Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

MMCRec: Towards Multi-modal Generative AI in Conversational Recommendation

Mukande, Tendai orcid logoORCID: 0000-0002-0654-7141, Ali, Esraa orcid logoORCID: 0000-0003-1600-3161, Caputo, Annalina orcid logoORCID: 0000-0002-7144-8545, Dong, Ruihai orcid logoORCID: 0000-0002-2509-1370 and O’Connor, Noel E. orcid logoORCID: 0000-0002-4033-9135 (2024) MMCRec: Towards Multi-modal Generative AI in Conversational Recommendation. In: 46th European Conference on Information Retrieval, ECIR 2024, 24 - 28 March, 2024, Glasgow, UK. ISBN 978-3-031-56063-7

Abstract
Personalized recommendation systems have become integral in this digital age by facilitating content discovery to users and products tailored to their preferences. Since the Generative Artificial Intelligence (GAI) boom, research into GAI-enhanced Conversational Recommender Systems (CRSs) has sparked great interest. Most existing methods, however, mainly rely on one mode of input such as text, thereby limiting their ability to capture content diversity. This is also inconsistent with real-world scenarios, which involve multi-modal input data and output data. To address these limitations, we propose the Multi-Modal Conversational Recommender System (MMCRec) model which harnesses multiple modalities, including text, images, voice and video to enhance the recommendation performance and experience. Our model is capable of not only accepting multi-mode input, but also generating multi-modal output in conversational recommendation. Experimental evaluations demonstrate the effectiveness of our model in real-world conversational recommendation scenarios.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:Generative AI, Large Language Model, Conversational Recommendation, Graph Neural Network, Diffusion Model
Subjects:Computer Science > Artificial intelligence
Computer Science > Information retrieval
Computer Science > World Wide Web
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Published in: Lecture Notes in Computer Science. European Conference on Information Retrieval 14610. Springer Nature. ISBN 978-3-031-56063-7
Publisher:Springer Nature
Official URL:https://link.springer.com/chapter/10.1007/978-3-03...
Copyright Information:Authors
Funders:Research Ireland ML-LABS - Grant number 18/CRT/6183
ID Code:32647
Deposited On:18 May 2026 09:59 by Tendai Mukande . Last Modified 18 May 2026 09:59
Documents

Full text available as:

[thumbnail of ECIR_24.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0
381kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record