Mukande, Tendai
ORCID: 0000-0002-0654-7141, Ali, Esraa
ORCID: 0000-0003-1600-3161, Caputo, Annalina
ORCID: 0000-0002-7144-8545, Dong, Ruihai
ORCID: 0000-0002-2509-1370 and O’Connor, Noel E.
ORCID: 0000-0002-4033-9135
(2024)
MMCRec: Towards Multi-modal Generative AI in Conversational Recommendation.
In: 46th European Conference on Information Retrieval, ECIR 2024, 24 - 28 March, 2024, Glasgow, UK.
ISBN 978-3-031-56063-7
Abstract
Personalized recommendation systems have become integral in this digital age by facilitating content discovery to users and products tailored to their preferences. Since the Generative Artificial Intelligence (GAI) boom, research into GAI-enhanced Conversational Recommender Systems (CRSs) has sparked great interest. Most existing methods, however, mainly rely on one mode of input such as text, thereby limiting their ability to capture content diversity. This is also inconsistent with real-world scenarios, which involve multi-modal input data and output data. To address these limitations, we propose the Multi-Modal Conversational Recommender System (MMCRec) model which harnesses multiple modalities, including text, images, voice and video to enhance the recommendation performance and experience. Our model is capable of not only accepting multi-mode input, but also generating multi-modal output in conversational recommendation. Experimental evaluations demonstrate the effectiveness of our model in real-world conversational recommendation scenarios.
Metadata
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Event Type: | Conference |
| Refereed: | Yes |
| Uncontrolled Keywords: | Generative AI, Large Language Model, Conversational Recommendation, Graph Neural Network, Diffusion Model |
| Subjects: | Computer Science > Artificial intelligence Computer Science > Information retrieval Computer Science > World Wide Web |
| DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing |
| Published in: | Lecture Notes in Computer Science. European Conference on Information Retrieval 14610. Springer Nature. ISBN 978-3-031-56063-7 |
| Publisher: | Springer Nature |
| Official URL: | https://link.springer.com/chapter/10.1007/978-3-03... |
| Copyright Information: | Authors |
| Funders: | Research Ireland ML-LABS - Grant number 18/CRT/6183 |
| ID Code: | 32647 |
| Deposited On: | 18 May 2026 09:59 by Tendai Mukande . Last Modified 18 May 2026 09:59 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0 381kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record