Riaz, Hamza and Smeaton, Alan F. ORCID: 0000-0003-1028-8389 (2023) Vision based machine learning algorithms for out-of-distribution generalisation. In: Science and Information Conference (SAI 023), 13-14 July 2023, London, UK.
Abstract
There are many computer vision applications including object segmentation, classification, object detection, and reconstruction for which machine learning (ML) shows state-of-the-art performance. Nowadays, we can build ML tools for such applications with real-world accuracy. However, each tool works well within the domain in which it has been trained and developed. Often, when we train a model on a dataset in one specific domain and test on another unseen domain known as an out of distribution (OOD) dataset, models or ML tools show a decrease in performance. For instance, when we train a simple classifier on real-world images and apply that model on the same classes but with a different domain like cartoons, paintings or sketches then the performance of ML tools disappoints. This presents serious challenges of domain generalisation (DG), domain adaptation (DA), and domain shifting. To enhance the power of ML tools, we can rebuild and retrain models from scratch or we can perform transfer learning. In this paper, we present a comparison study between vision-based technologies for domain-specific and domain-generalised methods. In this research we highlight that simple convolutional neural network (CNN) based deep learning methods perform poorly when they have to tackle domain shifting. Experiments are conducted on two popular vision-based benchmarks, PACS and Office-Home. We introduce an implementation pipeline for domain generalisation methods and conventional deep learning models. The outcome confirms that CNN-based deep learning models show poor generalisation compare to other extensive methods.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Uncontrolled Keywords: | Vision Machine Learning; Domain Generalisation; Domain Adaptation; Domain Shifting; Domain Specific Learning |
Subjects: | Computer Science > Artificial intelligence Computer Science > Machine learning |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing Research Institutes and Centres > INSIGHT Centre for Data Analytics |
Published in: | Arai, Kohei, (ed.) SAI 2023: Intelligent Computing. Lecture Notes in Networks and Systems 739. Springer. |
Publisher: | Springer |
Official URL: | https://doi.org/10.1007/978-3-031-37963-5_60 |
Copyright Information: | © 2023 The Authors |
Funders: | Science Foundation Ireland Grant number 18/CRT/6183., Science Foundation Ireland (SFI) under Grant Number SFI/12/RC/2289_P2, European Regional Development Fund. |
ID Code: | 28028 |
Deposited On: | 21 Jun 2023 15:05 by Alan Smeaton . Last Modified 16 Nov 2023 15:42 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial 4.0 2MB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record