Díaz, José-Luis Preza, Dorn, Amelie, Koch, Gerda and Abgaz, Yalemisew (2020) A Comparative Approach between Different Computer Vision Tools, Including Commercial and Open-source, for Improving Cultural Image Access and Analysis. In: 2020 10th International Conference on Advanced Computer Information Technologies (ACIT).
Abstract
Digital cultural heritage objects can benefit greatly from the application of Artificial Intelligence such as computer vision based tools to automatically extract valuable information from them. Novel methods and technologies have been used in the last few years to perform image classification,
object detection, caption generation, and other techniques on different types of digital objects from different disciplines. In this pilot study, carried out in the context of the Digital Humanities project ChIA, we present an approach for testing different commercial (Clarifai, IBM Watson, Microsoft
Cognitive Services, Google Cloud Vision) and open-source (YOLO) computer vision (CV) tools on a set of selected cultural food images from the Europeana collection with regard to producing relevant concepts. The project generally aims at improving access to implicit cultural knowledge contained in images, and increase analysis possibilities for scientific research as well as for content providers and educational purposes.
Preliminary results showed that not only quantitative output
results are important, but also the quality of concepts generated.
Types of digital objects can pose a challenge to CV solutions
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Uncontrolled Keywords: | Tools;Cultural differences;Painting;Computer vision;Europe;Google;Artificial intelligence;Artificial Intelligence;Computer Vision;image analysis;cultural heritage |
Subjects: | Computer Science > Artificial intelligence Computer Science > Image processing Computer Science > Machine learning Humanities > Culture |
DCU Faculties and Centres: | UNSPECIFIED |
Funders: | Austrian Academy of Sciences, SFI, ADAPT Grant 13/RC/2106) |
ID Code: | 30058 |
Deposited On: | 11 Jun 2024 13:14 by Yalemisew Abgaz . Last Modified 11 Jun 2024 13:14 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial-No Derivative Works 4.0 5MB |
Metrics
Altmetric Badge
Dimensions Badge
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record