McCarthy, Suzanne, McCarren, Andrew ORCID: 0000-0002-7297-0984 and Roantree, Mark ORCID: 0000-0002-1329-2570 (2018) An architecture and services for constructing data marts from online data sources. Technical Report. UNSPECIFIED.
Abstract
The Agri sector has shown an exponential growth in both the requirement for and the production and availability of data. In parallel with this growth, Agri organisations often have a need to integrate their in-house data with international, web-based datasets. Generally, data is freely available from official government sources but there is very little unity between sources, often leading to significant manual overhead in the development of data integration systems and the preparation of reports. While this has led to an increased use of data warehousing technology in the Agri sector, the issues of cost in terms of both time to access data and the financial costs of generating the Extract-Transform-Load layers remain high. In this work, we examine more lightweight data marts in an infrastructure which can support on-demand queries. We focus on the construction of data marts which combine both enterprise and web data, and present an evaluation which verifies the transformation process from source to data mart.
Metadata
Item Type: | Monograph (Technical Report) |
---|---|
Refereed: | No |
Subjects: | Computer Science > Artificial intelligence |
DCU Faculties and Centres: | Research Institutes and Centres > INSIGHT Centre for Data Analytics DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
Funders: | Science Foundation Ireland grant number SFI/12/RC/2289 |
ID Code: | 22386 |
Deposited On: | 06 Jun 2018 10:29 by Mark Roantree . Last Modified 03 Mar 2021 12:21 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
948kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record