Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Combining web and enterprise data for lightweight data mart construction

McCarthy, Suzanne, McCarren, Andrew orcid logoORCID: 0000-0002-7297-0984 and Roantree, Mark (2018) Combining web and enterprise data for lightweight data mart construction. In: 29th International Conference on Database and Expert Systems Applications (DEXA 2018), 3- 6 Sept 2018, Regensburg, Germany. ISBN 978-3-319-98811-5

Abstract
The Agri sector has shown an exponential growth in both the requirement for and the production and availability of data. In parallel with this growth, Agri organisations often have a need to integrate their in-house data with international, web-based datasets. Generally, data is freely available from official government sources but there is very little unity between sources, often leading to significant manual overhead in the development of data integration systems and the preparation of reports. While this has led to an increased use of data warehousing technology in the Agri sector, the issues of cost in terms of both time to access data and the financial costs of generating the Extract-Transform-Load layers remain high. In this work, we examine more lightweight data marts in an infrastructure which can support on-demand queries. We focus on the construction of data marts which combine both enterprise and web data, and present an evaluation which verifies the transformation process from source to data mart.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Subjects:Computer Science > Computer engineering
Computer Science > Computer software
DCU Faculties and Centres:Research Institutes and Centres > INSIGHT Centre for Data Analytics
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Published in: Hartmann, Sven, Ma, Hui, Hameurlain, Abdelkader and Pernul, Günther, (eds.) 29th International Conference on Database and Expert Systems Applications (DEXA 2018), Proceedings Part 2. Lecture Notes in Computer Science 11030. Springer. ISBN 978-3-319-98811-5
Publisher:Springer
Official URL:https://doi.org/10.1007/978-3-319-98812-2_10
Copyright Information:© 2018 Springer
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Science Foundation Ireland grant number SFI/12/RC/2289
ID Code:22388
Deposited On:23 Jul 2018 11:58 by Mark Roantree . Last Modified 26 Jun 2019 13:48
Documents

Full text available as:

[thumbnail of DEXA 2018 Publication]
Preview
PDF (DEXA 2018 Publication) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
375kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record