Browse DORAS
Browse Theses
Latest Additions
Creative Commons License
Except where otherwise noted, content on this site is licensed for use under a:

Data quality for web log data using a Hadoop environment

Yang, Qishan and Helfert, Markus (2016) Data quality for web log data using a Hadoop environment. In: 21st ICIQ 2016, 22-23 Jun 2016, Ciudad Real, Spain.

Full text available as:

PDF (Data Quality for Web Log Data Using a Hadoop Environment) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


Solving data quality problems is important for data warehouse construction and operation. This paper is based on developing a web log warehouse. It proposes a data quality problem methodology for data preprocessing within the log warehouse. It provides a hierarchical data warehouse architecture that is suitable for resource saving and ad hoc requirements. The data preprocessing is completed using Hadoop associated with its sub-projects such as Hive, HBase etc. In this paper we compare a Hadoop setup with a Oracle based architecture.

Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Uncontrolled Keywords:Hadoop
Subjects:Computer Science > Information storage and retrieval systems
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Published in:Data Quality for Web Log Data Using a Hadoop Environment. (21).
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
ID Code:21297
Deposited On:29 Jul 2016 11:19 by Qishan Yang. Last Modified 24 May 2017 09:40

Download statistics

Archive Staff Only: edit this record