Custom data quality mechanism in Data Warehouse facilitated by data integrity checks

Authors

DOI:

https://doi.org/10.55630/mem.2024.53.067-075

Keywords:

Data Warehouse, data quality, ground transportation, SQL, data, checks, data governance, data maintenance

Abstract

In the era of data-driven decision-making, Data Warehousing (DWH) is crucial for organizations seeking to leverage extensive datasets. However, the success of DWH initiatives depends on the quality of the enclosed data. Insufficient quality data in Data Warehousing can impact the accuracy of analytical results, leading to misguided decisions and reduced business performance. This paper examines the significance of Data Quality Mechanisms in addressing challenges related to data quality. Data Quality Mechanisms play a crucial role in identifying, rectifying, and preventing data quality issues throughout the data lifecycle. This paper explores fundamental concepts, challenges, and impacts of data quality on business operations. It emphasizes the critical role of robust Data Quality Mechanisms in ensuring the accuracy, completeness, and reliability of data within the Data Warehousing ecosystem. As organizations increasingly recognize data as a strategic asset, it is imperative to implement effective data quality mechanisms to unlock the true potential of data warehouses and derive actionable insights.

Author Biographies

Angel Georgiev, Faculty of Mathematics and Informatics, Paisii Hilendarski University of Plovdiv, Plovdiv, Bulgaria

Faculty of Mathematics and Informatics
Paisii Hilendarski University of Plovdiv
236, Bulgaria Blvd.
4027 Plovdiv, Bulgaria

E-mail: angel.georgiev@uni-plovdiv.bg

Vladimir Valkanov, Faculty of Mathematics and Informatics, Paisii Hilendarski University of Plovdiv, Plovdiv, Bulgaria

Faculty of Mathematics and Informatics
Paisii Hilendarski University of Plovdiv
236, Bulgaria Blvd.
4027 Plovdiv, Bulgaria

E-mail: vvalkanov@uni-plovdiv.net

 

References

W. H. Inmon. Building the Data Warehouse, 4th edn. Wiley India Pvt. Limited, 2005.

ISBN 9788126506453.

R. Kimball, M. Ross. The Data Warehouse Toolkit: The Complete Guide to Dimensional Modeling. 3rd edn. Indianapolis, John Wiley & Sons, Inc., 2013, ISBN 9780471153375.

B. Moses, L. Gavish, M. Vorwerck. Data Quality Fundamentals. O’Reilly Media, Inc., 2022, ISBN 9781098112011.

J. Reis, M. Housley. Fundamentals of Data Engineering: Plan and Build Robust Data Systems. O’Reilly Media, Inc., 2022. ISBN 9781098108304.

Q. Liu, G. Feng, G. K. Tayi, J. Tian.. Managing Data Quality of the Data Warehouse: A Chance-Constrained Programming Approach. Inf. Syst. Front. 23 (2021), 375–389, https://doi.org/10.1007/s10796-019-09963-5.

M. R. Sureddy, P. Yallamula. Data Quality Architecture for Data Ware- houses. International Journal of Research Culture Society, 4, no. 6 (2020), 95–100, DOIs:10.2017/IJRCS.2456.6683/202006017.

A. Fattah, T. Ridwan, N. Sulistiyowati. Dimensional Data Design for Event Feedback Data Warehouse. JISA (Jurnal Informatika dan Sains), 6, no. 1 (2023) 69–73. https: //doi.org/10.31326/jisa.v6i1.1648.

H. Benkhaled, D. Berrabah, F. Boufare`s. Data Warehouses and Big Data: How to Cope With Data Quality. International Journal of Organizational and Collective Intelligence (IJOCI), 10, no. 3 (2020), 13 pp, https://doi.org/10.4018/IJOCI.2020070101.

N. Gupta. Optimising data quality of a data warehouse using data purgation process. International Journal of Data Mining, Modelling and Management. 15, no. 1 (2023), 102– 131, https://doi.org/10.1504/IJDMMM.2023.10055198.

M. Altendeitering, T. Guggenberger. Data Quality Tools: Towards a Software Ref- erence Architecture. Hawaii International Conference on System Sciences (HICSS), 2024.

https://www.techtarget.com/searchdatamanagement/tip/Top-data-quality-management-tools (Last visited 23.12.2023)

Downloads

Published

2024-03-16

How to Cite

[1]
Georgiev, A. and Valkanov, V. 2024. Custom data quality mechanism in Data Warehouse facilitated by data integrity checks. Mathematics and Education in Mathematics. 53, (Mar. 2024), 67–75. DOI:https://doi.org/10.55630/mem.2024.53.067-075.

Issue

Section

Section B: Mathematical Modelling and Informatics