Keywords
Data governance
Cleansing and transformation
Data development
Sharing and exchange
Submitted : 2024-05-21
Accepted : 2024-06-05
Published : 2024-06-20
Abstract
Contemporary mainstream big data governance platforms are built atop the big data ecosystem components, offering a one-stop development and analysis governance platform for the collection, transmission, storage, cleansing, transformation, querying and analysis, data development, publishing, and subscription, sharing and exchange, management, and services of massive data. These platforms serve various role members who have internal and external data needs. However, in the era of big data, the rapid update and iteration of big data technologies, the diversification of data businesses, and the exponential growth of data present more challenges and uncertainties to the construction of big data governance platforms. This paper discusses how to effectively build a data governance platform under the big data system from the perspectives of functional architecture, logical architecture, data architecture, and functional design.
References
Chen XW, Lin X, 2014, Big Data Deep Learning: Challenges and Perspectives. IEEE Access, 2: 514–525.
Zhang Q, Yang LT, Chen Z, et al., 2018, A Survey on Deep Learning for Big Data. Information Fusion, 42: 146–157.
Li Y, Huang C, Ding L, et al., 2019, Deep Learning in Bioinformatics: Introduction, Application, and Perspective in the Big Data Era. Methods, 166: 4–21.
Pansara R, 2023, Unraveling the Complexities of Data Governance with Strategies, Challenges, and Future Directions. Transactions on Latest Trends in IoT, 6(6): 46–56.
Ridzuan F, Zainon WMNW, 2019, A Review on Data Cleansing Methods for Big Data. Procedia Computer Science, 161: 731–738.
Chu X, Ilyas IF, Krishnan S, et al., 2016, Data Cleaning: Overview and Emerging Challenges. Proceedings of the 2016 International Conference on Management of Data, 2201–2206.
Espinoza J, Xu NY, Nguyen KT, et al., 2023, The Need for Data Standards and Implementation Policies to Integrate CGM Data into the Electronic Health Record. Journal of Diabetes Science and Technology, 17(2): 495–502.
Mohammed S, Nanthini S, Krishna NB, et al., 2023, A New Lightweight Data Security System for Data Security in the Cloud Computing. Measurement: Sensors, 29: 100856.
Adeoye-Olatunde OA, Olenik NL, 2021, Research and Scholarly Methods: Semi-Structured Interviews. Journal of the American College of Clinical Pharmacy, 4(10): 1358–1367.