M-Data-Fabric: A Data Fabric System Based on Metadata
Kang Liu, Mingchuan Yang, Xinchi Li, Kaicheng Zhang, Xiaoqing Xia, Hui Yan
Abstract
Kang Liu, Mingchuan Yang, Xinchi Li, Kaicheng Zhang, Xiaoqing Xia, Hui Yan
Abstract
The data has become an island within the application, indicating that the data has not been fully utilized. Throughout the current performance ranking, almost all enterprises are data-driven enterprises. However, several challenges prevent them from making full use of all data, lack of data access, numerous data sources and data types, and complex data integration. Research shows that in most enterprises, up to 74% of the data has not been analyzed, and up to 82 % of enterprises are restricted by data islands. In order to solve the above problems, this paper designs a metadata based data fabric system architecture (M-Data-Fabric). M-Data-Fabric realizes the overall use of different data sources rather than reuse according to the process of metadata identification, analysis, integration, integration and knowledge map construction. By analyzing the relationship between data sources, metadata is aggregated through strong business After correlation, the whole business knowledge map is obtained.
OpenAlex reports 14 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
The data has become an island within the application, indicating that the data has not been fully utilized. Throughout the current performance ranking, almost all enterprises are data-driven enterprises. However, several challenges prevent them from making full use of all data, lack of data access, numerous data sources and data types, and complex data integration. Research shows that in most enterprises, up to 74% of the data has not been analyzed, and up to 82 % of enterprises are restricted by data islands. In order to solve the above problems, this paper designs a metadata based data fabric system architecture (M-Data-Fabric). M-Data-Fabric realizes the overall use of different data sources rather than reuse according to the process of metadata identification, analysis, integration, integration and knowledge map construction. By analyzing the relationship between data sources, metadata is aggregated through strong business After correlation, the whole business knowledge map is obtained.
Key concepts: Metadata, Data element, Data mapping, Metadata repository, Computer science, Data integration, Metadata management, Data architecture