Design of ETL Tool for Structured Data Based on Data Warehouse
Jingting Wang, Bao Liu
Abstract
Jingting Wang, Bao Liu
Abstract
This paper takes the current business system of a mobile communication-equipment-chain sales-service-company as an example, and analyzes the problem that the data from multiple data sources cannot directly be loaded into the data warehouse by the current commercial ETL (Extraction-Transformation-Loading, ETL) tool. Firstly, it designs the logical model of ETL tool based on the metadata, then customizes the data cleaning method in ETL tool. Finally, the system experiments are carried out on ETL tool, and the experimental results and analysis are given. Through the development of the ETL tool, an interface is provided for the user-defined data cleaning function, which makes up for the shortage of the custom data cleaning function by the commercial ETL tool, thereby the use efficiency of the ETL tool is improved.
OpenAlex reports 4 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
This paper takes the current business system of a mobile communication-equipment-chain sales-service-company as an example, and analyzes the problem that the data from multiple data sources cannot directly be loaded into the data warehouse by the current commercial ETL (Extraction-Transformation-Loading, ETL) tool. Firstly, it designs the logical model of ETL tool based on the metadata, then customizes the data cleaning method in ETL tool. Finally, the system experiments are carried out on ETL tool, and the experimental results and analysis are given. Through the development of the ETL tool, an interface is provided for the user-defined data cleaning function, which makes up for the shortage of the custom data cleaning function by the commercial ETL tool, thereby the use efficiency of the ETL tool is improved.
Key concepts: Data warehouse, Computer science, Database, Online analytical processing