2020Proceedings of the 4th International Conference on Computer Science and Application EngineeringRequires access

Design of ETL Tool for Structured Data Based on Data Warehouse

Jingting Wang, Bao Liu

Open publisher page 4 citations

Abstract

This paper takes the current business system of a mobile communication-equipment-chain sales-service-company as an example, and analyzes the problem that the data from multiple data sources cannot directly be loaded into the data warehouse by the current commercial ETL (Extraction-Transformation-Loading, ETL) tool. Firstly, it designs the logical model of ETL tool based on the metadata, then customizes the data cleaning method in ETL tool. Finally, the system experiments are carried out on ETL tool, and the experimental results and analysis are given. Through the development of the ETL tool, an interface is provided for the user-defined data cleaning function, which makes up for the shortage of the custom data cleaning function by the commercial ETL tool, thereby the use efficiency of the ETL tool is improved.

About this research paper

What this paper is about

This paper takes the current business system of a mobile communication-equipment-chain sales-service-company as an example, and analyzes the problem that the data from multiple data sources cannot directly be loaded into the data warehouse by the current commercial ETL (Extraction-Transformation-Loading, ETL) tool. Firstly, it designs the logical model of ETL tool based on the metadata, then customizes the data cleaning method in ETL tool. Finally, the system experiments are carried out on ETL tool, and the experimental results and analysis are given. Through the development of the ETL tool, an interface is provided for the user-defined data cleaning function, which makes up for the shortage of the custom data cleaning function by the commercial ETL tool, thereby the use efficiency of the ETL tool is improved.

Why it matters

OpenAlex reports 4 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

This paper takes the current business system of a mobile communication-equipment-chain sales-service-company as an example, and analyzes the problem that the data from multiple data sources cannot directly be loaded into the data warehouse by the current commercial ETL (Extraction-Transformation-Loading, ETL) tool. Firstly, it designs the logical model of ETL tool based on the metadata, then customizes the data cleaning method in ETL tool. Finally, the system experiments are carried out on ETL tool, and the experimental results and analysis are given. Through the development of the ETL tool, an interface is provided for the user-defined data cleaning function, which makes up for the shortage of the custom data cleaning function by the commercial ETL tool, thereby the use efficiency of the ETL tool is improved.

Key concepts: Data warehouse, Computer science, Database, Online analytical processing

Related papers

Back to paper searchBrowse research topicsOriginal source
Design of ETL Tool for Structured Data Based on Data Warehouse — Research Paper | ScholarLens