Design of ETL System for Drilling Data Warehouse
Jinglei Yang
Abstract
Jinglei Yang
Abstract
With the development of information,oil unit makes a plan for data integration.It is not easy to process data integration from different data source.At first,it takes much time and money to clean dirty data by hand,and it is difficult to guarantee quality;Second,it is hard to update data on a regular time.ETL system for data integration provides a satisfying solution.It can complete many tasks,such as data extraction,cleaning,transforming and loading etc,meet the needs of heterogeneous data source integration and also realize to update data.The article designs ETL system for drilling data warehouse which is based on a metadata ETL architecture,and focus on the design of the data preparation area,ETL management module,the task management module and the metadata management module.ETL tool has been used in COSL Chemical Technology Expert Support System.
A significance statement is not available in the OpenAlex record.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
With the development of information,oil unit makes a plan for data integration.It is not easy to process data integration from different data source.At first,it takes much time and money to clean dirty data by hand,and it is difficult to guarantee quality;Second,it is hard to update data on a regular time.ETL system for data integration provides a satisfying solution.It can complete many tasks,such as data extraction,cleaning,transforming and loading etc,meet the needs of heterogeneous data source integration and also realize to update data.The article designs ETL system for drilling data warehouse which is based on a metadata ETL architecture,and focus on the design of the data preparation area,ETL management module,the task management module and the metadata management module.ETL tool has been used in COSL Chemical Technology Expert Support System.
Key concepts: Data warehouse, Computer science, Metadata, Data integration, Database, Data element, Data quality, Data management