2021Unpublished venueRequires access

Addition of Process Decomposition in Open Source Tools-Based Cleansing Data Modules

Dita Aprillia Rahmani, Tien Fabrianti Kusumasari, Ekky Novriza Alam

Open publisher page 3 citations

Abstract

In today's technological developments, data has an important role in supporting the achievement of goals for the company. The importance of data for companies is to fulfill the quality of supporting the company's business needs. The high quality that data has is of critical value to the company. However, there are many errors in the data that reduce the quality. Low-quality data, i.e., the data is inaccurate, incomplete, or out of date. There is a need for data quality management or Data Quality Management to manage data quality improvements to become consistent, accurate, complete, timely, and unique data. Regulating the quality of the data requires data cleansing. Data cleansing is a method to improve low-quality data by producing high-quality data. Therefore, this study will discuss the analysis and design of the decomposition of process packages for data cleansing in order to improve the quality of data that does not meet the company's needs. In the design carried out, the authors provide several solutions based on analysis to meet the needs of the company's data cleansing process flexibly with the decomposition of the process package that will be implemented using open-source tools, namely Pentaho Data Integration as the result of this research. There is a comparative evaluation using OpenRefine, which results in data cleansing using Pentaho Data Integration which is superior in the overall data cleaning process.

About this research paper

What this paper is about

In today's technological developments, data has an important role in supporting the achievement of goals for the company. The importance of data for companies is to fulfill the quality of supporting the company's business needs. The high quality that data has is of critical value to the company. However, there are many errors in the data that reduce the quality. Low-quality data, i.e., the data is inaccurate, incomplete, or out of date. There is a need for data quality management or Data Quality Management to manage data quality improvements to become consistent, accurate, complete, timely, and unique data. Regulating the quality of the data requires data cleansing. Data cleansing is a method to improve low-quality data by producing high-quality data. Therefore, this study will discuss the analysis and design of the decomposition of process packages for data cleansing in order to improve the quality of data that does not meet the company's needs. In the design carried out, the authors provide several solutions based on analysis to meet the needs of the company's data cleansing process flexibly with the decomposition of the process package that will be implemented using open-source tools, namely Pentaho Data Integration as the result of this research. There is a comparative evaluation using OpenRefine, which results in data cleansing using Pentaho Data Integration which is superior in the overall data cleaning process.

Why it matters

OpenAlex reports 3 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

In today's technological developments, data has an important role in supporting the achievement of goals for the company. The importance of data for companies is to fulfill the quality of supporting the company's business needs. The high quality that data has is of critical value to the company. However, there are many errors in the data that reduce the quality. Low-quality data, i.e., the data is inaccurate, incomplete, or out of date. There is a need for data quality management or Data Quality Management to manage data quality improvements to become consistent, accurate, complete, timely, and unique data. Regulating the quality of the data requires data cleansing. Data cleansing is a method to improve low-quality data by producing high-quality data. Therefore, this study will discuss the analysis and design of the decomposition of process packages for data cleansing in order to improve the quality of data that does not meet the company's needs. In the design carried out, the authors provide several solutions based on analysis to meet the needs of the company's data cleansing process flexibly with the decomposition of the process package that will be implemented using open-source tools, namely Pentaho Data Integration as the result of this research. There is a comparative evaluation using OpenRefine, which results in data cleansing using Pentaho Data Integration which is superior in the overall data cleaning process.

Key concepts: Data cleansing, Data quality, Computer science, Quality (philosophy), Data governance, Process (computing), Data management, Data integration

Related papers

Back to paper searchBrowse research topicsOriginal source
Addition of Process Decomposition in Open Source Tools-Based Cleansing Data Modules — Research Paper | ScholarLens