2016Unpublished venueRequires access

Performance Comparison on the Heterogeneous File System in Cloud Storage Systems

Weipeng Chen, Chuan-Ming Liu

Open publisher page 2 citations

Abstract

The number of small-and mid-cap companies increases in recent decades due to the change on technologies. A considerable number of information systems are thus built for efficient production and management. As a result, a large number of operations and data are generated. The internal IT unit must have the ability to process the large amount of data, provide different services for each kinds of users, and make proper data backup. Because of the limited human resources and budget, a self-owned cloud storage system, that can effectively unify the existing and future storage system, may be a good choice to fulfill the needs. Functions that should be considered in the cloud storage system include: storage resource virtualization, construction of storage pools, supply of online data access, and backup of web services. In this study, we compare three common file systems, namely GlusterFS, Lustre, and Hadoop, on the time cost and efficiency as well as build up a cloud storage system combining these three file systems. Experimental results are as follows. First, the Hadoop has the best performance when the storage is of larger than 200MB. Second, the Lustre performs the best when the storage is of less than 200MB and more than 4MB file. Last, the GlusterFS is the best when the storage is of less than 4MB.

About this research paper

What this paper is about

The number of small-and mid-cap companies increases in recent decades due to the change on technologies. A considerable number of information systems are thus built for efficient production and management. As a result, a large number of operations and data are generated. The internal IT unit must have the ability to process the large amount of data, provide different services for each kinds of users, and make proper data backup. Because of the limited human resources and budget, a self-owned cloud storage system, that can effectively unify the existing and future storage system, may be a good choice to fulfill the needs. Functions that should be considered in the cloud storage system include: storage resource virtualization, construction of storage pools, supply of online data access, and backup of web services. In this study, we compare three common file systems, namely GlusterFS, Lustre, and Hadoop, on the time cost and efficiency as well as build up a cloud storage system combining these three file systems. Experimental results are as follows. First, the Hadoop has the best performance when the storage is of larger than 200MB. Second, the Lustre performs the best when the storage is of less than 200MB and more than 4MB file. Last, the GlusterFS is the best when the storage is of less than 4MB.

Why it matters

OpenAlex reports 2 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

The number of small-and mid-cap companies increases in recent decades due to the change on technologies. A considerable number of information systems are thus built for efficient production and management. As a result, a large number of operations and data are generated. The internal IT unit must have the ability to process the large amount of data, provide different services for each kinds of users, and make proper data backup. Because of the limited human resources and budget, a self-owned cloud storage system, that can effectively unify the existing and future storage system, may be a good choice to fulfill the needs. Functions that should be considered in the cloud storage system include: storage resource virtualization, construction of storage pools, supply of online data access, and backup of web services. In this study, we compare three common file systems, namely GlusterFS, Lustre, and Hadoop, on the time cost and efficiency as well as build up a cloud storage system combining these three file systems. Experimental results are as follows. First, the Hadoop has the best performance when the storage is of larger than 200MB. Second, the Lustre performs the best when the storage is of less than 200MB and more than 4MB file. Last, the GlusterFS is the best when the storage is of less than 4MB.

Key concepts: Computer science, Object storage, Backup, Lustre (file system), Information repository, Cloud storage, Cloud computing, Database

Related papers

Back to paper searchBrowse research topicsOriginal source
Performance Comparison on the Heterogeneous File System in Cloud Storage Systems — Research Paper | ScholarLens