2016Unpublished venueRequires access

Provision of Docker and InfiniBand in High Performance Computing

Minh Thanh Chung, An Van Le, Nguyen Quang-Hung, Duc-Dung Nguyen, Nam Thoai

Open publisher page 9 citations

Abstract

High Performance Computing (HPC) is playing an important role in a variety of domains with the demand of high-level computational capacity. Besides, HPC provides services for a huge range of different users as well as multiple environments. Hence, the performance of the network is also one of the important criteria. The advent of InfiniBand (IB) aims at the improvement of computer-networking. IB technology has been used and expanded on virtualization environments, especially in virtual machines (VMs). Recently, another virtualization technique known as Docker platform is being popularly considered. Docker promises to bring higher performance, but it also poses some challenging problems. Concretely, while VMs are combined with IB by standard virtualization modules such as SR-IOV, Docker containers are still being examined on feasible solutions with IB. An important question is the advantages and disadvantages of both architectures, namely VM and Docker. In this paper, we deploy Docker on IB infrastructure and evaluate their performance with VMs. Remarkably, we highlight the benefits and the drawbacks of Docker in the conflict of resources when its architecture shares the same kernel with the host. Our evaluations emphasize the potential of Docker containers in HPC field, simultaneously, we propose experiences when using Docker for running parallel applications.

About this research paper

What this paper is about

High Performance Computing (HPC) is playing an important role in a variety of domains with the demand of high-level computational capacity. Besides, HPC provides services for a huge range of different users as well as multiple environments. Hence, the performance of the network is also one of the important criteria. The advent of InfiniBand (IB) aims at the improvement of computer-networking. IB technology has been used and expanded on virtualization environments, especially in virtual machines (VMs). Recently, another virtualization technique known as Docker platform is being popularly considered. Docker promises to bring higher performance, but it also poses some challenging problems. Concretely, while VMs are combined with IB by standard virtualization modules such as SR-IOV, Docker containers are still being examined on feasible solutions with IB. An important question is the advantages and disadvantages of both architectures, namely VM and Docker. In this paper, we deploy Docker on IB infrastructure and evaluate their performance with VMs. Remarkably, we highlight the benefits and the drawbacks of Docker in the conflict of resources when its architecture shares the same kernel with the host. Our evaluations emphasize the potential of Docker containers in HPC field, simultaneously, we propose experiences when using Docker for running parallel applications.

Why it matters

OpenAlex reports 9 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

High Performance Computing (HPC) is playing an important role in a variety of domains with the demand of high-level computational capacity. Besides, HPC provides services for a huge range of different users as well as multiple environments. Hence, the performance of the network is also one of the important criteria. The advent of InfiniBand (IB) aims at the improvement of computer-networking. IB technology has been used and expanded on virtualization environments, especially in virtual machines (VMs). Recently, another virtualization technique known as Docker platform is being popularly considered. Docker promises to bring higher performance, but it also poses some challenging problems. Concretely, while VMs are combined with IB by standard virtualization modules such as SR-IOV, Docker containers are still being examined on feasible solutions with IB. An important question is the advantages and disadvantages of both architectures, namely VM and Docker. In this paper, we deploy Docker on IB infrastructure and evaluate their performance with VMs. Remarkably, we highlight the benefits and the drawbacks of Docker in the conflict of resources when its architecture shares the same kernel with the host. Our evaluations emphasize the potential of Docker containers in HPC field, simultaneously, we propose experiences when using Docker for running parallel applications.

Key concepts: Virtualization, InfiniBand, Computer science, Operating system, Virtual machine, Supercomputer, Emulation, Host (biology)

Related papers

Back to paper searchBrowse research topicsOriginal source
Provision of Docker and InfiniBand in High Performance Computing — Research Paper | ScholarLens