1992Unpublished venueOpen access

Processing multi-join query in parallel systems

Kian‐Lee Tan, Hongjun Lü

Open full text 8 citations

Abstract

In parallel systems, a number of joins from one or more queries ean be exeeuted either seriatly or in parallel.While seriat execution assigns all processors to execute each join one after another, the parallel execution distributes the joins to clusters formed by certain number of processors and exeeutes them concurrently.Both approaches employ parallelism to improve system performance.However, data skew may result in load imbalance among processors executing the same join and some clusters may be overloaded with time-consuming joins.As a result, the completion time will be much longer than what is expeeted.In this paper, we propose an algorithm to further minimize the completion time of concurrently executed multiple joins.For this algorithm, all the joins to be executed concurrently are decomposed into a set of tasks that are ordered according to decreasing task size.These tasks are dynamically allocated to available processors during exeeution.Our performance study shows that the proposed algorithm outperforms the previously proposed approaches, especially when number of processors increases, high skewness is present in the relations to be joined and relation sizes are large.

Open-access reader

About this research paper

What this paper is about

In parallel systems, a number of joins from one or more queries ean be exeeuted either seriatly or in parallel.While seriat execution assigns all processors to execute each join one after another, the parallel execution distributes the joins to clusters formed by certain number of processors and exeeutes them concurrently.Both approaches employ parallelism to improve system performance.However, data skew may result in load imbalance among processors executing the same join and some clusters may be overloaded with time-consuming joins.As a result, the completion time will be much longer than what is expeeted.In this paper, we propose an algorithm to further minimize the completion time of concurrently executed multiple joins.For this algorithm, all the joins to be executed concurrently are decomposed into a set of tasks that are ordered according to decreasing task size.These tasks are dynamically allocated to available processors during exeeution.Our performance study shows that the proposed algorithm outperforms the previously proposed approaches, especially when number of processors increases, high skewness is present in the relations to be joined and relation sizes are large.

Why it matters

OpenAlex reports 8 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

In parallel systems, a number of joins from one or more queries ean be exeeuted either seriatly or in parallel.While seriat execution assigns all processors to execute each join one after another, the parallel execution distributes the joins to clusters formed by certain number of processors and exeeutes them concurrently.Both approaches employ parallelism to improve system performance.However, data skew may result in load imbalance among processors executing the same join and some clusters may be overloaded with time-consuming joins.As a result, the completion time will be much longer than what is expeeted.In this paper, we propose an algorithm to further minimize the completion time of concurrently executed multiple joins.For this algorithm, all the joins to be executed concurrently are decomposed into a set of tasks that are ordered according to decreasing task size.These tasks are dynamically allocated to available processors during exeeution.Our performance study shows that the proposed algorithm outperforms the previously proposed approaches, especially when number of processors increases, high skewness is present in the relations to be joined and relation sizes are large.

Key concepts: Join (topology), Computer science, Citation, Information retrieval, World Wide Web, Database, Mathematics, Combinatorics

Related papers

Back to paper searchBrowse research topicsOriginal source
Processing multi-join query in parallel systems — Research Paper | ScholarLens