Research on Distributed Index Mechanism for Large Dataset

In this paper we focus on index structure of distributed storage system for large-scale structured/semi-structured dataset. We propose a hybrid index structure based on clustering index and B+ tree, which defines the input, storage and query operation on the dataset, and analyze the communication model between index server and client. Because of different handling policy on record's primary keyword and other attributes, our architecture obtains good performance under different retrieval conditions.