2021•Journal of Physics Conference SeriesOpen access

Research on Big Data Computing Model based on Spark and Big Data Application

Sida Chen

Open full text 3 citations

Abstract

Abstract Under the background of the information age, with the rapid development of cloud computing and Internet of things technology, all kinds of data information grow rapidly. How to transform massive data information into effective resources is the key point of big data technology research. This paper introduces the inherent laws of big data mining technology, determine and use valuable information data, which can open a new thinking and cognitive perspective, and it is of great significance to the development of the social economy. It can be concluded that the big data ecosystem based on spark platform and application of big data still have a lot of room for development, but there are also some problems. Nowadays, as a low latency cluster distributed computing system for big data collection, spark platform can provide more support for improving the efficiency of big data mining, but some of its methods are not perfect.

Open-access reader

About this research paper

What this paper is about

Abstract Under the background of the information age, with the rapid development of cloud computing and Internet of things technology, all kinds of data information grow rapidly. How to transform massive data information into effective resources is the key point of big data technology research. This paper introduces the inherent laws of big data mining technology, determine and use valuable information data, which can open a new thinking and cognitive perspective, and it is of great significance to the development of the social economy. It can be concluded that the big data ecosystem based on spark platform and application of big data still have a lot of room for development, but there are also some problems. Nowadays, as a low latency cluster distributed computing system for big data collection, spark platform can provide more support for improving the efficiency of big data mining, but some of its methods are not perfect.

Why it matters

OpenAlex reports 3 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Abstract Under the background of the information age, with the rapid development of cloud computing and Internet of things technology, all kinds of data information grow rapidly. How to transform massive data information into effective resources is the key point of big data technology research. This paper introduces the inherent laws of big data mining technology, determine and use valuable information data, which can open a new thinking and cognitive perspective, and it is of great significance to the development of the social economy. It can be concluded that the big data ecosystem based on spark platform and application of big data still have a lot of room for development, but there are also some problems. Nowadays, as a low latency cluster distributed computing system for big data collection, spark platform can provide more support for improving the efficiency of big data mining, but some of its methods are not perfect.

Key concepts: Big data, SPARK (programming language), Data science, Computer science, Cloud computing, The Internet, Data mining, World Wide Web

Related papers

Back to paper searchBrowse research topicsOriginal source
Research on Big Data Computing Model based on Spark and Big Data Application — Research Paper | ScholarLens