Research on Big Data Computing Model based on Spark and Big Data Application
Sida Chen
Abstract
Open-access reader
Sida Chen
Abstract
Open-access reader
Abstract Under the background of the information age, with the rapid development of cloud computing and Internet of things technology, all kinds of data information grow rapidly. How to transform massive data information into effective resources is the key point of big data technology research. This paper introduces the inherent laws of big data mining technology, determine and use valuable information data, which can open a new thinking and cognitive perspective, and it is of great significance to the development of the social economy. It can be concluded that the big data ecosystem based on spark platform and application of big data still have a lot of room for development, but there are also some problems. Nowadays, as a low latency cluster distributed computing system for big data collection, spark platform can provide more support for improving the efficiency of big data mining, but some of its methods are not perfect.
OpenAlex reports 3 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
Abstract Under the background of the information age, with the rapid development of cloud computing and Internet of things technology, all kinds of data information grow rapidly. How to transform massive data information into effective resources is the key point of big data technology research. This paper introduces the inherent laws of big data mining technology, determine and use valuable information data, which can open a new thinking and cognitive perspective, and it is of great significance to the development of the social economy. It can be concluded that the big data ecosystem based on spark platform and application of big data still have a lot of room for development, but there are also some problems. Nowadays, as a low latency cluster distributed computing system for big data collection, spark platform can provide more support for improving the efficiency of big data mining, but some of its methods are not perfect.
Key concepts: Big data, SPARK (programming language), Data science, Computer science, Cloud computing, The Internet, Data mining, World Wide Web