Effect of Garbage Collection on Streaming Big Data Workloads
S Abhaay, MG Shashank, BS Shreyas, Subramaniam Kalambur
Abstract
S Abhaay, MG Shashank, BS Shreyas, Subramaniam Kalambur
Abstract
Java applications retrieve memory items as needed. The function of garbage collection (GC) on Java Virtual Machine (JVM) is to automatically determine which memory is no longer in use by the Java system and to deallocate the objects stored in this part of the memory. As memory is restored to JVM automatically, Java developers are not responsible for explicitly deleting unused memory items. We study the performance of various GCs on an Apache Kafka-Storm platform for processing a real-time workload. We demonstrate that the choice of the Garbage collector is sensitive to the configuration of Kafka and the impact of Garbage Collection events on the latency of processing application.
A significance statement is not available in the OpenAlex record.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
Java applications retrieve memory items as needed. The function of garbage collection (GC) on Java Virtual Machine (JVM) is to automatically determine which memory is no longer in use by the Java system and to deallocate the objects stored in this part of the memory. As memory is restored to JVM automatically, Java developers are not responsible for explicitly deleting unused memory items. We study the performance of various GCs on an Apache Kafka-Storm platform for processing a real-time workload. We demonstrate that the choice of the Garbage collector is sensitive to the configuration of Kafka and the impact of Garbage Collection events on the latency of processing application.
Key concepts: Garbage collection, Computer science, Manual memory management, Java, Operating system, Garbage, Memory management, Latency (audio)