Separating predictable and unpredictable flows via dynamic flow mining for effective traffic engineering

For Internet service providers to efficiently use network resources, they need to conduct traffic engineering to dynamically control traffic routes to accommodate traffic with limited network resources. The performance of traffic engineering depends on the accuracy of traffic prediction. However, the volume of network traffic has been changing drastically in recent years due to the growth of various types of network services, making traffic prediction increasingly difficult. Our simple ideas to overcome this challenge are to separate traffic into predictable and unpredictable parts and to apply different control policies to predictable and unpredictable traffic. To promote these ideas, we use software-defined networking technology, particularly Open-Flow, that can control macroflows defined by any combination of L2-L4 packet header information such as 5-tuple. In this paper, we therefore propose the macroflow-generating method for separating traffic into predictable macroflows that have little traffic variation and unpredictable macroflows that have large traffic variation within a limited flow table size. We also propose a macroflow-based traffic engineering scheme that uses different routing policies in accordance with traffic predictability. Simulation evaluation results suggest that our proposed scheme can reduce the maximum link load in a network at the most congested time by 34% and the average link load in a network on average by 11% compared with the current traffic engineering schemes.