A Suite of Java Message-passing Benchmarks to Support the Validation of Testing Models, Criteria and Tools

This paper proposes a novel suite of benchmarks for the evaluation of the structural testing of concurrent programs with message-passing paradigm. This suite is composed of thirteen bug-free programs and five faulty programs. The benchmarks are developed in Java and are available as free-software on the Internet. They were validated with experimental studies and also have been used in different research and for educational aims. The obtained results showed that the benchmarks can generate qualified workload for the testing of message-passing programs. The main contribution of this study is the development of a more robust and fair suite of benchmarks capable of improving the evaluation of the testing activity applied to concurrent programs.