EvoSuite Tool Demonstration at ICST 2013

We will give a tool demo of EvoSuite at ICST 2013: http://www.icst.lu/site/icst2013/program/schedule

  • [PDF] G. Fraser and A. Arcuri, “EvoSuite: On The Challenges of Test Case Generation in the Real World (Tool Paper),” in ICST’13: Proceedings of the 6th International Conference on Software Testing, Verification and Validation, 2013, pp. 362-369.
    [Bibtex]
    @inproceedings{ICST13_Tool,
       AUTHOR="G. Fraser and A. Arcuri",
       TITLE="EvoSuite: On The Challenges of Test Case Generation in the Real World (Tool Paper)",
       booktitle = {ICST'13: Proceedings of the 6th International Conference on Software Testing, Verification and Validation},
       publisher = {IEEE Computer Society},
       YEAR="2013",
       pages={362--369}
    }

ICST 2013: CrowdOracles: Can the Crowd Solve the Oracle Problem?

  • [PDF] F. Pastore, L. Mariani, and G. Fraser, “CrowdOracles: Can the Crowd Solve the Oracle Problem?,” in ICST’13: Proceedings of the 6th International Conference on Software Testing, Verification and Validation, 2013, pp. 342-351.
    [Bibtex]
    @inproceedings{ICST13_Crowd,
       AUTHOR="Fabrizio Pastore and Leonardo Mariani and Gordon Fraser",
       TITLE="CrowdOracles: Can the Crowd Solve the Oracle Problem?",
       booktitle = {ICST'13: Proceedings of the 6th International Conference on Software Testing, Verification and Validation},
       publisher = {IEEE Computer Society},
       YEAR="2013",
       pages={342--351},
    }

ICST 2013: Generating Unit Tests for Concurrent Classes

  • [PDF] S. Steenbuck and G. Fraser, “Generating Unit Tests for Concurrent Classes,” in ICST’13: Proceedings of the 6th International Conference on Software Testing, Verification and Validation, 2013, pp. 144-153.
    [Bibtex]
    @inproceedings{ICST13_ConSuite,
       AUTHOR="Sebastian Steenbuck and Gordon Fraser",
       TITLE="Generating Unit Tests for Concurrent Classes",
       booktitle = {ICST'13: Proceedings of the 6th International Conference on Software Testing, Verification and Validation},
       publisher = {IEEE Computer Society},
       YEAR="2013",
       pages={144--153}
    }

ICST 2013: Reconstructing Core Dumps

  • [PDF] J. Rößler, A. Zeller, G. Fraser, C. Zamfir, and G. Candea, “Reconstructing Core Dumps,” in ICST’13: Proceedings of the 6th International Conference on Software Testing, Verification and Validation, 2013, pp. 114-123.
    [Bibtex]
    @inproceedings{ICST13_ReCore,
       AUTHOR="Jeremias R\"o\ss{}ler and Andreas Zeller and Gordon Fraser and Cristian Zamfir and George Candea",
       TITLE="Reconstructing Core Dumps",
       booktitle = {ICST'13: Proceedings of the 6th International Conference on Software Testing, Verification and Validation},
       publisher = {IEEE Computer Society},
       YEAR="2013",
       pages={114--123}
    }

TSE: Whole Test Suite Generation

The journal extension of the original EvoSuite paper has now appeared in IEEE TSE: http://www.computer.org/csdl/trans/ts/2013/02/tts2013020276-abs.html

  • [PDF] [DOI] G. Fraser and A. Arcuri, “Whole Test Suite Generation,” IEEE Transactions on Software Engineering, vol. 39, iss. 2, pp. 276-291, 2013.
    [Bibtex]
    @article{TSE12_EvoSuite,
    author = {Gordon Fraser and Andrea Arcuri},
    title = {Whole Test Suite Generation},
    journal ={IEEE Transactions on Software Engineering},
    year={2013},
    month={feb. },
    volume={39},
    number={2},
    pages={276 -291},
    abstract={Not all bugs lead to program crashes, and not always is there a formal specification to check the correctness of a software test's outcome. A common scenario in software testing is therefore that test data are generated, and a tester manually adds test oracles. As this is a difficult task, it is important to produce small yet representative test sets, and this representativeness is typically measured using code coverage. There is, however, a fundamental problem with the common approach of targeting one coverage goal at a time: Coverage goals are not independent, not equally difficult, and sometimes infeasible-the result of test generation is therefore dependent on the order of coverage goals and how many of them are feasible. To overcome this problem, we propose a novel paradigm in which whole test suites are evolved with the aim of covering all coverage goals at the same time while keeping the total size as small as possible. This approach has several advantages, as for example, its effectiveness is not affected by the number of infeasible targets in the code. We have implemented this novel approach in the EvoSuite tool, and compared it to the common approach of addressing one goal at a time. Evaluated on open source libraries and an industrial case study for a total of 1,741 classes, we show that EvoSuite achieved up to 188 times the branch coverage of a traditional approach targeting single branches, with up to 62 percent smaller test suites.},
    keywords={Arrays;Genetic algorithms;Genetic programming;Search problems;Software;Software testing;formal specification;program debugging;program testing;EvoSuite tool;code coverage;formal specification;program crashes;program debugging;software testing;whole test suite generation;Search-based software engineering;branch coverage;collateral coverage;genetic algorithm;infeasible goal;length;},
    doi={10.1109/TSE.2012.14},
    ISSN={0098-5589},}

ISSTA 2012: Search-based System Testing

Exsyst is an extension of EvoSuite that creates test suites by accessing the GUI (currently Java/Swing). For more details check the Exsyst website.

  • [PDF] F. Gross, G. Fraser, and A. Zeller, “Search-Based System Testing: High Coverage, No False Alarms,” in Proceedings of the 2012 International Symposium on Software Testing and Analysis, New York, NY, USA, 2012, pp. 67-77.
    [Bibtex]
    @inproceedings{ISSTA12_Exsyst,
     author = {Gross, Florian and Fraser, Gordon and Zeller, Andreas},
     title = {Search-Based System Testing: High Coverage, No False Alarms},
     booktitle = {Proceedings of the 2012 International Symposium on Software Testing and Analysis},
     series = {ISSTA '12},
     year = {2012},
     publisher = {ACM},
     address = {New York, NY, USA},
    pages={67--77},
    }

ISSTA 2012: Isolating Failure Causes through Test Case Generation

  • [PDF] J. Roessler, G. Fraser, A. Zeller, and A. Orso, “Isolating Failure Causes through Test Case Generation,” in Proceedings of the 2012 International Symposium on Software Testing and Analysis, New York, NY, USA, 2012, pp. 309-319.
    [Bibtex]
    @inproceedings{ISSTA12_Bugex,
     author = {Jeremias Roessler and Gordon Fraser and Andreas Zeller and Alessandro Orso},
     title = {Isolating Failure Causes through Test Case Generation},
     booktitle = {Proceedings of the 2012 International Symposium on Software Testing and Analysis},
     series = {ISSTA '12},
     year = {2012},
     publisher = {ACM},
     address = {New York, NY, USA},
     pages={309--319},
    }

ICSE 2012: Sound Empirical Evidence in Software Testing

  • [PDF] G. Fraser and A. Arcuri, “Sound Empirical Evidence in Software Testing,” in 34th International Conference on Software Engineering, ICSE 2012, June 2-9, 2012, Zurich, Switzerland, 2012, pp. 178-188.
    [Bibtex]
    @inproceedings{ICSE12,
        author    = {Gordon Fraser and Andrea Arcuri},
        TITLE="Sound Empirical Evidence in Software Testing",
        YEAR={2012},
        pages     = {178--188},
        ee        = {http://dx.doi.org/10.1109/ICSE.2012.6227195},
        booktitle     = {34th International Conference on Software Engineering, ICSE 2012, June 2-9, 2012, Zurich, Switzerland},
        publisher = {IEEE},
      isbn      = {978-1-4673-1067-3},
    }

Details of the SF100 corpus of classes used in this paper are available here.