Automated test generation techniques for graphical user interfaces include model-based approaches that generate tests from a graph or state machine model of the interface, capture-replay methods that require the user to specify and demonstrate each test case individually, and modeling-language approaches that provide templates for abstract test cases. There has been little work, however, in automated goal-based testing, where the goal is a realistic user task, a function, or an abstract behavior. Recent work in human performance regression testing (HPRT) has shown that there is a need for generating multiple test cases that execute the same user task in different ways, however that work is limited in that it lacks efficient test generation techniques and only a single type of goal has been considered.

In this paper we expand the notion of goal based interface testing to generate tests for a variety of goals. We develop a direct test generation technique, EventFlowSlicer, that is more e cient than that used in human performance regres- sion testing, reducing run times by 92.5% on average for test suites between 9 to 26 steps and 63.1% across all test suites. Our evaluation shows that the number of tests generated is non-trivial – more than can be easily captured manually. On average EventFlowSlicer generated 38 test cases per suite, and as many as 200 test cases which all achieve the same goal for a specified task.

• CPU: AMD Opteron 6128, 2.0 GHz processors
• Maximum Allocateable memory: 128 GB
• Operating System: Scientific Linux 6.7
• Java Runtime: Java 1.7
• GUI Environment (for replaying test cases) Mac OS X Version 10.9.5 (Mavericks)

Below are EFG, GUI, and Rules files provided for different versions of the tasks. Note that we provide data in the rules column that specifies rules files for both the generators used during the study of 1) the EFS test case generator and 2) the HPRT test case generator. A zip file of each set of generated test cases is provided in a table following the input files table.

The set of applications used for our tasks consist of the following:

• JEdit version 5.1.0
• Dr. Java version 20140826-r5761
• TerpWord 3 (2003 release) (TerpWord is available at http://www.cs.umd.edu/~atif/TerpOffice/)
• LibreOffice 3.4.3 suite, Writer, Calc, and Impress. (LibreOffice is available at www.libreoffice.org)
.