PAUL REGIS KRAM
Pilots at Middle St, Lowell, MA

7272752, Sep 18, 2007

Sep 5, 2001

09/946237

Eitan Farchi - Pardes Hana, IL
Daniel Geist - Haifa, IL
Alan Hartman - Haifa, IL
Paul Kram - Lowell MA, US
Kenneth Nagin - D. N. HaMovil, IL
Shmuel Ur - Shorashim, IL

International Business Machines Corporation - Armonk NY

G06F 11/00

714 38, 714 37

A test coverage tool provides output that identifies differences between the actual coverage provided by a test suite run on a program under test and the coverage criteria (e. g. , the coverage criteria required by the test/development team management). The output from the test coverage tool is generated in the same language that was used to write the coverage criteria that are input to an automated test generator to create the test cases which form the test suite. As a result, the output from the coverage tool can be input back into the automated test generator to cause the generator to revise the test cases to correct the inadequacies. This allows iterative refinement of the test suite automatically, enabling automated test generation to be more effectively and efficiently used with more complex software and more complex test generation inputs. In preferred embodiments, test coverage analysis results of several different test suites, some manually generated and others automatically generated, are used to produce a streamlined automatically-generated test suite and/or to add missing elements to an automatically generated test-suite.

2003012, Jun 26, 2003

Sep 5, 2001

09/946255

Eitan Farchi - Pardes Hana, IL
Paul Kram - Lowell MA, US
Shmuel Ur - Shorashim, IL

G06F009/44, G06F009/45

717/124000, 717/146000, 717/151000

The present invention allows tests generated by multiple test generators to be merged into a comprehensive test specification, allowing multiple test generators to work together as a single unit, and allowing tests from multiple test generators to be combined to achieve a single defined testing goal. A novel test generation framework is disclosed in which the test compilation and test optimization processes of the prior art are utilized in connection with a novel combining process (a framework) to allow the combining of testing tools of different formats. The test compilation and test optimization processes work with an “intermediate test representation,” which is simply an intermediate step during which models of differing formats are disguised to “hide” their format; and instructions directing the appropriate execution order of the disguised models are developed and utilized. By disguising their format, the test engine can read and run the models and combine the different testing tools and obtain an abstract test representation that is far superior to that available using prior art tools. In the intermediate test representation, some portions of the overall test are “partially specified” when they are received from the test optimization process, in contrast to the abstract test representation which is fully instantiated.

7055065, May 30, 2006

Sep 5, 2001

09/946248

Eitan Farchi - Pardes Hana, IL
Alan Hartman - Haifa, IL
Paul Kram - Lowell MA, US
Kenneth Nagin - D.N. HaMovil, IL

International Business Machines Corporation - Armonk NY

G06F 11/00

714 38, 714 37, 717124

The present invention enables the modeling of plural outcomes resulting from a single stimulus, thereby allowing for automated test generation for non-deterministic software. In accordance with the present invention, a method, system, and computer program product are disclosed for testing software having a non-deterministic outcome. In accordance with the present invention, a set of rules is created, each rule having an associated stimulus, a precondition computation, and a computation procedure to produce the set of all valid outcome states. Each valid outcome state models one of several states that may result from applying the stimulus to any state which satisfies the precondition computation. Using these models, a test generation program is executed against the set of rules to recursively expand each path associated with an outcome state of a rule and outputting a list of valid possible outcomes, then selecting sequences of stimuli in accordance with coverage goals set by the test engineer. A test execution engine is then run against the application under test applying the sequences of stimuli to the software and a list of observed states resulting from the application of the stimuli is compiled.

6944848, Sep 13, 2005

May 3, 2001

09/847309

Alan Hartman - Haifa, IL
Kenneth Nagin - Nazareth Illit, IL
Paul Kram - Lowell MA, US

International Business Machines Corporation - Armonk NY

G06F009/44

717124

A system for automatic generation of test programs employs test generation foci linked to a finite state machine behavioral model of a software application under test to produce abstract test suites that are executed by an execution engine. The foci include directive expressions that tag coverage variables of the behavioral model. The execution engine operates until the tagged coverage variables have assumed all their possible values. Both the behavioral models and the foci are archivable and can be retrieved and reused independently.