| Free beta release of combinatorial testing tool | |
| The
tool, named Advanced
Combinatorial Testing Suite (ACTS), can
compute tests for 2-way through 6-way interactions. An easy-to-use GUI is included. A comparison of ACTS with similar tools shows that ACTS produces smaller test sets (with the same degree of coverage) and is faster than others. To request a copy, send email to Rick Kuhn - kuhn@nist.gov. This software is provided free
of charge and will remain free in the future. NIST is an
agency of the US Government. User
Feedback
|
![]() Defining
variables in system under test
![]() Option
1: Constraints among variables can be added.
![]() Option2:
Different interaction strengths can be used for sets of
variables.
![]() Finished
covering array can be output as Excel spreadsheet, text or XML.
|
| IPO (FireEye) | Tconfig | ITCH | Jenny | Test Vector Generator | AllPairs | CTE-XL | ||||||||
| n -way | Size | Time | Size | Time | Size | Time | Size | Time | Size | Time | Size | Time | Size | Time |
| 2 | 100 | 0.8s | 108 | >1 hour | 120 | 0.73s | 108 | 0.001s | 101 | 2.75s | 103 | 3.82s | 114 | 2s |
| 3 | 400 | 0.35s | 472 | >12 hours | 2388 | 17 min | 413 | 0.71s | 9158 | 3.07s | 469 | 43.88s | ||
| 4 | 1361 | 3.05s | 1478 | >21 hours | 1484 | 15 hours | 1536 | 3.54s | 64696 | 2 min 7s | ||||
| 5 | 4219 | 18.41s | n/a | >1 day | n/a | >1 day | 4580 | 43.54s | 313056 | 25 min 49s | ||||
| 6 | 10919 | 65.03s | n/a | >1 day | n/a | >1 day | 11625 | 7 m 50 s | 1070048 | 3 hr 30 min | ||||
| n-way type | Multiway | Multiway | Multiway | Multiway | Multiway | 2 - way | 2-way, 3-way | |||||||
| Developer | NIST/UT Arlington | Univ of Ottawa | IBM | Bob Jenkins | SourceForge | Satisfice | Daimler Chrystler | |||||||
| Language used | Java | Java | Java | C | Java | Perl | (Not Known) | |||||||
| Free/Commercial | Free | Free | Free | Free/Open Source | Free/Open Source | Commercial | Commercial | |||||||
Comparison of Extended IPO Algorithm (ACTS/FireEye) with Other Covering Array Generators
Input (12 variables)
Cur_Vertical_Sep
: { 299, 300, 601 };
High_Confidence : boolean;
Two_of_Three_Reports_Valid : boolean;
Own_Tracked_Alt : { 1, 2 };
Other_Tracked_Alt : { 1, 2 };
Own_Tracked_Alt_Rate : { 600, 601 };
Alt_Layer_Value : 0..3;
Up_Separation : { 0, 399, 400, 499, 500, 639, 640, 739, 740, 840 };
Down_Separation : { 0, 399, 400, 499, 500, 639, 640, 739, 740, 840 };
Other_RAC : { NO_INTENT, DO_NOT_CLIMB, DO_NOT_DESCEND };
Other_Capability : { TCAS_TA, OTHER };
Climb_Inhibit : boolean;