On September 18, 2017 this (legacy) site will be replaced with the new site you can see at beta.csrc.nist.rip. At that time, links to this legacy site will be automatically redirected to apporpriate links on the new site.
We are developing tools to support combinatorial testing. No license is required and there are no restrictions on distribution or use. If you would like a copy, just send us an email request. Please include the name of your company or university - this information helps us with maintaining management support for the project. All software is provided free of charge and will remain free in the future. NIST is an agency of the US Government.
Advanced Combinatorial Testing System (ACTS) can compute tests for 2-way through 6-way interactions. An easy-to-use GUI is included, in addition to a command line version suitable for use in scripts or system calls from another tool. A comparison of ACTS with similar tools shows that ACTS produces smaller test sets with the same degree of coverage) and is faster than others. ACTS is Java-based, so it will run on any Java platform.
For a detailed comparison of ACTS with other combinatorial testing tools, see spreadsheet and graphs here.
To request a copy, send email to Rick Kuhn - kuhn@nist.gov.
This software is provided free of charge, is in the public domain, and will remain free in the future. NIST is an agency of the US Government. Please Note: Prior to February 2009, the name "FireEye" was used for the ACTS tool. Some papers and articles on the site refer to FireEye; this is the same tool now called ACTS.
User guide for combinatorial testing tool here.
Who uses our combinatorial testing tool? We have more than 2200 users as of August 2015, in IT, defense, finance, telecom, and many other industries. Here is a breakdown of our user base>.
User Feedback
Users have been very positive, and are applying ACTS to a wide variety
of software.
Combinatorial coverage measurement: a
tool to measure combinatorial coverage of an existing test suite. This
is currently an alpha release, but will eventually be open source.
To request a copy, send email to Rick Kuhn - kuhn@nist.gov.
User guide for coverage measurement tool here.
Access Control Policy Test (ACPT) tool
allows policy authors to conveniently specify access control models
(such as RBAC and Multi-Level models) and rules as well as access
control properties. From the specified models and rules, the ACPT
tool automatically synthesizes deployable policies in XACML and generates
combinatorial tests to verify security policy implementations.
Complete test cases are generated, consisting of test inputs and
expected output for each set of inputs. ACPT uses ACTS to provide 2-way
to 4-way combinatorial testing of policies.
To request a copy, send email to Vincent Hu - vhu@nist.gov.
.NET Configuration test file generator produces a collection of .NET config files from ACTS output. This tool can
be used to provide combinatorial coverage for systems that have a large number of configuration options.
To request a copy, send email to Rick Kuhn - kuhn@nist.gov.
Sequence covering array generator can produce arrays for more efficient testing of event-driven systems. See chapter 5 of the Practical Combinatorial Testing tutorial, here, for an explanation of sequence covering arrays.
To request a copy, send email to Rick Kuhn - kuhn@nist.gov.
Defining variables in system under test
Option 1: Constraints among variables can be added.
Option 2: Different interaction strengths can be used for sets of variables.
Finished covering array can be output as Excel spreadsheet, text or XML.