U.S. flag   An unofficial archive of your favorite United States government website
Dot gov

Official websites do not use .rip
We are an unofficial archive, replace .rip by .gov in the URL to access the official website. Access our document index here.


We are building a provable archive!
A lock (Dot gov) or https:// don't prove our archive is authentic, only that you securely accessed it. Note that we are working to fix that :)

Combinatorial Testing

Autonomous Systems Assurance

Autonomous systems must function correctly in an enormous range of environments.  For example, self-driving cars must deal with lighting, rain, fog, pedestrians, animals, other vehicles, road markings, signs, etc.  How do we ensure that autonomous systems are safe in such complex and rapidly changing environments, when conventional test coverage and formal verification methods cannot be applied?  

Achieving assured autonomy in any environment requires methods for measuring the input space, to show that the test environment adequately covers real-world conditions that may be encountered.  Although some statistical and structural coverage metrics are relevant, they are terribly inadequate for many of the challenges in autonomous systems assurance.  NIST is developing new combinatorial measurement methods and tools for input space coverage, to fill this key gap in current software engineering capabilities and provide assured autonomy. 

Created May 24, 2016, Updated August 04, 2022