Skip to main content
U.S. flag

An unofficial archive of your favorite United States government website

Official websites do not use .rip
We are an unofficial archive, replace .rip by .gov in the URL to access the official website. Access our document index here.

We are building a provable archive!
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.


Welcome to the Software Assurance Metrics And Tool Evaluation (SAMATE) Website!

Software assurance is a set of methods and processes to prevent, mitigate or remove weaknesses and vulnerabilities and ensure that software functions as intended. The Introduction to SAMATE page provides more details. SAMATE’s major efforts include defining bug classes, collecting a corpus of programs with known bugs, and enabling better understanding of tool effectiveness.

The Software Assurance Reference Dataset (SARD) is a growing collection of thousands of test programs with documented weaknesses. The Acknowledgments and Test Case Descriptions page describes the content. The Manual explains how to use the SARD website.

The Static Analysis Tool Exposition (SATE) is a recurring study designed to advance research in static analysis tools that find security-relevant weaknesses in source code. We provide a set of programs to tool makers, then they run their tools and return tool outputs for analysis.

The Bugs Framework (BF) is a structured, complete, orthogonal, and language-independent classification of software weaknesses (bugs). BF allows unambiguous descriptions of software vulnerabilities.


We invite you to participate in the SAMATE mailing list!  The mailing list web site is Note that as of November 2019, the SAMATE mailing list moved to Google Groups.

We pronounce SAMATE as suh-mate, which rhymes with date.

If you are looking for the (similarly named) Software Engineering Method And Theory (SEMAT) project web site, please visit

This web site was created in July 2005. 


Created February 3, 2021, Updated October 28, 2021