Metamorphic Testing on the Continuum of Verification and Validation of Simulation Models

Metamorphic testing has been shown to be useful in testing "non-testable" programs in many domains. Modeling & simulation is one such domain, where both verification and validation can be difficult due to lack of oracles. Although the definition of verification and validation vary slightly in... See full abstract

Metamorphic testing has been shown to be useful in testing "non-testable" programs in many domains. Modeling & simulation is one such domain, where both verification and validation can be difficult due to lack of oracles. Although the definition of verification and validation vary slightly in modeling and simulation when compared to standard software, we show that metamorphic testing is appropriate in both aspects of ensuring that a simulation model is accurate. In this paper we expand on our five years of prior work on metamorphic testing for simulation validation to show how metamorphic testing can be used for verification as well, and how the previously defined guidelines for validation can be utilized in eliciting metamorphic relations for verification.
Hide full abstract