D. Richard Kuhn - NIST
How Can We Provide Assured Autonomy?
Jan 29, 2025
Download:

Abstract
Safety and security-critical systems require extensive test and evaluation, but existing high assurance test methods are based on structural coverage criteria that do not apply to many black box AI and machine learning components. AI/ML systems make decisions based on training data rather than conventionally programmed functions. Autonomous systems that rely on these components therefore require assurance methods that evaluate input data to ensure that they can function correctly in their environments with inputs they will encounter. Combinatorial test methods can provide added assurance for these systems and complement conventional verification and test for AI/ML.
This talk reviews some combinatorial methods that can be used to provide assured autonomy, including:
- Background on combinatorial test methods
- Why conventional test methods are not sufficient for many or most autonomous systems
- Where combinatorial methods apply
- Assurance based on input space coverage
- Explainable AI as part of validation
About the Speaker

Ways to Watch
