System and methodology for performance verification of multi-agent autonomous robotic systems

This invention describes a computer-based way to check if self-driving car software is safe and works correctly. It does this by running simulations where it gradually adds more "noise" or "delay" to the car's sensors or its reactions to commands. It keeps increasing these difficulties until it finds a scenario that is challenging enough to test the software thoroughly, which is then used for statistical safety and performance verification. The claims further specify that the system records these noise and delay settings and can reuse them.