Testing software changes and determining a repeatability of software tests

This invention describes a system designed to improve the reliability of software testing. It works by running software tests at different times and identifying any tests that produce inconsistent results. For these inconsistent tests, the system reruns them multiple times to see how often they pass or fail for specific code changes. Based on these reruns, it calculates a "repeatability score" to show how trustworthy each test is, specifically by looking at the percentage of test scores that fall within or outside a certain variation threshold.

Why it matters: The increasing complexity of software and the demand for rapid, reliable CI/CD pipelines since 2022 have amplified the cost and frustration of flaky tests. This system offers a structured approach to quantify and manage test repeatability, which is more critical than ever for maintaining developer velocity and software quality.

Status: Not in forceListed as no longer active. The specific reason is not in the record we hold.
How hard to build: SpecializedSoftware logic, test environment integration

3 AI reinvention directions for this patent

See all three

AI gives you a few directions you could take this. Pick one, and we check whether your version is different enough to patent, then write the filing.

Reinvent this with AI

Where this one came from

Every morning we go through millions of abandoned patents and pick out 15 worth your time. This was one of today’s.

This one

+10