Automating tasks for a user across their mobile applications

This invention describes a system that helps users automate tasks across their mobile applications. It works by understanding what a user wants to do, then picking the right app or apps for the job. The system then analyzes what's shown on the app's screen to understand its layout and content, figures out if any information is missing for the task, and finally takes over to interact with the app automatically, like typing in missing details, so the user doesn't have to.

Why it matters: Filed before the widespread adoption of highly capable large language models (LLMs) and multimodal AI agents. These advancements now make the semantic understanding of user interfaces and the generation of automated interactions, as described in the claims, significantly more feasible and robust.

Status: Not in forceListed as no longer active. The specific reason is not in the record we hold.
How hard to build: SpecializedHeavy software system, AI/ML models

3 AI reinvention directions for this patent

See all three

AI gives you a few directions you could take this. Pick one, and we check whether your version is different enough to patent, then write the filing.

Reinvent this with AI

Where this one came from

Every morning we go through millions of abandoned patents and pick out 15 worth your time. This was one of today’s.

This one

+10