Distributed and contextualized artificial intelligence inference service

This invention describes a system for running artificial intelligence (AI) tasks efficiently on various devices. When an edge device (like a smart sensor or a phone) needs an AI task done, it sends a request with some information about its current situation (like network strength or sensor readings) to a central gateway. The gateway then intelligently picks the best version of the AI model to run, considering the device's context and the available hardware, executes it, and sends the results back to the edge device. The claims specifically focus on the gateway's role in selecting different versions of an AI model based on hardware and contextual data.

Why it matters: Since 2022, the diversity and complexity of AI models, particularly for edge deployment, have grown significantly, alongside advancements in specialized edge hardware. This makes the invention's focus on intelligently selecting the optimal AI model variant based on real-time contextual data and specific hardware configurations much more critical and practical for efficient, low-latency edge AI.

Status: Not in forceListed as no longer active. The specific reason is not in the record we hold.
How hard to build: SpecializedSoftware logic, distributed system, AI models

3 AI reinvention directions for this patent

See all three

AI gives you a few directions you could take this. Pick one, and we check whether your version is different enough to patent, then write the filing.

Reinvent this with AI

Where this one came from

Every morning we go through millions of abandoned patents and pick out 15 worth your time. This was one of today’s.

This one

+10