Pointer-based interaction with a virtual surface using a peripheral device in artificial reality environments

This invention describes an artificial reality system, typically a head-mounted display, that uses its built-in camera to spot a physical handheld device. It then tracks the device's position and orientation to create a virtual pointer extending from it to a virtual surface in the artificial reality environment. The system performs actions based on where the pointer lands on the virtual surface, and specifically allows for "drawing" by tracking the pointer's movement across the surface.

Why it matters: Filed before the widespread availability of powerful consumer HMDs with advanced on-device computer vision. Modern HMDs and improved processing capabilities make real-time peripheral tracking and rendering more efficient and accessible.

Status: Not in forceListed as no longer active. The specific reason is not in the record we hold.
How hard to build: SpecializedAR/VR software, computer vision, rendering engine

3 AI reinvention directions for this patent

See all three

AI gives you a few directions you could take this. Pick one, and we check whether your version is different enough to patent, then write the filing.

Reinvent this with AI

Where this one came from

Every morning we go through millions of abandoned patents and pick out 15 worth your time. This was one of today’s.

This one

+10