Image-based localization

This invention describes a way for a camera device to figure out its exact location and orientation in the real world. It works by taking several pictures, then immediately sending the details of what it sees in the very first picture to a powerful remote computer. As it processes the other pictures, it sends those details too, allowing the remote computer to quickly calculate the camera's position and send it back. The specific version described involves capturing all the images at the same time, often using multiple cameras on the device, whose relative positions are also known to the remote computer.