Automatic Generation of In-Store Product Information and Navigation Guidance, Using Augmented Reality (AR) and a Vision-and-Language Model (VLM) and Multi-Modal Artificial Intelligence (AI)

This invention describes a system for automatically providing shoppers with product information and navigation guidance inside stores. It works by using a smartphone, AR device, or smart glasses to capture images of products on shelves. These images are then fed into an Artificial Intelligence model called a Vision and Language Model (VLM), which analyzes the visual content to recognize products, answer user questions about them, and generate real-time shopping assistance or directions, all without needing barcodes.