System and method for conversational shopping based on machine learning

This invention describes a system that helps people shop by understanding both what they see and what they type. When you provide a picture of a product and a text description, the system uses a trained machine learning model to combine these inputs into a single representation. It then uses this combined understanding to find and show you a different, relevant product image in response to your search. The system's training involves specific steps like extracting product attributes and filtering image pairs.