Automated semantic inference of visual features and scenes

This invention describes a computer system that understands what's happening in images or videos. It works by first identifying some initial objects using trained software models. Then, based on a knowledge map that shows how objects relate to each other, it predicts and searches for other expected objects in the scene, building a complete picture. The claims specifically focus on using this knowledge map to guide the search for related objects.