Computationally reacting to a multiparty conversation

This invention describes a system that analyzes conversations between multiple people, such as a coach and a mentee. The system specifically processes video recordings of these conversations, analyzing both the audio and visual aspects to extract various features. It then uses machine learning to generate various scores, like progress or impact, which can trigger actions such as sending alerts about a poor pairing or suggesting helpful resources.