Automated Speech Recognition for Modeling Team Performance | CU Experts

While team tasks provide a wealth of data on individual and team performance, techniques for modeling team communication can be quite effortful and time-consuming. Automated techniques of analyzing team discourse provide the promise of quickly judging team performance and permitting feedback to teams both in training and in operations. In previous research, techniques using Latent Semantic Analysis (LSA) have proven successful for analyzing team transcripts. However, converting the audio discourse into transcripts often requires hand transcription. In this work, we describe applying automated speech recognition (ASR) to team transcripts and using the output of the ASR to predict overall team performance. Results indicate that ASR can be used in conjunction with semantic methods of modeling team communication to provide accurate predictions of performance. The work has potential for assisting operators in the performance of their tasks because it can “listen” and in real-time evaluate free-form verbal communication from a variety of sources.

VIVO