Multistream speaker diarization through Information Bottleneck system outputs combination

• Main Authors: Vijayasenan, Deepu, Valente, Fabio, Motlicek, Petr
• Format: Conference Proceeding
• Language: English
• Subjects: Clustering algorithms; Computational modeling; diarization system combination; Estimation; Feature combination; Hidden Markov models; Information bottleneck principle; Mel frequency cepstral coefficient; Mutual information; Speaker diarization; Speech; TDOA features
• ISSN: 1520-6149; 2379-190X
• DOI: 10.1109/ICASSP.2011.5947334

Speaker diarization of meetings recorded with Multiple Distant Microphones makes extensive use of multiple feature streams like MFCC and Time Delay of Arrivals (TDOA). Typically the combination happens using separate models for each feature stream. This work investigates if the combination of multiple feature streams can happen through the combination of multiple diarization systems performed using those features. The paper extends the previously proposed Information Bottleneck method to handle the combination of several probabilistic diarization outputs. In contrast to the conventional model-based feature combination, this technique is referred as system-based combination. Furthermore the paper introduces an hybrid model-system combination. Experiments are run on data from the Rich Transcription campaigns and show that the system based combination largely outperforms the model based combination by 37% relative. The hybrid approaches improve by 10-20%. The analysis of errors shows that the improvements come from the recordings where the individual MFCC and TDOA systems provide very different performances.