The ranking
Overall DER at collar 0. The bar under each score is the error mix: missed speech, speaker confusion, false alarm.
DiariZen is lowest overall because 38% of the corpus is two-speaker. From three speakers up, Nemotron is equal or better.
Listen to one tape
A 35.8 s English clip. Malini is the blue channel, Satvik is the orange channel. Overlap is both channels lit. Play, then click a turn or a lane.
Why the ranking looks like this
DiariZen is the two-speaker specialist (11.1% vs Nemotron 20.6% vs Community-1 16.2%). That slice is 38% of the corpus, which is why DiariZen wins overall.
Nemotron misses a lot of speech (21.3% miss, 0.41% FA). DiariZen and Community-1 recover more speech (miss about 10-11%) but then confuse speakers. Community-1's confusion term (21.9%) is the largest single error in the study.
Going from 0 ms to 500 ms drops overall DER by about 6-7 points for every system. Confusion stays flat. The ranking does not change with collar.
On 5-8 speakers Nemotron is best (43.2%), then DiariZen (46.0%), then Community-1 (54.1%).
Nemotron's easiest language is English (24.4%). DiariZen is flatter across Indic languages and best on Kannada (25.4%). Only English inverts the ranking.
Under 5% overlap, DiariZen is clearly ahead (16.8%). In the 15-30% band the three systems compress: 34.0 / 35.2 / 43.9.
Full scoreboard
Rows rank by DER unless you sort another column. Lower is better.
DER vs collar
Every language has a winner
Lowest DER at collar 0. Click a language below to rerank the table. Click a column to sort by that metric instead.
DER by language at collar 0 ms
Harder rooms
Speaker count and overlap. Click a band to rerank by that slice.
What was scored
NIST RTTM speaker turns and a full-file UEM on every session. Components are percent of the same reference speech, so miss + FA + confusion = DER.
Hours by language
Sessions by number of speakers
Overlap occupies 26.9 h (9.8% of audio). Most sessions sit in the 5-15% overlap band. Event inventory: 405,153 lexical turns, 96,350 backchannels, 22,902 filled pauses.
Cite this page
Use either form.
Plain text
Mandal, I. (2026, November). Who can follow a conversation when everyone talks at once? - Indic Edition. https://iamindrayudh.github.io/indic-diarization/
BibTeX
@misc{mandal2026indic,
author = {Mandal, Indrayudh},
title = {Who can follow a conversation when everyone talks at once? - Indic Edition},
year = {2026},
month = {November},
url = {https://iamindrayudh.github.io/indic-diarization/}
}