Instructions to use nvidia/diar_streaming_sortformer_4spk-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use nvidia/diar_streaming_sortformer_4spk-v2 with NeMo:
import nemo.collections.asr as nemo_asr asr_model = nemo_asr.models.ASRModel.from_pretrained("nvidia/diar_streaming_sortformer_4spk-v2") transcriptions = asr_model.transcribe(["file.wav"]) - Notebooks
- Google Colab
- Kaggle
Feature Request: 8-Speaker (8 spk) version of `diar_streaming_sortformer`
Hello NVIDIA NeMo Team,
Thank you for your excellent work on the diar_streaming_sortformer_4spk-v2 model. The performance and streaming capabilities for 4-speaker diarization are very impressive.
We are writing to express strong interest in, and inquire about the possibility of, an 8-speaker (8 spk) version of this model.
In many of our practical use cases, such as large business meetings, panel discussions, or multi-participant calls, we frequently encounter scenarios that exceed the 4-speaker limit.
A model capable of handling up to 8 speakers would be incredibly useful and significantly expand the model's applicability to these more complex, real-world scenarios.
Could you share if an 8-speaker version is on your roadmap? Any information on its potential availability would be greatly appreciated by the community.
Thank you for your consideration!
Best,
Hi @FIT17 ,
Thank you for your kind words about the 4-speaker model and for the great feedback. We really appreciate hearing about your use cases.
To answer your question: yes, an 8-speaker version is on our roadmap.
We are currently working on it, and the release is targeted for the first half of 2026.
We value your input, and please stay tuned for future announcements.
Hi, @imedenikov
It's great to hear that the 8-speaker version is on the roadmap for the first half of 2026.
Could you let me know if there is a more exact release date set for it yet, Since we are already in the first half of 2026?
Hi @FIT17 , our current target is the end of June. Please note that, while we are pushing for this timeline, we cannot fully guarantee it at this moment.
Hi @imedennikov
Thanks again for the earlier update. Now that we're in early June, I wanted to
check in: is the 8-speaker model still on track for the end-of-June target?
I completely understand it couldn't be fully guaranteed back in March โ just
hoping to get your latest read on whether a June release still looks realistic,
or if the timeline has shifted at all. Even a rough update would help us plan on
our side.
Really looking forward to it. Thanks!
Hi @FIT17 , unfortunately the timeline has shifted a bit. The realistic target for the release is around August-September.
Hi @FIT17 , unfortunately the timeline has shifted a bit. The realistic target for the release is around August-September.
Thank you for your contributions. Will the new model focus solely on adding more speakers, or will there also be improvements related to parallel speech or overall accuracy?
ty again looking forward the new release ๐
Hello, would it be possible for you to also make a lightweight version of the 8 speaker model?
Hello, would it be possible for you to also make a lightweight version of the 8 speaker model?
Hello @GradientDescent2718 ! Thanks for reaching out.
We do not have plans to release a separate lightweight version at this time. However, our new model is heavily optimizedโyou will see faster performance and lower memory usage compared to v2.1.
If you require an even smaller footprint for your specific use case, we recommend exploring distillation on your end.
BTW, If anyone here is interested in early access to the new model, please react to this comment with a โ!
โโโ please :-)
BTW, If anyone here is interested in early access to the new model, please react to this comment with a โ!
โ
Can't wait to see it!
โโโโโโ
If you require an even smaller footprint for your specific use case, we recommend exploring distillation on your end.
Hello @imedennikov , would you happen to know the effects of reducing the number of transformer and conformer blocks in the model? I am wondering if that would be an effective way to create a smaller model for distillation.
Hello @imedennikov , would you happen to know the effects of reducing the number of transformer and conformer blocks in the model? I am wondering if that would be an effective way to create a smaller model for distillation.
Hi @GradientDescent2718 ,
Sorry for the delayed reply.
While we haven't run ablation studies on this specifically for Sortformer models, a recent paper (https://arxiv.org/abs/2506.18623) covers this exact question in depth.
This should serve as an excellent starting point for your own distillation efforts.
Best of luck with your optimizations!
BTW, If anyone here is interested in early access to the new model, please react to this comment with a โ!
is there a specific form or process to have the early access to the model?