Feature Request: 8-Speaker (8 spk) version of `diar_streaming_sortformer`

#7
by FIT17 - opened

Hello NVIDIA NeMo Team,

Thank you for your excellent work on the diar_streaming_sortformer_4spk-v2 model. The performance and streaming capabilities for 4-speaker diarization are very impressive.

We are writing to express strong interest in, and inquire about the possibility of, an 8-speaker (8 spk) version of this model.

In many of our practical use cases, such as large business meetings, panel discussions, or multi-participant calls, we frequently encounter scenarios that exceed the 4-speaker limit.

A model capable of handling up to 8 speakers would be incredibly useful and significantly expand the model's applicability to these more complex, real-world scenarios.

Could you share if an 8-speaker version is on your roadmap? Any information on its potential availability would be greatly appreciated by the community.

Thank you for your consideration!

Best,

Hi @FIT17 ,

Thank you for your kind words about the 4-speaker model and for the great feedback. We really appreciate hearing about your use cases.
To answer your question: yes, an 8-speaker version is on our roadmap.
We are currently working on it, and the release is targeted for the first half of 2026.
We value your input, and please stay tuned for future announcements.

Hi, @imedenikov
It's great to hear that the 8-speaker version is on the roadmap for the first half of 2026.
Could you let me know if there is a more exact release date set for it yet, Since we are already in the first half of 2026?

NVIDIA org

Hi @FIT17 , our current target is the end of June. Please note that, while we are pushing for this timeline, we cannot fully guarantee it at this moment.

Hi @imedennikov

Thanks again for the earlier update. Now that we're in early June, I wanted to
check in: is the 8-speaker model still on track for the end-of-June target?

I completely understand it couldn't be fully guaranteed back in March โ€” just
hoping to get your latest read on whether a June release still looks realistic,
or if the timeline has shifted at all. Even a rough update would help us plan on
our side.

Really looking forward to it. Thanks!

NVIDIA org

Hi @FIT17 , unfortunately the timeline has shifted a bit. The realistic target for the release is around August-September.

Hi @FIT17 , unfortunately the timeline has shifted a bit. The realistic target for the release is around August-September.

Thank you for your contributions. Will the new model focus solely on adding more speakers, or will there also be improvements related to parallel speech or overall accuracy?
ty again looking forward the new release ๐Ÿ™ƒ

NVIDIA org

Hi @altunenes , the new model should perform better overall.

Hello, would it be possible for you to also make a lightweight version of the 8 speaker model?

Hello, would it be possible for you to also make a lightweight version of the 8 speaker model?

Hello @GradientDescent2718 ! Thanks for reaching out.
We do not have plans to release a separate lightweight version at this time. However, our new model is heavily optimizedโ€”you will see faster performance and lower memory usage compared to v2.1.
If you require an even smaller footprint for your specific use case, we recommend exploring distillation on your end.

BTW, If anyone here is interested in early access to the new model, please react to this comment with a โž•!

โž•โž•โž• please :-)

BTW, If anyone here is interested in early access to the new model, please react to this comment with a โž•!

โž•

Can't wait to see it!

โž•โž•โž•โž•โž•โž•

If you require an even smaller footprint for your specific use case, we recommend exploring distillation on your end.

Hello @imedennikov , would you happen to know the effects of reducing the number of transformer and conformer blocks in the model? I am wondering if that would be an effective way to create a smaller model for distillation.

NVIDIA org

Hello @imedennikov , would you happen to know the effects of reducing the number of transformer and conformer blocks in the model? I am wondering if that would be an effective way to create a smaller model for distillation.

Hi @GradientDescent2718 ,
Sorry for the delayed reply.
While we haven't run ablation studies on this specifically for Sortformer models, a recent paper (https://arxiv.org/abs/2506.18623) covers this exact question in depth.
This should serve as an excellent starting point for your own distillation efforts.
Best of luck with your optimizations!

BTW, If anyone here is interested in early access to the new model, please react to this comment with a โž•!

is there a specific form or process to have the early access to the model?

NVIDIA org

@GordonChang - Once ready, a note will be posted here.

Sign up or log in to comment