Smaller variants

#8
by nonetrix - opened

Do you plan to release smaller versions of this model e.g. 30B class or lower?

Stay tuned! Yes!

120b would be great!

Hi! We were planning to do a 122b version. However, that specific run failed and we are tight on gpu hours, so it was ultimately canceled

Hi! We were planning to do a 122b version. However, that specific run failed and we are tight on gpu hours, so it was ultimately canceled

What about 35B A3B? Would be great to see it!

i think they're working on a 35B. one of the people in the iplan org has a Rio 3.2 Open 35B checkpoint

https://huggingface.co/Sangu1nius/Rio-3.2-Open-35B

image

i think they're working on a 35B. one of the people in the iplan org has a Rio 3.2 Open 35B checkpoint

https://huggingface.co/Sangu1nius/Rio-3.2-Open-35B

image

That's so cool, thanks!

Sign up or log in to comment