Post
4130
who's working on an NVFP4 version of Kimi-K3?
- 4 replies
AI & ML interests
A one-year long research workshop on large language models: the Summer of Language Models 21 🌸
Recent Activity
View all activity
Fixed CO2 metadata in README.md
1
#293 opened 14 days ago
by 
Croc-Prog-HF
gsarti
authored 5
papers 16 days ago
Beyond the Commitment Boundary: Probing Epiphenomenal Chain-of-Thought in Large Reasoning Models
Paper • 2606.13603 • Published
Distilling Formal Logic into Neural Spaces: A Kernel Alignment Approach for Signal Temporal Logic
Paper • 2603.05198 • Published
Bridging Logic and Learning: Decoding Temporal Logic Embeddings via Transformers
Paper • 2507.07808 • Published
Predicting Future Behaviors in Reasoning Models Enables Better Steering
Paper • 2606.11172 • Published • 1
Interpreto: An Explainability Library for Transformers
Paper • 2512.09730 • Published • 1
Post
1691
I present to you a new experimental open book.
https://github.com/stas00/python-cookbook
I took my dense Python cheatsheet that I have been honing for many years and use a lot daily and turned it into a book of recipes.
Is this useful?
This is, of course, free, like other open books.
https://github.com/stas00/python-cookbook
I took my dense Python cheatsheet that I have been honing for many years and use a lot daily and turned it into a book of recipes.
Is this useful?
This is, of course, free, like other open books.
Post
458
The Art of Debugging Open Free book is now available in pdf/epub and finally sports a book cover
https://github.com/stas00/the-art-of-debugging#ebook-versions-of-the-book
While a lot of the focus is on Unix/Python/Pytorch, the methodology chapter is applicable to any Software Debugging.
It currently sports 161 packed pages in 5 solid chapters and more coming...
https://github.com/stas00/the-art-of-debugging#ebook-versions-of-the-book
While a lot of the focus is on Unix/Python/Pytorch, the methodology chapter is applicable to any Software Debugging.
It currently sports 161 packed pages in 5 solid chapters and more coming...
- 7 replies
Post
144
In parallel we announce a new open source repo:
https://github.com/Snowflake-AI-Research/Arctic-Platform
This is the framework for very fast RL (and future other optimizations rolled into it)
It currently has all the code you need to use or integrate Arctic RL into RL frameworks, with SkyRL and Verl available and more framework integrations coming.
Please kindly spread the word! Thank you!
https://github.com/Snowflake-AI-Research/Arctic-Platform
This is the framework for very fast RL (and future other optimizations rolled into it)
It currently has all the code you need to use or integrate Arctic RL into RL frameworks, with SkyRL and Verl available and more framework integrations coming.
Please kindly spread the word! Thank you!
Post
3638
After many months of intense work the
Snowflake AI Research team is happy to present to you the new open source project: Arctic RL
https://snowflake.com/en/blog/engineering/arctic-rl-open-source-backend/
- Arctic RL integrates with VeRL and SkyRL today; enable ZoRRo with one config flag, no code changes required
- ZoRRo delivers up to 6x actor-update acceleration and a 3.5x end-to-end training speedup, reducing Arctic-Text2SQL-R2 training from ~5 days to ~36 hours on 32 H200 GPUs
- Arctic-Text2SQL-R2 achieved higher accuracy scores (48.7) than Gemini 3.1 Pro (47.9) and Claude 4.7 (47.3) on Snowflake's evaluated enterprise SQL benchmark under the tested conditions
- Two open source recipes ship with this release: a text-to-SQL recipe that improved BIRD dev accuracy from 59.92% to 70.35%, and a multi-hop QA recipe that improved average accuracy from 69.6% to 72.3%
Snowflake AI Research team is happy to present to you the new open source project: Arctic RL
https://snowflake.com/en/blog/engineering/arctic-rl-open-source-backend/
- Arctic RL integrates with VeRL and SkyRL today; enable ZoRRo with one config flag, no code changes required
- ZoRRo delivers up to 6x actor-update acceleration and a 3.5x end-to-end training speedup, reducing Arctic-Text2SQL-R2 training from ~5 days to ~36 hours on 32 H200 GPUs
- Arctic-Text2SQL-R2 achieved higher accuracy scores (48.7) than Gemini 3.1 Pro (47.9) and Claude 4.7 (47.3) on Snowflake's evaluated enterprise SQL benchmark under the tested conditions
- Two open source recipes ship with this release: a text-to-SQL recipe that improved BIRD dev accuracy from 59.92% to 70.35%, and a multi-hop QA recipe that improved average accuracy from 69.6% to 72.3%
- 4 replies
Post
144
PSA for DeepSpeed users - a long outstanding precision-related critical bug has been identified and fixed in https://github.com/deepspeedai/DeepSpeed/pull/8066 and a new release has been made.
The issue was about mixed precision mode downcasting buffers that had to be in fp32 - massively impacting correctness due to large static buffers - e.g. RoPE in Qwen3 models when using long sequence lengths 32K+.
Hopefully this fix brings Deepspeed to a close parity with FSDP2 which has been an issue since a long time.
You can still have the old behavior but you'd now need to manually configure it - by default the model's buffers will now remain in the original precision.
Please install deepspeed==0.19.2 which will do the right thing.
Thanks to Tunji Ruwase and Claude Opus 4.8 via Cursor for identifying and fixing the problem.
The issue was about mixed precision mode downcasting buffers that had to be in fp32 - massively impacting correctness due to large static buffers - e.g. RoPE in Qwen3 models when using long sequence lengths 32K+.
Hopefully this fix brings Deepspeed to a close parity with FSDP2 which has been an issue since a long time.
You can still have the old behavior but you'd now need to manually configure it - by default the model's buffers will now remain in the original precision.
Please install deepspeed==0.19.2 which will do the right thing.
Thanks to Tunji Ruwase and Claude Opus 4.8 via Cursor for identifying and fixing the problem.
craffel
authored a
paper about 2 months ago
why mt0-large is 1.3B while mt5-large is 780M?
1
#6 opened almost 2 years ago
by 
tansq
Geração de Texto
#63 opened 9 months ago
by 
alcidesmoreira1963
Adding Evaluation Results
#61 opened over 2 years ago
by 
leaderboard-pr-bot
Hosted inference API: 500 Internal Server Error returned
1
#4 opened almost 4 years ago
by 
MarkDeSouza
Adding Evaluation Results
#41 opened over 2 years ago
by leaderboard-pr-bot
Adding Evaluation Results
#42 opened about 2 years ago
by leaderboard-pr-bot
