Models used in CHARM: Calibrating Reward Models With Chatbot Arena Scores.
shawnxzhu
shawnxzhu
AI & ML interests
None yet
Recent Activity
authored a paper 10 days ago
EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL submitted a paper 10 days ago
EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL upvoted a paper 10 days ago
EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RLOrganizations
Datasets used in CHARM: Calibrating Reward Models With Chatbot Arena Scores.
-
shawnxzhu/CHARM-preference20K-gemma-2-9b-it-SimPO
Viewer • Updated • 20k • 16 -
shawnxzhu/CHARM-preference20K-GPT-4o-mini-2024-07-18
Viewer • Updated • 20k • 10 -
shawnxzhu/CHARM-preference20K-gemma-2-9b-it
Viewer • Updated • 20k • 21 -
shawnxzhu/CHARM-preference20K-Llama-3.1-8B-Instruct
Viewer • Updated • 20k • 9
Models used in CHARM: Calibrating Reward Models With Chatbot Arena Scores.
Datasets used in CHARM: Calibrating Reward Models With Chatbot Arena Scores.
-
shawnxzhu/CHARM-preference20K-gemma-2-9b-it-SimPO
Viewer • Updated • 20k • 16 -
shawnxzhu/CHARM-preference20K-GPT-4o-mini-2024-07-18
Viewer • Updated • 20k • 10 -
shawnxzhu/CHARM-preference20K-gemma-2-9b-it
Viewer • Updated • 20k • 21 -
shawnxzhu/CHARM-preference20K-Llama-3.1-8B-Instruct
Viewer • Updated • 20k • 9
datasets 10
shawnxzhu/DSAA6000Q-Mistral-7B-Instruct-v0.2-lima-dpo
Viewer • Updated • 1.03k • 14
shawnxzhu/CHARM-preference20K
Viewer • Updated • 20k • 15
shawnxzhu/CHARM-preference20K-Qwen2.5-72B-Instruct
Viewer • Updated • 20k • 8
shawnxzhu/CHARM-preference20K-Llama-3.1-70B-Instruct
Viewer • Updated • 20k • 7
shawnxzhu/CHARM-preference20K-Llama-3.1-8B-Instruct
Viewer • Updated • 20k • 9
shawnxzhu/CHARM-preference20K-GPT-4o-mini-2024-07-18
Viewer • Updated • 20k • 10
shawnxzhu/CHARM-preference20K-gemma-2-27b-it
Viewer • Updated • 20k • 18
shawnxzhu/CHARM-preference20K-gemma-2-9b-it
Viewer • Updated • 20k • 21
shawnxzhu/CHARM-preference20K-gemma-2-9b-it-SimPO
Viewer • Updated • 20k • 16
shawnxzhu/backward-curation
Preview • Updated • 2