can i get the settings for gpqa diamond benchmarks
#6
by shahidchdry - opened
i tried evaluating with default qwen settings (1 temperature) for reasoning and default gpqa diamond zero shot (0 temperature) it severely underperforms in both it gives under 80% score