pranavupadhyaya52/Wiki-SmartBotLM-Instruct
Feature Extraction • 0.3B • Updated • 744 • 13
Pranav Upadhyaya PRO
pranavupadhyaya52
AI & ML interests
None yet
Recent Activity
repliedto their post 10 days ago
Wiki-SmartBotLM Benchmarked. Here are the results:
Benchmark WikiSB | Gemma3_270M
BoolQ 37.8 | 61.4
ARC Challenge 24.2 | 28.2
HellaSwag 26.3 | 37.7
PIQA 53.5 | 66.2
Winogrande 50.2 | 52.3
Summary:
Closest benchmark: Winogrande (2.1-point gap)
Strong performance: ARC Challenge (4.0-point gap)
Moderate gap: HellaSwag and PIQA
Largest gap: BoolQ (Reading Comprehension)
It shows despite the training difference between Gemma3 270M and WikiSmartBotLM, It does come close to Gemma 3 in some benchmarks.
https://huggingface.co/pranavupadhyaya52/Wiki-SmartBotLM-Instruct posted an update 12 days ago
Wiki-SmartBotLM Benchmarked. Here are the results:
Benchmark WikiSB | Gemma3_270M
BoolQ 37.8 | 61.4
ARC Challenge 24.2 | 28.2
HellaSwag 26.3 | 37.7
PIQA 53.5 | 66.2
Winogrande 50.2 | 52.3
Summary:
Closest benchmark: Winogrande (2.1-point gap)
Strong performance: ARC Challenge (4.0-point gap)
Moderate gap: HellaSwag and PIQA
Largest gap: BoolQ (Reading Comprehension)
It shows despite the training difference between Gemma3 270M and WikiSmartBotLM, It does come close to Gemma 3 in some benchmarks.
https://huggingface.co/pranavupadhyaya52/Wiki-SmartBotLM-Instruct updated a model 12 days ago
pranavupadhyaya52/Wiki-SmartBotLM-InstructOrganizations
