The Minitron Models and Their Teachers, Quantized
updated
kaitchup/Mistral-NeMo-Minitron-8B-Base-AutoRound-GPTQ-sym-4bit
Text Generation
• 8B • Updated • 14
kaitchup/Mistral-NeMo-Minitron-8B-Base-AutoRound-GPTQ-asym-4bit
Text Generation
• 8B • Updated • 16
kaitchup/Mistral-Nemo-Base-2407-AutoRound-GPTQ-asym-4bit
Text Generation
• 12B • Updated • 15
kaitchup/Llama-3.1-Minitron-4B-Width-Base-AutoRound-GPTQ-asym-4bit
Text Generation
• 5B • Updated • 13
kaitchup/Meta-Llama-3.1-8B-AutoRound-GPTQ-asym-4bit
Text Generation
• 8B • Updated • 15
kaitchup/Llama-3.1-Minitron-4B-Depth-Base-AutoRound-GPTQ-asym-4bit
Text Generation
• 5B • Updated • 12
kaitchup/Llama-3.1-Minitron-4B-Width-Base-AutoRound-GPTQ-sym-4bit
Text Generation
• 5B • Updated • 11
kaitchup/Llama-3.1-Minitron-4B-Depth-Base-AutoRound-GPTQ-sym-4bit
Text Generation
• 5B • Updated • 11
kaitchup/Mistral-Nemo-Base-2407-AutoRound-GPTQ-sym-4bit
Text Generation
• 12B • Updated • 18
• 1
kaitchup/Meta-Llama-3.1-8B-AutoRound-GPTQ-sym-4bit
Text Generation
• 8B • Updated • 15