Error running Llama 3.1 Minitron 4B quantized model with Ollama

anasainea
Tue, 27 Aug 2024 15:41:42 +0000

I am getting the same error, I tried IQ3_M from :

huggingface.co

mradermacher/Llama-3.1-Minitron-4B-Width-Base-GGUF at main

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

and IQ3_M and IQ3_S from :

huggingface.co

legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.