LLM architecture Dots1ForCausalLM conversion to GGUF

John6666
Sat, 07 Jun 2025 15:53:44 +0000

Hmm… This?

github.com/ggml-org/llama.cpp

Architecture "LlamaForCausalLM" not supported

opened 12:45PM - 26 Jan 24 UTC

closed 01:08AM - 02 Apr 24 UTC

dfengpo

bug-unconfirmed stale

I use python convert-hf-to-gguf.py /fengpo/github/Yi-34B-Chat-8bits. I get this… error: File "/fengpo/github/llama.cpp/convert-hf-to-gguf.py", line 1335, in main model_instance = model_class(dir_model, ftype_map[args.outtype], fname_out, args.bigendian) File "/fengpo/github/llama.cpp/convert-hf-to-gguf.py", line 57, in __init__ self.model_arch = self._get_model_architecture() File "/fengpo/github/llama.cpp/convert-hf-to-gguf.py", line 254, in _get_model_architecture raise NotImplementedError(f'Architecture "{arch}" not supported!') NotImplementedError: Architecture "LlamaForCausalLM" not supported!. This also contain LlamaForCausalLM. ![image](https://github.com/ggerganov/llama.cpp/assets/12029452/f803d6bd-d671-45a4-bf41-0cc707d1b607)

Galunid
convert-hf-to-gguf.py never supported llama based models. Please use convert.py.

Read full topic