runtime error
Exit code: 1. Reason: π₯ Downloading Qwen 3.5 (4B) from Hugging Face... /home/user/.local/lib/python3.10/site-packages/huggingface_hub/file_download.py:986: UserWarning: `local_dir_use_symlinks` parameter is deprecated and will be ignored. The process to download files to a local folder has been updated and do not rely on symlinks anymore. You only need to pass a destination folder as`local_dir`. For more details, check out https://huggingface.co/docs/huggingface_hub/main/en/guides/download#download-files-to-local-folder. warnings.warn( π Initializing Qwen engine at ml_models/qwen-3.5-4b.gguf Traceback (most recent call last): File "/home/user/app/qwen_api.py", line 227, in <module> get_qwen() File "/home/user/app/qwen_api.py", line 41, in get_qwen _llm = Llama( File "/home/user/.local/lib/python3.10/site-packages/llama_cpp/llama.py", line 381, in __init__ internals.LlamaModel( File "/home/user/.local/lib/python3.10/site-packages/llama_cpp/_internals.py", line 59, in __init__ raise ValueError(f"Failed to load model from file: {path_model}") ValueError: Failed to load model from file: ml_models/qwen-3.5-4b.gguf Exception ignored in: <function LlamaModel.__del__ at 0x7ffb29264dc0> Traceback (most recent call last): File "/home/user/.local/lib/python3.10/site-packages/llama_cpp/_internals.py", line 87, in __del__ self.close() File "/home/user/.local/lib/python3.10/site-packages/llama_cpp/_internals.py", line 79, in close if self.sampler is not None: AttributeError: 'LlamaModel' object has no attribute 'sampler'
Container logs:
Fetching error logs...