Instructions to use Ellbendls/Qwen-2.5-3b-Quran-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Ellbendls/Qwen-2.5-3b-Quran-GGUF with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Ellbendls/Qwen-2.5-3b-Quran-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Ellbendls/Qwen-2.5-3b-Quran-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Ellbendls/Qwen-2.5-3b-Quran-GGUF # Run inference directly in the terminal: llama cli -hf Ellbendls/Qwen-2.5-3b-Quran-GGUF
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Ellbendls/Qwen-2.5-3b-Quran-GGUF # Run inference directly in the terminal: llama cli -hf Ellbendls/Qwen-2.5-3b-Quran-GGUF
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Ellbendls/Qwen-2.5-3b-Quran-GGUF # Run inference directly in the terminal: ./build/bin/llama cli -hf Ellbendls/Qwen-2.5-3b-Quran-GGUF
Use Docker
docker model run hf.co/Ellbendls/Qwen-2.5-3b-Quran-GGUF
- Llama new
- LM Studio
- Jan
- Ollama
How to use Ellbendls/Qwen-2.5-3b-Quran-GGUF with Ollama:
ollama run hf.co/Ellbendls/Qwen-2.5-3b-Quran-GGUF
- Unsloth Desktop
- Docker Model Runner
How to use Ellbendls/Qwen-2.5-3b-Quran-GGUF with Docker Model Runner:
docker model run hf.co/Ellbendls/Qwen-2.5-3b-Quran-GGUF
- Lemonade
How to use Ellbendls/Qwen-2.5-3b-Quran-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Ellbendls/Qwen-2.5-3b-Quran-GGUF
Run and chat with the model
lemonade run user.Qwen-2.5-3b-Quran-GGUF-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
Model Card for Fine-Tuned Qwen2.5-3B-Instruct
This is a fine-tuned version of the Qwen2.5-3B-Instruct model. The fine-tuning process utilized the Quran Indonesia Tafseer Translation dataset, which provides translations and tafsir in Bahasa Indonesia for the Quran.
Model Details
Model Description
- Base Model: Qwen2.5-3B-Instruct
- Fine-Tuned By: Ellbendl Satria
- Dataset: emhaihsan/quran-indonesia-tafseer-translation
- Language: Bahasa Indonesia
- License: MIT
This model is designed for NLP tasks involving Quranic text in Bahasa Indonesia, including understanding translations and tafsir.
Uses
Direct Use
This model can be used for applications requiring the understanding, summarization, or retrieval of Quranic translations and tafsir in Bahasa Indonesia.
Downstream Use
It is suitable for fine-tuning on tasks such as:
- Quranic text summarization
- Question answering systems related to Islamic knowledge
- Educational tools for learning Quranic content in Indonesian
Biases
- The model inherits any biases present in the dataset, which is specific to Islamic translations and tafsir in Bahasa Indonesia.
Recommendations
- Users should ensure that applications using this model respect cultural and religious sensitivities.
- Results should be verified by domain experts for critical applications.
- Downloads last month
- 32
We're not able to determine the quantization variants.