jadael/comma-v0.1-2t-GGUF

Comma v0.1-2T - GGUF

This is a GGUF conversion of common-pile/comma-v0.1-2t for use with llama.cpp and Ollama.

Model Details

Original Model: Comma v0.1-2T Architecture: Llama 3 (7B parameters) Training: 2 trillion tokens from the Common Pile v0.1 dataset License: Apache 2.0 Converted by: Community conversion

About Comma v0.1

Comma v0.1-2T is a 7 billion parameter language model trained exclusively on openly licensed and public domain text from the Common Pile v0.1 dataset. This model demonstrates that competitive performance can be achieved using only ethically sourced training data.

Performance is competitive with Llama 2 7B, OLMo, and DeepSeekLLM on knowledge-intensive and coding benchmarks.

GGUF Conversion Details

• Format: GGUF
• Quantization: F16 (non-quantized, full precision)
• Size: 14GB
• Converted with: llama.cpp (with custom patch for Comma tokenizer)
• File: comma-v0.1-2t-f16.gguf

Conversion Notes

This conversion required patching llama.cpp to recognize Comma v0.1's tokenizer format. The tokenizer uses Llama 3 style BPE with a unique checksum. The patch has been included in this repository for others who want to convert similar models.

Usage with Ollama

1. Download the GGUF file

Download from the Files tab above, or use the command line:

huggingface-cli download jadael/comma-v0.1-2t-GGUF comma-v0.1-2t-f16.gguf --local-dir .

2. Create a Modelfile

FROM ./comma-v0.1-2t-f16.gguf

TEMPLATE """{{ .Prompt }}"""

PARAMETER stop "<|end_of_text|>"
PARAMETER temperature 0.7
PARAMETER top_p 0.9
PARAMETER repeat_penalty 1.1

Note: This is a base model (not instruction-tuned), so it will continue/complete text rather than follow chat instructions.

3. Import the model

ollama create comma-v0.1-2t -f Modelfile

4. Run the model

ollama run comma-v0.1-2t

Example usage (text completion):

>>> Once upon a time in a land far away
[Model will continue the story...]

Usage with llama.cpp

./llama-cli -m comma-v0.1-2t-f16.gguf -p "Your prompt here" -n 128

Important Notes

• This is a base model (not instruction-tuned)
• Trained on Common Pile v0.1: openly licensed and public domain text only
• Suitable for further fine-tuning or use as a foundation model
• For chat/instruct capabilities, fine-tuning is recommended

Citation

If you use this model, please cite the original Common Pile work:

@article{commonpile2025,
  title={The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text},
  author={[Original authors from Common Pile team]},
  year={2025}
}

Links

• Original Model: https://huggingface.co/common-pile/comma-v0.1-2t
• Common Pile Dataset: https://huggingface.co/common-pile
• Project Blog: https://blog.eleuther.ai/common-pile/
• Ollama: https://ollama.com
• llama.cpp: https://github.com/ggerganov/llama.cpp

License

This GGUF conversion is released under Apache 2.0 (same as the original model).

Apache 2.0 was chosen because:

• It matches the original Comma v0.1-2T model license
• It's compatible with llama.cpp's MIT license
• It provides patent grants and protections
• It requires attribution and license preservation
• It's the most protective license compatible with all components

All conversions, tools, and documentation in this repository are Apache 2.0 licensed.