Configuration Parsing Warning:In config.json: "quantization_config.modules_to_not_convert" must be an array
https://huggingface.co/CohereForAI/c4ai-command-r-plus-08-2024
quant_config = { "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }
- Downloads last month
- 76
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for aixsatoshi/c4ai-command-r-plus-08-2024-awq
Base model
CohereLabs/c4ai-command-r-plus-08-2024