hancheolp commited on
Commit
6e78cc9
·
verified ·
1 Parent(s): 28ca6bd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -16
README.md CHANGED
@@ -2,6 +2,9 @@
2
  base_model: upstage/Solar-Open2-250B
3
  base_model_relation: quantized
4
  library_name: vllm
 
 
 
5
  pipeline_tag: text-generation
6
  language:
7
  - en
@@ -40,20 +43,16 @@ large language models.
40
  quantization process.
41
 
42
  ## License
43
- This repository contains both model weights and code,
44
- which are licensed under different terms:
45
 
46
- 1. MODEL WEIGHTS (*.safetensors)
47
- The Upstage Solar License is based on the permissive Apache License 2.0 with specific mandatory conditions to support the Solar ecosystem.
48
-
49
- **Key requirements for Derivative AI Models** (create / train / fine-tune / distill / improve using Solar Open 2):
50
- - Naming: prefix your model name with "Solar" (e.g., Solar-MyModel-v1).
51
- - Attribution: prominently display "Built with Solar" in related public-facing materials.
52
- - Notice: include a copy of the Upstage Solar License with your derivative model.
53
 
54
- 2. CODE (*.py, *.json, *.jinja files)
55
- Licensed under **Apache License 2.0**
56
- See: https://www.apache.org/licenses/LICENSE-2.0
 
 
 
 
57
 
58
  ## Performance
59
 
@@ -85,23 +84,53 @@ which are licensed under different terms:
85
  | KorMedMCQA | 92.99 | 92.85 |
86
  | **Avg.** | **81.57** | **81.17** |
87
 
88
- ## Usage
89
 
90
  This model is packed in the AutoRound (GPTQ-compatible) INT4 format and can be served
91
  directly with vLLM:
92
 
 
 
 
 
 
 
 
 
 
 
93
  ```bash
94
  vllm serve nota-ai/Solar-Open2-250B-Nota-INT4 \
 
95
  --tensor-parallel-size 4 \
96
- --trust-remote-code
 
 
 
 
97
  ```
98
 
99
  - Set `--tensor-parallel-size` according to the number of GPUs available in your serving environment.
100
 
101
- - For reasoning and tool-calling, use the reasoning parser and tool parser provided in the original [upstage/Solar-Open2-250B](https://huggingface.co/upstage/) model card.
102
-
103
  - See the original model card for the prompt format, parser configuration, and further details.
104
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
105
  ## Citation
106
  ```bibtex
107
  @inproceedings{park2026dreammoe,
 
2
  base_model: upstage/Solar-Open2-250B
3
  base_model_relation: quantized
4
  library_name: vllm
5
+ license: other
6
+ license_name: upstage-solar-license
7
+ license_link: LICENSE
8
  pipeline_tag: text-generation
9
  language:
10
  - en
 
43
  quantization process.
44
 
45
  ## License
 
 
46
 
47
+ Solar Open 2 is distributed under the [**Upstage Solar License**](https://huggingface.co/upstage/Solar-Open2-250B/blob/main/LICENSE).
 
 
 
 
 
 
48
 
49
+ **Key requirements for Derivative AI Models** (create / train / fine-tune / distill / improve using Solar Open 2):
50
+
51
+ - **Naming:** prefix your model name with "Solar" (e.g., `Solar-MyModel-v1`).
52
+
53
+ - **Attribution:** prominently display "Built with Solar" in related public-facing materials.
54
+
55
+ - **Notice:** include a copy of the Upstage Solar License with your derivative model.
56
 
57
  ## Performance
58
 
 
84
  | KorMedMCQA | 92.99 | 92.85 |
85
  | **Avg.** | **81.57** | **81.17** |
86
 
87
+ ## Quick Start
88
 
89
  This model is packed in the AutoRound (GPTQ-compatible) INT4 format and can be served
90
  directly with vLLM:
91
 
92
+ ```bash
93
+ uv venv --python 3.12 --seed solar_open2_venv
94
+ source .venv/bin/activate
95
+
96
+ VLLM_PRECOMPILED_WHEEL_LOCATION="https://github.com/vllm-project/vllm/releases/download/v0.22.0/vllm-0.22.0%2Bcu129-cp38-abi3-manylinux_2_28_x86_64.whl" \
97
+ VLLM_USE_PRECOMPILED=1 \
98
+ uv pip install --reinstall-package vllm --torch-backend=cu129 \
99
+ "git+https://github.com/UpstageAI/vllm.git@v0.22.0-solar-open2"
100
+ ```
101
+
102
  ```bash
103
  vllm serve nota-ai/Solar-Open2-250B-Nota-INT4 \
104
+ --served-model-name solar-open2-250b \
105
  --tensor-parallel-size 4 \
106
+ --default-chat-template-kwargs '{"think_render_option":"preserved"}' \
107
+ --reasoning-parser solar_open2 \
108
+ --tool-call-parser solar_open2 \
109
+ --enable-auto-tool-choice \
110
+ --logits-processors vllm.v1.sample.logits_processor.solar_open2:SolarOpen2TemplateLogitsProcessor
111
  ```
112
 
113
  - Set `--tensor-parallel-size` according to the number of GPUs available in your serving environment.
114
 
 
 
115
  - See the original model card for the prompt format, parser configuration, and further details.
116
 
117
+ Send a chat completion request:
118
+
119
+ ```bash
120
+ curl http://localhost:8000/v1/chat/completions \
121
+ -H "Content-Type: application/json" \
122
+ -d '{
123
+ "model": "solar-open2-250b",
124
+ "messages": [
125
+ {"role": "user", "content": "What is Upstage?"}
126
+ ],
127
+ "max_tokens": 131584,
128
+ "temperature": 1.0,
129
+ "top_p": 1.0,
130
+ "reasoning_effort": "high"
131
+ }'
132
+ ```
133
+
134
  ## Citation
135
  ```bibtex
136
  @inproceedings{park2026dreammoe,