Clarify LoRA direction filenames
Browse filesRename adapters using apply_to_BASE__toward_TARGET terminology and document compressed-matrix rank fidelity separately from misleading global energy capture.
- README.md +35 -13
- SHA256SUMS +6 -6
- minimax_h3_ref2va_from_fl2va_pruned_rank1024_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors +0 -0
- minimax_h3_ref2va_from_fl2va_pruned_rank1024_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors.json +0 -0
- minimax_h3_ref2va_from_fl2va_pruned_rank256_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors +0 -0
- minimax_h3_ref2va_from_fl2va_pruned_rank256_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors.json +0 -0
- minimax_h3_ref2va_from_fl2va_pruned_rank512_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors +0 -0
- minimax_h3_ref2va_from_fl2va_pruned_rank512_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors.json +0 -0
- minimax_h3_fl2va_from_ref2va_pruned_rank1024_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors +0 -0
- minimax_h3_fl2va_from_ref2va_pruned_rank1024_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors.json +2 -2
- minimax_h3_fl2va_from_ref2va_pruned_rank256_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors +0 -0
- minimax_h3_fl2va_from_ref2va_pruned_rank256_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors.json +2 -2
- minimax_h3_fl2va_from_ref2va_pruned_rank512_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors +0 -0
- minimax_h3_fl2va_from_ref2va_pruned_rank512_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors.json +2 -2
README.md
CHANGED
|
@@ -35,7 +35,11 @@ At strength `1.0`, applying an adapter to its matching base moves the model towa
|
|
| 35 |
|
| 36 |
## Required checkpoints and directions
|
| 37 |
|
| 38 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 39 |
|
| 40 |
```text
|
| 41 |
Comfy-Org/MiniMax-H3
|
|
@@ -48,7 +52,7 @@ Base SHA-256:
|
|
| 48 |
a32572fb90b5508b201ec7c2eddcc184b13ddfd3c6f6d2cf06a0b46535d541b4
|
| 49 |
```
|
| 50 |
|
| 51 |
-
For files named `
|
| 52 |
|
| 53 |
```text
|
| 54 |
diffusion_models/minimax_h3_ref2va_pruned_bf16.safetensors
|
|
@@ -59,23 +63,41 @@ Do not expect correct results with the full-size BF16, FP8, or INT8 checkpoints.
|
|
| 59 |
|
| 60 |
## Files
|
| 61 |
|
| 62 |
-
|
|
| 63 |
-
|---|---|---
|
| 64 |
-
| FL2VA
|
| 65 |
-
| FL2VA
|
| 66 |
-
| FL2VA
|
| 67 |
-
| Ref2VA
|
| 68 |
-
| Ref2VA
|
| 69 |
-
| Ref2VA
|
| 70 |
-
|
| 71 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
|
| 73 |
Each `.safetensors.json` file contains the complete per-layer extraction report.
|
| 74 |
|
| 75 |
## ComfyUI use
|
| 76 |
|
| 77 |
1. Put one `.safetensors` file in `ComfyUI/models/loras/`.
|
| 78 |
-
2.
|
| 79 |
3. Apply the adapter with a model-only LoRA loader.
|
| 80 |
4. Start at model strength `1.0`; compare `0.25`, `0.5`, `0.75`, and `1.0` using identical inputs.
|
| 81 |
5. Do not stack ranks or opposing directions together. They are alternative forms of the same underlying delta.
|
|
|
|
| 35 |
|
| 36 |
## Required checkpoints and directions
|
| 37 |
|
| 38 |
+
The filenames state both the checkpoint to load and the direction of the
|
| 39 |
+
adapter. `apply_to_fl2va__toward_ref2va` means exactly: load the pruned FL2VA
|
| 40 |
+
checkpoint, then apply that LoRA to move its weights toward Ref2VA.
|
| 41 |
+
|
| 42 |
+
For files named `apply_to_fl2va__toward_ref2va`, use this base:
|
| 43 |
|
| 44 |
```text
|
| 45 |
Comfy-Org/MiniMax-H3
|
|
|
|
| 52 |
a32572fb90b5508b201ec7c2eddcc184b13ddfd3c6f6d2cf06a0b46535d541b4
|
| 53 |
```
|
| 54 |
|
| 55 |
+
For files named `apply_to_ref2va__toward_fl2va`, use this base:
|
| 56 |
|
| 57 |
```text
|
| 58 |
diffusion_models/minimax_h3_ref2va_pruned_bf16.safetensors
|
|
|
|
| 63 |
|
| 64 |
## Files
|
| 65 |
|
| 66 |
+
| Apply to this base | Move toward | File | Size |
|
| 67 |
+
|---|---|---|---:|
|
| 68 |
+
| pruned FL2VA BF16 | Ref2VA | `minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors` | 2.589 GB |
|
| 69 |
+
| pruned FL2VA BF16 | Ref2VA | `minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors` | 5.075 GB |
|
| 70 |
+
| pruned FL2VA BF16 | Ref2VA | `minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors` | 10.048 GB |
|
| 71 |
+
| pruned Ref2VA BF16 | FL2VA | `minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors` | 2.589 GB |
|
| 72 |
+
| pruned Ref2VA BF16 | FL2VA | `minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors` | 5.075 GB |
|
| 73 |
+
| pruned Ref2VA BF16 | FL2VA | `minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors` | 10.048 GB |
|
| 74 |
+
|
| 75 |
+
### What rank preserves
|
| 76 |
+
|
| 77 |
+
| Rank | Median capture across compressed matrices | Mean capture across compressed matrices | Global energy-weighted capture |
|
| 78 |
+
|---:|---:|---:|---:|
|
| 79 |
+
| 256 | 14.32% | 16.77% | 99.1260% |
|
| 80 |
+
| 512 | 26.40% | 29.70% | 99.2417% |
|
| 81 |
+
| 1024 | 46.11% | 49.62% | 99.4311% |
|
| 82 |
+
|
| 83 |
+
The global weighted percentage is **not the full story and is not a quality
|
| 84 |
+
score**. It is dominated by a small number of high-energy tensors with low
|
| 85 |
+
effective rank. Of the 264 matrix deltas, 54 low-rank matrices are reconstructed
|
| 86 |
+
essentially exactly at every requested rank. The table's median and mean are
|
| 87 |
+
calculated over the remaining 210 matrices that are genuinely compressed;
|
| 88 |
+
typical large attention and MLP matrices retain much less energy. Rank 1024 can
|
| 89 |
+
therefore be materially more faithful than rank 256 even though their global
|
| 90 |
+
weighted figures differ by only about 0.3 percentage points. Weight-space
|
| 91 |
+
energy also does not predict which directions matter most during inference;
|
| 92 |
+
compare actual generations with identical prompts, inputs, seeds, and sampler
|
| 93 |
+
settings.
|
| 94 |
|
| 95 |
Each `.safetensors.json` file contains the complete per-layer extraction report.
|
| 96 |
|
| 97 |
## ComfyUI use
|
| 98 |
|
| 99 |
1. Put one `.safetensors` file in `ComfyUI/models/loras/`.
|
| 100 |
+
2. Follow the filename literally: load pruned FL2VA for an `apply_to_fl2va` file, or pruned Ref2VA for an `apply_to_ref2va` file.
|
| 101 |
3. Apply the adapter with a model-only LoRA loader.
|
| 102 |
4. Start at model strength `1.0`; compare `0.25`, `0.5`, `0.75`, and `1.0` using identical inputs.
|
| 103 |
5. Do not stack ranks or opposing directions together. They are alternative forms of the same underlying delta.
|
SHA256SUMS
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
-
f8f15be3728fe52159b2dd840f6c8d7057f99b93690ba5bb129d827757cf13f4
|
| 2 |
-
f7e7fac7e5d29622705f92e1a1cd359db0c54c3364344fdecfc82d8d32b7d512
|
| 3 |
-
b97515fd5e654a3b37c4f499404f73340cb46e93bb626a575cd8626fd889fad0
|
| 4 |
-
cd4001221599e88f1fa06b2e0cddbc69d61e14765f9b0a994369663f9fc86167
|
| 5 |
-
b7cad943cea4fee3d4614c092f78b370fd3d9cc876f7a5c6f6d254c1aed8b122
|
| 6 |
-
8c90b63df76e1819870c8b6809b08eb2bf8cf80348e59e3117d69e322a481d68
|
|
|
|
| 1 |
+
f8f15be3728fe52159b2dd840f6c8d7057f99b93690ba5bb129d827757cf13f4 minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors
|
| 2 |
+
f7e7fac7e5d29622705f92e1a1cd359db0c54c3364344fdecfc82d8d32b7d512 minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors
|
| 3 |
+
b97515fd5e654a3b37c4f499404f73340cb46e93bb626a575cd8626fd889fad0 minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors
|
| 4 |
+
cd4001221599e88f1fa06b2e0cddbc69d61e14765f9b0a994369663f9fc86167 minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors
|
| 5 |
+
b7cad943cea4fee3d4614c092f78b370fd3d9cc876f7a5c6f6d254c1aed8b122 minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors
|
| 6 |
+
8c90b63df76e1819870c8b6809b08eb2bf8cf80348e59e3117d69e322a481d68 minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors
|
minimax_h3_ref2va_from_fl2va_pruned_rank1024_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors
RENAMED
|
File without changes
|
minimax_h3_ref2va_from_fl2va_pruned_rank1024_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors.json
RENAMED
|
File without changes
|
minimax_h3_ref2va_from_fl2va_pruned_rank256_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors
RENAMED
|
File without changes
|
minimax_h3_ref2va_from_fl2va_pruned_rank256_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors.json
RENAMED
|
File without changes
|
minimax_h3_ref2va_from_fl2va_pruned_rank512_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors
RENAMED
|
File without changes
|
minimax_h3_ref2va_from_fl2va_pruned_rank512_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors.json
RENAMED
|
File without changes
|
minimax_h3_fl2va_from_ref2va_pruned_rank1024_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors
RENAMED
|
File without changes
|
minimax_h3_fl2va_from_ref2va_pruned_rank1024_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors.json
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8ee2f123f3d1a9b25933658437723c8a2c935c6978acd2bcd28c13f46de5bcc5
|
| 3 |
+
size 216963
|
minimax_h3_fl2va_from_ref2va_pruned_rank256_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors
RENAMED
|
File without changes
|
minimax_h3_fl2va_from_ref2va_pruned_rank256_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors.json
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d342a9d440748acfe9a30a29f16cb3b30f564528984d91c28429683e138a6b5d
|
| 3 |
+
size 217073
|
minimax_h3_fl2va_from_ref2va_pruned_rank512_bf16_lora.safetensors β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors
RENAMED
|
File without changes
|
minimax_h3_fl2va_from_ref2va_pruned_rank512_bf16_lora.safetensors.json β minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors.json
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fcaabc6099d36a7f71f5f87a1f4c754af477702a072b070cfb89be6a79ad4481
|
| 3 |
+
size 216946
|