ethanfel commited on
Commit
6945e76
Β·
verified Β·
1 Parent(s): 7a77706

Clarify LoRA direction filenames

Browse files

Rename adapters using apply_to_BASE__toward_TARGET terminology and document compressed-matrix rank fidelity separately from misleading global energy capture.

Files changed (14) hide show
  1. README.md +35 -13
  2. SHA256SUMS +6 -6
  3. minimax_h3_ref2va_from_fl2va_pruned_rank1024_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors +0 -0
  4. minimax_h3_ref2va_from_fl2va_pruned_rank1024_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors.json +0 -0
  5. minimax_h3_ref2va_from_fl2va_pruned_rank256_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors +0 -0
  6. minimax_h3_ref2va_from_fl2va_pruned_rank256_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors.json +0 -0
  7. minimax_h3_ref2va_from_fl2va_pruned_rank512_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors +0 -0
  8. minimax_h3_ref2va_from_fl2va_pruned_rank512_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors.json +0 -0
  9. minimax_h3_fl2va_from_ref2va_pruned_rank1024_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors +0 -0
  10. minimax_h3_fl2va_from_ref2va_pruned_rank1024_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors.json +2 -2
  11. minimax_h3_fl2va_from_ref2va_pruned_rank256_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors +0 -0
  12. minimax_h3_fl2va_from_ref2va_pruned_rank256_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors.json +2 -2
  13. minimax_h3_fl2va_from_ref2va_pruned_rank512_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors +0 -0
  14. minimax_h3_fl2va_from_ref2va_pruned_rank512_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors.json +2 -2
README.md CHANGED
@@ -35,7 +35,11 @@ At strength `1.0`, applying an adapter to its matching base moves the model towa
35
 
36
  ## Required checkpoints and directions
37
 
38
- For files named `ref2va_from_fl2va`, use this base:
 
 
 
 
39
 
40
  ```text
41
  Comfy-Org/MiniMax-H3
@@ -48,7 +52,7 @@ Base SHA-256:
48
  a32572fb90b5508b201ec7c2eddcc184b13ddfd3c6f6d2cf06a0b46535d541b4
49
  ```
50
 
51
- For files named `fl2va_from_ref2va`, use this base:
52
 
53
  ```text
54
  diffusion_models/minimax_h3_ref2va_pruned_bf16.safetensors
@@ -59,23 +63,41 @@ Do not expect correct results with the full-size BF16, FP8, or INT8 checkpoints.
59
 
60
  ## Files
61
 
62
- | Direction | File | Size | Weighted matrix-delta energy capture |
63
- |---|---|---:|---:|
64
- | FL2VA β†’ Ref2VA | `minimax_h3_ref2va_from_fl2va_pruned_rank256_bf16_lora.safetensors` | 2.589 GB | 99.1260% |
65
- | FL2VA β†’ Ref2VA | `minimax_h3_ref2va_from_fl2va_pruned_rank512_bf16_lora.safetensors` | 5.075 GB | 99.2417% |
66
- | FL2VA β†’ Ref2VA | `minimax_h3_ref2va_from_fl2va_pruned_rank1024_bf16_lora.safetensors` | 10.048 GB | 99.4311% |
67
- | Ref2VA β†’ FL2VA | `minimax_h3_fl2va_from_ref2va_pruned_rank256_bf16_lora.safetensors` | 2.589 GB | 99.1260% |
68
- | Ref2VA β†’ FL2VA | `minimax_h3_fl2va_from_ref2va_pruned_rank512_bf16_lora.safetensors` | 5.075 GB | 99.2417% |
69
- | Ref2VA β†’ FL2VA | `minimax_h3_fl2va_from_ref2va_pruned_rank1024_bf16_lora.safetensors` | 10.048 GB | 99.4311% |
70
-
71
- The weighted percentage is dominated by high-energy tensors whose effective rank is naturally small. Many large attention and MLP deltas retain substantially less energy, so this statistic is **not** a quality score. Compare generations with identical prompts, inputs, seeds, and sampler settings.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
72
 
73
  Each `.safetensors.json` file contains the complete per-layer extraction report.
74
 
75
  ## ComfyUI use
76
 
77
  1. Put one `.safetensors` file in `ComfyUI/models/loras/`.
78
- 2. Load pruned FL2VA for a `ref2va_from_fl2va` file, or pruned Ref2VA for a `fl2va_from_ref2va` file.
79
  3. Apply the adapter with a model-only LoRA loader.
80
  4. Start at model strength `1.0`; compare `0.25`, `0.5`, `0.75`, and `1.0` using identical inputs.
81
  5. Do not stack ranks or opposing directions together. They are alternative forms of the same underlying delta.
 
35
 
36
  ## Required checkpoints and directions
37
 
38
+ The filenames state both the checkpoint to load and the direction of the
39
+ adapter. `apply_to_fl2va__toward_ref2va` means exactly: load the pruned FL2VA
40
+ checkpoint, then apply that LoRA to move its weights toward Ref2VA.
41
+
42
+ For files named `apply_to_fl2va__toward_ref2va`, use this base:
43
 
44
  ```text
45
  Comfy-Org/MiniMax-H3
 
52
  a32572fb90b5508b201ec7c2eddcc184b13ddfd3c6f6d2cf06a0b46535d541b4
53
  ```
54
 
55
+ For files named `apply_to_ref2va__toward_fl2va`, use this base:
56
 
57
  ```text
58
  diffusion_models/minimax_h3_ref2va_pruned_bf16.safetensors
 
63
 
64
  ## Files
65
 
66
+ | Apply to this base | Move toward | File | Size |
67
+ |---|---|---|---:|
68
+ | pruned FL2VA BF16 | Ref2VA | `minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors` | 2.589 GB |
69
+ | pruned FL2VA BF16 | Ref2VA | `minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors` | 5.075 GB |
70
+ | pruned FL2VA BF16 | Ref2VA | `minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors` | 10.048 GB |
71
+ | pruned Ref2VA BF16 | FL2VA | `minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors` | 2.589 GB |
72
+ | pruned Ref2VA BF16 | FL2VA | `minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors` | 5.075 GB |
73
+ | pruned Ref2VA BF16 | FL2VA | `minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors` | 10.048 GB |
74
+
75
+ ### What rank preserves
76
+
77
+ | Rank | Median capture across compressed matrices | Mean capture across compressed matrices | Global energy-weighted capture |
78
+ |---:|---:|---:|---:|
79
+ | 256 | 14.32% | 16.77% | 99.1260% |
80
+ | 512 | 26.40% | 29.70% | 99.2417% |
81
+ | 1024 | 46.11% | 49.62% | 99.4311% |
82
+
83
+ The global weighted percentage is **not the full story and is not a quality
84
+ score**. It is dominated by a small number of high-energy tensors with low
85
+ effective rank. Of the 264 matrix deltas, 54 low-rank matrices are reconstructed
86
+ essentially exactly at every requested rank. The table's median and mean are
87
+ calculated over the remaining 210 matrices that are genuinely compressed;
88
+ typical large attention and MLP matrices retain much less energy. Rank 1024 can
89
+ therefore be materially more faithful than rank 256 even though their global
90
+ weighted figures differ by only about 0.3 percentage points. Weight-space
91
+ energy also does not predict which directions matter most during inference;
92
+ compare actual generations with identical prompts, inputs, seeds, and sampler
93
+ settings.
94
 
95
  Each `.safetensors.json` file contains the complete per-layer extraction report.
96
 
97
  ## ComfyUI use
98
 
99
  1. Put one `.safetensors` file in `ComfyUI/models/loras/`.
100
+ 2. Follow the filename literally: load pruned FL2VA for an `apply_to_fl2va` file, or pruned Ref2VA for an `apply_to_ref2va` file.
101
  3. Apply the adapter with a model-only LoRA loader.
102
  4. Start at model strength `1.0`; compare `0.25`, `0.5`, `0.75`, and `1.0` using identical inputs.
103
  5. Do not stack ranks or opposing directions together. They are alternative forms of the same underlying delta.
SHA256SUMS CHANGED
@@ -1,6 +1,6 @@
1
- f8f15be3728fe52159b2dd840f6c8d7057f99b93690ba5bb129d827757cf13f4 minimax_h3_ref2va_from_fl2va_pruned_rank256_bf16_lora.safetensors
2
- f7e7fac7e5d29622705f92e1a1cd359db0c54c3364344fdecfc82d8d32b7d512 minimax_h3_ref2va_from_fl2va_pruned_rank512_bf16_lora.safetensors
3
- b97515fd5e654a3b37c4f499404f73340cb46e93bb626a575cd8626fd889fad0 minimax_h3_ref2va_from_fl2va_pruned_rank1024_bf16_lora.safetensors
4
- cd4001221599e88f1fa06b2e0cddbc69d61e14765f9b0a994369663f9fc86167 minimax_h3_fl2va_from_ref2va_pruned_rank256_bf16_lora.safetensors
5
- b7cad943cea4fee3d4614c092f78b370fd3d9cc876f7a5c6f6d254c1aed8b122 minimax_h3_fl2va_from_ref2va_pruned_rank512_bf16_lora.safetensors
6
- 8c90b63df76e1819870c8b6809b08eb2bf8cf80348e59e3117d69e322a481d68 minimax_h3_fl2va_from_ref2va_pruned_rank1024_bf16_lora.safetensors
 
1
+ f8f15be3728fe52159b2dd840f6c8d7057f99b93690ba5bb129d827757cf13f4 minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors
2
+ f7e7fac7e5d29622705f92e1a1cd359db0c54c3364344fdecfc82d8d32b7d512 minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors
3
+ b97515fd5e654a3b37c4f499404f73340cb46e93bb626a575cd8626fd889fad0 minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors
4
+ cd4001221599e88f1fa06b2e0cddbc69d61e14765f9b0a994369663f9fc86167 minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors
5
+ b7cad943cea4fee3d4614c092f78b370fd3d9cc876f7a5c6f6d254c1aed8b122 minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors
6
+ 8c90b63df76e1819870c8b6809b08eb2bf8cf80348e59e3117d69e322a481d68 minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors
minimax_h3_ref2va_from_fl2va_pruned_rank1024_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors RENAMED
File without changes
minimax_h3_ref2va_from_fl2va_pruned_rank1024_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank1024.safetensors.json RENAMED
File without changes
minimax_h3_ref2va_from_fl2va_pruned_rank256_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors RENAMED
File without changes
minimax_h3_ref2va_from_fl2va_pruned_rank256_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank256.safetensors.json RENAMED
File without changes
minimax_h3_ref2va_from_fl2va_pruned_rank512_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors RENAMED
File without changes
minimax_h3_ref2va_from_fl2va_pruned_rank512_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_fl2va__toward_ref2va__rank512.safetensors.json RENAMED
File without changes
minimax_h3_fl2va_from_ref2va_pruned_rank1024_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors RENAMED
File without changes
minimax_h3_fl2va_from_ref2va_pruned_rank1024_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank1024.safetensors.json RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:97009c54e939ff7576cf1c65ede03421eb6035c079d471899543847dc0d127c1
3
- size 216945
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ee2f123f3d1a9b25933658437723c8a2c935c6978acd2bcd28c13f46de5bcc5
3
+ size 216963
minimax_h3_fl2va_from_ref2va_pruned_rank256_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors RENAMED
File without changes
minimax_h3_fl2va_from_ref2va_pruned_rank256_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank256.safetensors.json RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f9cc0dccd043471612a5db6f333027e38666ae6b1d57ef07a9ca838c5f3ab6ed
3
- size 217055
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d342a9d440748acfe9a30a29f16cb3b30f564528984d91c28429683e138a6b5d
3
+ size 217073
minimax_h3_fl2va_from_ref2va_pruned_rank512_bf16_lora.safetensors β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors RENAMED
File without changes
minimax_h3_fl2va_from_ref2va_pruned_rank512_bf16_lora.safetensors.json β†’ minimax_h3_pruned_bf16__apply_to_ref2va__toward_fl2va__rank512.safetensors.json RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:05f96c313abfa9e301844dc3ead2b2b7b635c32775d775f366ba27dcf95630ea
3
- size 216928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fcaabc6099d36a7f71f5f87a1f4c754af477702a072b070cfb89be6a79ad4481
3
+ size 216946