GLM-5.3-W4AFP8-8L

For testing serving infrastructure only. Its output is not useful text.

PhalaCloud/GLM-5.3-W4AFP8 (revision 03179e95916f9f79a92536e76da63f9251d93d4f) cut to its first 8 of 78 decoder layers and the MTP layer 78 (renumbered 8). Every kept tensor is copied byte for byte, so the quantization, the attention and DSA indexer shapes, the KV cache layout, the MoE routing and the speculative-decoding layer are those of the full model; only the depth differs. 36.3 GB.

Built by cut.py with:

cut.py --source PhalaCloud/GLM-5.3-W4AFP8 --revision 03179e95916f9f79a92536e76da63f9251d93d4f --layers 8 --repo nvcnvn/GLM-5.3-W4AFP8-8L --license-from zai-org/GLM-5.3 --out /home/runner/work/_temp/out

The original license is in LICENSE.