brishen/iron-sapiens2-pose-0.4b-npu2

Sapiens2-Pose 0.4B whole-body keypoints (308) on the AMD NPU

An IRON export of facebook/sapiens2-pose-0.4b for AMD Ryzen AI NPUs: the compiled NPU kernels (.xclbin + instruction streams) and the packed weights the taconite-sapiens2 Rust runtime replays, over XRT or directly over the amdxdna driver.

The kernels are compiled for NPU2 (AIE2P: Strix Point, Strix Halo, Krackan) and will not load on NPU1 (Phoenix, Hawk Point).

Download

hf download brishen/iron-sapiens2-pose-0.4b-npu2 --local-dir sapiens2-pose
# or, from an IRON checkout:
python scripts/hf_models.py download sapiens2-pose --repo brishen/iron-sapiens2-pose-0.4b-npu2 --out sapiens2-pose

Top-down: give each person's box (COCO x,y,w,h, from a person detector); the keypoints come back in image coordinates with their heatmap scores (Sociopticon's 308: body + feet, hands, face). sapiens2 check on a Ryzen AI 9 HX 370, against the float32 HF model: heatmaps cosine 0.9993-0.9996, mean keypoint error 0.12-1.03 px over 5 COCO val2017 boxes; ~4.3 s a box.

The weights are Meta's, under the Sapiens2 License (LICENSE.md here): it permits redistribution with the license attached and forbids, among others, surveillance and biometric processing.

Usage

cargo install taconite-sapiens2             # over XRT
# or, with no XRT at all (straight to the amdxdna driver):
cargo install taconite-sapiens2 --no-default-features --features cli,direct
sapiens2 pose sapiens2-pose person.jpg --box 150,130,275,480 -o overlay.png --json kp.json
sapiens2 check sapiens2-pose                    # the reference cases against the float32 model

See taconite-sapiens2 (docs, source) for the full API. The bundle is exported by IRON's iron/applications/sapiens2_pose.

Provenance

• Upstream model: facebook/sapiens2-pose-0.4b (license: other; its terms apply to these weights)
• IRON commit: 08a5e90
• Uploaded: 2026-10-06
• Files: 23, 732.9 MB