Cosmos3-Super-ThunderWorldFP4 / quality_summary.csv
Concyclics's picture
Release frozen ThunderWorld FP4 1.5x and 2x weights, calibration provenance and loader (part 3)
ec27659 verified
Raw History Blame Contribute Delete
2.47 kB
model,benchmark,method,lpips,ssim_mean,psnr_db,relative_l2,aggregation,scenes,videos,scored_scenes,score_category_macro
super,paibench,arcquant,0.119513419546145,0.7618370486657658,22.901584535669425,0.1867023378966727,category_macro,1044,2088,1036,0.7679581037539044
super,paibench,arcquant100,0.1119044532252572,0.7766469769908838,23.34013324689473,0.1802093417695233,category_macro,1044,2088,1036,0.7687121321275752
super,paibench,awq_reference,0.1136638569040118,0.7757557641989602,23.23475537819664,0.1835746608900217,category_macro,1044,2088,1036,0.7613499295895867
super,paibench,b1.5_protected_n,0.1256823681147053,0.7487811385951887,22.578586576745334,0.1905642738391101,category_macro,1044,2088,1036,0.7646785971895793
super,paibench,b2_joint,0.1055293622597253,0.7878219883617531,23.70367827243793,0.1723440447689749,category_macro,1044,2088,1036,0.7616209370947928
super,paibench,fp4_base,0.1955988423988959,0.6479143330907332,19.691320518022927,0.2541019266761394,category_macro,1044,2088,1036,0.7520562389066959
super,paibench,fp8,0.0884785796393699,0.8191413151110191,24.985148309601243,0.1509277478274277,category_macro,1044,2088,1036,0.7679326029170505
super,paibench,sharq_perf,0.1172022173123496,0.7650827654283221,22.94733804588552,0.1856167138440917,category_macro,1044,2088,1036,0.7604906717425071
super,rbench,arcquant,0.1042674669969034,0.8021150396557318,21.04602229456402,0.1882120320014106,category_macro,650,1300,650,2.904905555555555
super,rbench,arcquant100,0.095927676049474,0.8177031355020072,21.54535949472773,0.179319258406241,category_macro,650,1300,650,2.936333333333333
super,rbench,awq_reference,0.0956396446893533,0.8186673860003552,21.47742902867692,0.1804860473740993,category_macro,650,1300,650,2.857977777777778
super,rbench,b1.5_protected_n,0.1046142834276198,0.7959324210054345,21.10808689393459,0.1853352166021141,category_macro,650,1300,650,2.8936222222222217
super,rbench,b2_joint,0.0883605409341246,0.8253813280165195,22.018558813406926,0.1692824962569715,category_macro,650,1300,650,2.869955555555556
super,rbench,fp4_base,0.1619553097581786,0.7062405236934622,18.660224739012463,0.237125486610853,category_macro,650,1300,650,2.7445055555555555
super,rbench,fp8,0.074843517238568,0.8491563602619701,23.103237567542102,0.1507762814226049,category_macro,650,1300,650,2.88275
super,rbench,sharq_perf,0.103633131019224,0.8005511442820231,21.087580321109105,0.1866347810387631,category_macro,650,1300,650,2.868961111111111