← 量化方案

FP4

fp4 有损

Microscaling FP4; introduced on Blackwell B200/B300 and AMD MI355X for inference

权重位数
bits/weight
4
激活位数
bits/activation
8
支持硬件
of total
8/39
实测案例
1

支持硬件 (8)

国产 (1)

昇腾 950

海外

AMD Instinct MI355X Etched Sohu NVIDIA B200 SXM 180GB NVIDIA B300 SXM 288GB NVIDIA GB200 NVL72 NVIDIA GB300 NVL72 NVIDIA R200 SXM (Vera Rubin)

使用此量化的案例 (1)