FP16
fp 有损
IEEE 754 half precision; 5-bit exponent, 10-bit mantissa
权重位数
bits/weight
16
激活位数
bits/activation
16
支持硬件
of total
34/39
实测案例
1
支持硬件 (34)
国产 (13)
海外
AMD Instinct MI300A AMD Instinct MI300X AMD Instinct MI325X AMD Instinct MI355X Apple M4 Max Neural Engine AWS Inferentia 2 AWS Trainium 2 Cerebras WSE-3 Etched Sohu Google TPU v5p Groq LPU (TSP v1) Intel Gaudi 2 Intel Gaudi 3 NVIDIA A100 SXM4 80GB NVIDIA B200 SXM 180GB NVIDIA H100 SXM5 80GB NVIDIA H200 SXM 141GB NVIDIA L40S NVIDIA R200 SXM (Vera Rubin) SambaNova SN40L Tenstorrent Wormhole n300