DeepSeek V4 Flash
deepseek MOE text deepseek-license 2026-04-24
Architecture
Total params
284 B
Active params
13 B
Layers
32
Context
1024 k
Detailed specs
Hidden size
4096
FFN size
14336
Attention heads
32
KV heads
8
Head dim
128
Vocab size
132000
Attention type
csa+hca
MoE experts
64
MoE top-k
4
Expert hidden
1408
Operator decomposition (per token)
Compatible hardware
— unknown AMD Instinct MI300A — unknown AMD Instinct MI300X — unknown AMD Instinct MI325X — unknown AMD Instinct MI355X — unknown Apple M4 Max Neural Engine — unknown AWS Inferentia 2 — unknown AWS Trainium 2 — unknown 壁仞 BR100 — unknown 壁仞 BR104 — unknown 寒武纪 MLU370-X8 — unknown 寒武纪 思元 590 — unknown Cerebras WSE-3 — unknown 燧原 云燧 T21 — unknown Etched Sohu — unknown Google TPU v5p — unknown Google TPU Trillium (v6e) — unknown Groq LPU (TSP v1) — unknown 昇腾 910B — unknown 昇腾 910C — unknown 昇腾 950 — unknown 海光 DCU K100 — unknown 海光 DCU Z100 — unknown 天数智芯 天垓 100 — unknown Intel Gaudi 2 — unknown Intel Gaudi 3 — unknown 沐曦 曦云 C500 🟢 measured 摩尔线程 MTT S4000 — unknown NVIDIA A100 SXM4 80GB — unknown NVIDIA B200 SXM 180GB — unknown NVIDIA B300 SXM 288GB — unknown NVIDIA GB200 NVL72 — unknown NVIDIA GB300 NVL72 🟢 measured NVIDIA H100 SXM5 80GB 🟢 measured NVIDIA H200 SXM 141GB — unknown NVIDIA L40S — unknown NVIDIA R200 SXM (Vera Rubin) — unknown 平头哥 含光 800 — unknown SambaNova SN40L — unknown Tenstorrent Wormhole n300