DeepSeek · Over 80B · Mixture of experts

DeepSeek V4 Flash DSpark

165.27 billion parameters in total, but only 20.36 billion are read for each token. That split is the whole point of the design: it costs the memory of a large model and the speed of a small one. Grouped-query attention keeps the cache small, so long contexts cost less here than on models of the same size.

Parameters165.27B
Active per token20.36B
Layers43
KV heads1 / 64
Native context1M
Vocabulary129k

Memory needed, by quantisation

At an 8k context window. Quality is our rough ranking of how much the compression costs you: anything at or above Q5 is hard to tell apart from the original in normal use.

Quantisation File size KV cache Total VRAM Quality What it costs you
Q8_0 163.54 GB 0.01 GB 164.4 GB 99% Lossless in practice. Use it when the memory is there.
Q6_K 126.21 GB 0.01 GB 127.08 GB 98% Very close to Q8 for two thirds of the size.
Q5_K_M 109.48 GB 0.01 GB 110.34 GB 96% The quality-first choice when Q6 will not fit.
Q4_K_M 92.93 GB 0.01 GB 93.79 GB 93% The default. Best size-to-quality ratio for local use.
IQ4_XS 81.77 GB 0.01 GB 82.63 GB 91% Importance-matrix 4-bit. Q4_K_S quality, smaller file.
Q3_K_M 75.23 GB 0.01 GB 76.09 GB 86% Degradation starts to show. A way to fit one size up.
IQ3_XXS 58.87 GB 0.01 GB 59.74 GB 79% Aggressive. Only worth it on very large models.

What a longer conversation costs

Same model at Q4_K_M, only the context window changes. This model uses sliding-window attention, so most layers stop growing past 128 tokens and the bill flattens out.

ContextKV cacheTotal VRAMFits in 8 GBFits in 12 GBFits in 24 GB
4k 0.01 GB 93.67 GB no no no
8k 0.01 GB 93.79 GB no no no
16k 0.01 GB 94.04 GB no no no
32k 0.01 GB 94.54 GB no no no
64k 0.01 GB 95.54 GB no no no
128k 0.01 GB 97.54 GB no no no

The "fits" columns allow for the roughly 0.8 GB Windows keeps for the desktop.

Which hardware runs DeepSeek V4 Flash DSpark

10 of 118 consumer devices run it at a quantisation worth using, at an 8k context window. Another 16 can load it only by compressing the weights far enough to damage the model, marked with a warning below.

DeviceMemoryVerdictQuantisationUsedSpeed
Apple M3 Ultra 256GB
Apple
256 GB Runs great Q8_0 164.1 GB 31.7 t/s
Apple M3 Ultra 512GB
Apple
512 GB Runs great Q8_0 164.1 GB 31.7 t/s
Apple M2 Ultra 192GB
Apple
192 GB Runs great Q6_K 126.78 GB 40.1 t/s
RTX PRO 6000 Blackwell
NVIDIA
96 GB Runs great Q4_K_M 93.79 GB 128.2 t/s
Apple M1 Ultra 128GB
Apple
128 GB Runs great Q4_K_M 93.49 GB 54.5 t/s
Apple M2 Ultra 128GB
Apple
128 GB Runs great Q4_K_M 93.49 GB 54.5 t/s
Apple M4 Max 128GB
Apple
128 GB Runs great Q4_K_M 93.49 GB 37.2 t/s
Apple M3 Max 128GB
Apple
128 GB Runs great Q4_K_M 93.49 GB 27.2 t/s
NVIDIA DGX Spark 128GB
NVIDIA
128 GB Runs well Q4_K_M 93.79 GB 19.5 t/s
Ryzen AI Max+ 395 128GB
AMD
128 GB Runs well Q4_K_M 93.79 GB 14.5 t/s
Apple M3 Ultra 96GB
Apple
96 GB Runs great IQ3_XXS ! 59.44 GB 88 t/s
Apple M2 Max 96GB
Apple
96 GB Runs great IQ3_XXS ! 59.44 GB 43 t/s
Apple M3 Max 96GB
Apple
96 GB Runs great IQ3_XXS ! 59.44 GB 43 t/s
Ryzen AI Max+ 395 96GB
AMD
96 GB Runs well IQ3_XXS ! 59.74 GB 22.9 t/s
RTX 6000 Ada Generation
NVIDIA
48 GB Runs great IQ2_XXS ! 40.5 GB 160.9 t/s
RTX A6000
NVIDIA
48 GB Runs great IQ2_XXS ! 40.5 GB 128.7 t/s
Apple M1 Ultra 64GB
Apple
64 GB Runs great IQ2_XXS ! 40.2 GB 127.5 t/s
Apple M2 Ultra 64GB
Apple
64 GB Runs great IQ2_XXS ! 40.2 GB 127.5 t/s
Radeon PRO W7900
AMD
48 GB Runs great IQ2_XXS ! 40.5 GB 127.1 t/s
Apple M4 Max 64GB
Apple
64 GB Runs great IQ2_XXS ! 40.2 GB 87 t/s
Apple M1 Max 64GB
Apple
64 GB Runs great IQ2_XXS ! 40.2 GB 63.8 t/s
Apple M2 Max 64GB
Apple
64 GB Runs great IQ2_XXS ! 40.2 GB 63.8 t/s
Apple M3 Max 64GB
Apple
64 GB Runs great IQ2_XXS ! 40.2 GB 63.8 t/s
Apple M4 Pro 64GB
Apple
64 GB Runs great IQ2_XXS ! 40.2 GB 43.5 t/s
Jetson AGX Orin 64GB
NVIDIA
64 GB Runs great IQ2_XXS ! 40.5 GB 34.3 t/s
Ryzen AI Max+ 395 64GB
AMD
64 GB Runs great IQ2_XXS ! 40.5 GB 34 t/s
GeForce RTX 5090
NVIDIA
32 GB Partial offload 14/43 93.79 GB 4 t/s
GeForce RTX 4090
NVIDIA
24 GB Partial offload 10/43 93.79 GB 3.6 t/s
GeForce RTX 3090 Ti
NVIDIA
24 GB Partial offload 10/43 93.79 GB 3.6 t/s
GeForce RTX 3090
NVIDIA
24 GB Partial offload 10/43 93.79 GB 3.6 t/s
GeForce RTX 5090 Laptop
NVIDIA
24 GB Partial offload 10/43 93.79 GB 3.5 t/s
RTX A5000
NVIDIA
24 GB Partial offload 10/43 93.79 GB 3.5 t/s
Radeon RX 7900 XTX
AMD
24 GB Partial offload 10/43 93.79 GB 3.5 t/s
Radeon RX 7900 XT
AMD
20 GB Partial offload 8/43 93.79 GB 3.3 t/s
GeForce RTX 5080
NVIDIA
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
GeForce RTX 5070 Ti
NVIDIA
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
GeForce RTX 5060 Ti 16GB
NVIDIA
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
GeForce RTX 4080 SUPER
NVIDIA
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
GeForce RTX 4080
NVIDIA
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
GeForce RTX 4070 Ti SUPER
NVIDIA
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
GeForce RTX 4090 Laptop
NVIDIA
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
GeForce RTX 5080 Laptop
NVIDIA
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
RTX A4000
NVIDIA
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
Radeon RX 9070 XT
AMD
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
Radeon RX 9070
AMD
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
Radeon RX 7900 GRE
AMD
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
Radeon RX 7800 XT
AMD
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
Radeon RX 6900 XT
AMD
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
Radeon RX 6800
AMD
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
Arc A770 16GB
Intel
16 GB Partial offload 6/43 93.79 GB 3.2 t/s
GeForce RTX 4060 Ti 16GB
NVIDIA
16 GB Partial offload 6/43 93.79 GB 3.1 t/s
Radeon RX 7600 XT
AMD
16 GB Partial offload 6/43 93.79 GB 3.1 t/s
GeForce RTX 5070
NVIDIA
12 GB Partial offload 4/43 93.79 GB 3 t/s
GeForce RTX 4070 Ti
NVIDIA
12 GB Partial offload 4/43 93.79 GB 3 t/s
GeForce RTX 4070 SUPER
NVIDIA
12 GB Partial offload 4/43 93.79 GB 3 t/s
GeForce RTX 4070
NVIDIA
12 GB Partial offload 4/43 93.79 GB 3 t/s
GeForce RTX 3080 Ti
NVIDIA
12 GB Partial offload 4/43 93.79 GB 3 t/s
GeForce RTX 3080 12GB
NVIDIA
12 GB Partial offload 4/43 93.79 GB 3 t/s
GeForce RTX 3080 10GB
NVIDIA
10 GB Partial offload 3/43 93.79 GB 3 t/s
GeForce RTX 3060 12GB
NVIDIA
12 GB Partial offload 4/43 93.79 GB 3 t/s

What to buy to run DeepSeek V4 Flash DSpark

The cheapest hardware that runs it at a quantisation worth using and a speed you would not resent, at an 8k context window.

DevicePriceMemoryRuns it atSpeed
Ryzen AI Max+ 395 128GB
AMD · whole machine
$2,199 128 GB IQ4_XS 16.5 t/s Check price
Apple M1 Ultra 128GB
Apple · whole machine
$3,400 128 GB Q4_K_M 54.5 t/s Check price
Apple M3 Ultra 256GB
Apple · whole machine
$5,599 256 GB Q8_0 31.7 t/s Check price
RTX PRO 6000 Blackwell
NVIDIA
$8,500 96 GB Q4_K_M 128.2 t/s Check price
Apple M3 Ultra 512GB
Apple · whole machine
$9,499 512 GB Q8_0 31.7 t/s Check price

Indicative prices reviewed 2026-09-01; used prices are marketplace typical. Options that cost more than a cheaper one with no more memory and no more speed are hidden. Price links are Amazon affiliate links. Change the standard, the context window or the budget in the buying tool.

Where it sits in the catalogue

Source: deepseek-ai/DeepSeek-V4-Flash-DSpark on Hugging Face. Downloaded 441k times in the last month. Published 2026-06-27. Architecture figures are read from the repository's own configuration file, so they move when the model does.