How much VRAM does FLUX.1 dev need?

At BF16 with everything resident, FLUX.1 dev peaks at about 34.84 GB. Offloading components one at a time brings that to 23.6 GB, and quantising the weights to 4-bit brings it to 12.17 GB.

What is the cheapest GPU that runs FLUX.1 dev?

The GeForce GTX 1650 at around $100, running it at FP8 with sequential offload, taking about 3 h 10 min per generation.

FLUX · Diffusion transformer

FLUX.1 dev

FLUX.1 dev is a pipeline of 4 networks totalling 16.87 billion parameters, of which 11.901 billion do the actual generating. At 1024x1024 that is 4,096 latent tokens per denoising step.

The quality benchmark for open image models, and heavy: the transformer alone is 12 billion parameters and the T5 text encoder adds nearly five more.

Whole pipeline16.87B

Denoiser11.901B

Download31.4 GB

Default steps28

What the pipeline is made of

This is the part that separates a media model from a language model: these are separate networks, and whether they sit in memory together is your choice, not the model's.

Component	Parameters	Published as	On disk	What it does
transformer	11.901B	BF16	22.17 GB	Does the generating. Runs once per step, so it dominates both memory and time.
text_encoder	0.123B	BF16	0.23 GB	Turns your prompt into conditioning. Runs once, then can leave the GPU entirely.
text_encoder_2	4.762B	BF16	8.87 GB	Turns your prompt into conditioning. Runs once, then can leave the GPU entirely.
vae	0.084B	BF16	0.16 GB	Converts between pixels and the compressed latent space. Small, but its decode pass is a memory spike.

These figures were derived from the published file sizes, because the repository is gated.

Memory by precision

Everything resident, at the model's native output size, on a card large enough that precision is the only constraint.

Precision	Peak VRAM	Quality	What it costs you
BF16	34.84 GB	100%	How the weights are published. No loss, and the largest footprint.
FP8	19.21 GB	97%	Halves the denoiser with a small, usually invisible cost. Needs Ada or newer.
GGUF Q8_0	20.18 GB	98%	Works on any card, unlike FP8. Slightly slower than native precision.
GGUF Q5_K_M	14.69 GB	95%	A middle step when Q8 will not fit.
GGUF Q4_K_M	13.02 GB	91%	The usual way a 12B image model gets onto an 8 GB card. Detail softens.
NF4	12.17 GB	89%	Aggressive 4-bit. Fast to load, noticeably looser on fine detail.

Memory by arrangement

The other lever: the same weights at the same precision, moved around differently. On this model quantising is the stronger lever: the denoiser is 71% of the pipeline and stays resident whatever you rearrange.

Arrangement	Peak VRAM	Time	How it works
Everything resident	34.84 GB	34 s	All components stay on the GPU. Fastest, and needs the most memory.
Text encoder on CPU	23.6 GB	36 s	The prompt is encoded once on the processor, so the encoder never touches the GPU at all. Standard practice on video models, whose encoders are often larger than their denoisers.
Component offload	23.44 GB	39 s	One component on the GPU at a time. The text encoder runs, then makes way for the denoiser. Costs a few seconds per generation.
Sequential offload	5 GB	3 min 25 s	Weights stream layer by layer from system RAM. Runs almost anything on almost anything, and is many times slower.

What a bigger output costs

Memory climbs with the pixel count, and the VAE decode pass climbs with it.

Output	Latent tokens	Peak VRAM	Time
512 x 512	1,024	32.95 GB	6.6 s
768 x 768	2,304	33.74 GB	17 s
1024 x 1024	4,096	34.84 GB	34 s
1536 x 1536	9,216	37.99 GB	1 min 47 s
2048 x 2048	16,384	42.39 GB	4 min 24 s

Measured at BF16 with everything resident on an RTX 4090, so the columns compare with each other rather than with your machine.

Which hardware runs FLUX.1 dev

118 of 118 consumer devices run it in some arrangement. Each row shows the fastest arrangement that fits on that device.

Device	Memory	Verdict	Arrangement	Peak	Time
RTX PRO 6000 Blackwell NVIDIA	96 GB	Slow	BF16 everything resident	34.84 GB	23 s
GeForce RTX 5090 NVIDIA	32 GB	Slow	GGUF Q8_0 everything resident	20.18 GB	27 s
RTX 6000 Ada Generation NVIDIA	48 GB	Slow	BF16 everything resident	34.84 GB	31 s
GeForce RTX 4090 NVIDIA	24 GB	Slow	GGUF Q8_0 everything resident	20.18 GB	34 s
GeForce RTX 5090 Laptop NVIDIA	24 GB	Slow	GGUF Q8_0 everything resident	20.18 GB	44 s
NVIDIA DGX Spark 128GB NVIDIA	128 GB	Slow	BF16 everything resident	34.84 GB	45 s
GeForce RTX 5080 NVIDIA	16 GB	Slow	GGUF Q5_K_M everything resident	14.69 GB	50 s
GeForce RTX 4080 SUPER NVIDIA	16 GB	Slow	GGUF Q5_K_M everything resident	14.69 GB	54 s
GeForce RTX 4090 Laptop NVIDIA	16 GB	Slow	GGUF Q5_K_M everything resident	14.69 GB	57 s
GeForce RTX 4080 NVIDIA	16 GB	Slow	GGUF Q5_K_M everything resident	14.69 GB	58 s
GeForce RTX 5080 Laptop NVIDIA	16 GB	Slow	GGUF Q5_K_M everything resident	14.69 GB	60 s
GeForce RTX 5070 Ti NVIDIA	16 GB	Slow	GGUF Q5_K_M everything resident	14.69 GB	1 min 4 s
GeForce RTX 4070 Ti SUPER NVIDIA	16 GB	Slow	GGUF Q5_K_M everything resident	14.69 GB	1 min 4 s
GeForce RTX 3090 Ti NVIDIA	24 GB	Slow	GGUF Q8_0 everything resident	20.18 GB	1 min 11 s
RTX A6000 NVIDIA	48 GB	Slow	BF16 everything resident	34.84 GB	1 min 13 s
GeForce RTX 4070 Ti NVIDIA	12 GB	Slow	GGUF Q5_K_M text encoder on cpu	9.31 GB	1 min 14 s
GeForce RTX 3090 NVIDIA	24 GB	Slow	GGUF Q8_0 everything resident	20.18 GB	1 min 20 s
GeForce RTX 4080 Laptop NVIDIA	12 GB	Slow	GGUF Q5_K_M text encoder on cpu	9.31 GB	1 min 20 s
GeForce RTX 4070 SUPER NVIDIA	12 GB	Slow	GGUF Q5_K_M text encoder on cpu	9.31 GB	1 min 24 s
GeForce RTX 3080 Ti NVIDIA	12 GB	Slow	GGUF Q5_K_M text encoder on cpu	9.31 GB	1 min 27 s
GeForce RTX 5070 NVIDIA	12 GB	Barely usable	GGUF Q5_K_M text encoder on cpu	9.31 GB	1 min 36 s
GeForce RTX 3080 12GB NVIDIA	12 GB	Barely usable	GGUF Q5_K_M text encoder on cpu	9.31 GB	1 min 40 s
GeForce RTX 3080 10GB NVIDIA	10 GB	Barely usable	GGUF Q4_K_M text encoder on cpu	8.13 GB	1 min 40 s
RTX A5000 NVIDIA	24 GB	Barely usable	GGUF Q8_0 everything resident	20.18 GB	1 min 42 s
GeForce RTX 4070 NVIDIA	12 GB	Barely usable	GGUF Q5_K_M text encoder on cpu	9.31 GB	1 min 42 s
GeForce RTX 2080 Ti NVIDIA	11 GB	Barely usable	GGUF Q5_K_M text encoder on cpu	9.31 GB	1 min 50 s
GeForce RTX 5060 Ti 16GB NVIDIA	16 GB	Barely usable	GGUF Q5_K_M everything resident	14.69 GB	1 min 58 s
GeForce RTX 4060 Ti 16GB NVIDIA	16 GB	Barely usable	GGUF Q5_K_M everything resident	14.69 GB	2 min 8 s
Jetson AGX Orin 32GB NVIDIA	32 GB	Barely usable	GGUF Q8_0 everything resident	20.18 GB	2 min 13 s
Jetson AGX Orin 64GB NVIDIA	64 GB	Barely usable	BF16 everything resident	34.84 GB	2 min 13 s
Radeon RX 7900 XTX AMD	24 GB	Barely usable	GGUF Q8_0 everything resident	20.18 GB	2 min 14 s
Radeon PRO W7900 AMD	48 GB	Barely usable	BF16 everything resident	34.84 GB	2 min 15 s
RTX A4000 NVIDIA	16 GB	Barely usable	GGUF Q5_K_M everything resident	14.69 GB	2 min 27 s
Radeon RX 7900 XT AMD	20 GB	Barely usable	GGUF Q5_K_M everything resident	14.69 GB	2 min 40 s
Radeon RX 9070 XT AMD	16 GB	Barely usable	GGUF Q5_K_M everything resident	14.69 GB	2 min 50 s
Radeon RX 7900 GRE AMD	16 GB	Barely usable	GGUF Q5_K_M everything resident	14.69 GB	2 min 59 s
Radeon RX 9070 AMD	16 GB	Barely usable	GGUF Q5_K_M everything resident	14.69 GB	3 min 31 s
Radeon RX 7800 XT AMD	16 GB	Barely usable	GGUF Q5_K_M everything resident	14.69 GB	3 min 39 s
GeForce RTX 2060 12GB NVIDIA	12 GB	Barely usable	GGUF Q5_K_M text encoder on cpu	9.31 GB	3 min 48 s
GeForce RTX 3060 12GB NVIDIA	12 GB	Barely usable	GGUF Q5_K_M text encoder on cpu	9.31 GB	3 min 52 s
Radeon RX 7700 XT AMD	12 GB	Barely usable	GGUF Q5_K_M text encoder on cpu	9.31 GB	4 min 7 s
Radeon RX 6900 XT AMD	16 GB	Barely usable	GGUF Q5_K_M everything resident	14.69 GB	5 min 57 s
Radeon RX 7600 XT AMD	16 GB	Barely usable	GGUF Q5_K_M everything resident	14.69 GB	6 min 5 s
Ryzen AI Max+ 395 32GB AMD	32 GB	Barely usable	GGUF Q8_0 everything resident	20.18 GB	6 min 58 s
Ryzen AI Max+ 395 64GB AMD	64 GB	Barely usable	BF16 everything resident	34.84 GB	6 min 58 s

Source: black-forest-labs/FLUX.1-dev . Downloaded 0.7 million times in the last month. See how we calculate, or browse every image model.