Stable Diffusion ยท UNet

SDXL Turbo

SDXL Turbo is a pipeline of 4 networks totalling 3.469 billion parameters, of which 2.567 billion do the actual generating. At 512x512 that is 4,096 latent tokens per denoising step.

Whole pipeline3.469B
Denoiser2.567B
Download12.9 GB
Default steps1

What the pipeline is made of

This is the part that separates a media model from a language model: these are separate networks, and whether they sit in memory together is your choice, not the model's.

ComponentParametersPublished asOn diskWhat it does
unet 2.567B F32 9.56 GB Does the generating. Runs once per step, so it dominates both memory and time.
text_encoder 0.123B F32 0.46 GB Turns your prompt into conditioning. Runs once, then can leave the GPU entirely.
text_encoder_2 0.695B F32 2.59 GB Turns your prompt into conditioning. Runs once, then can leave the GPU entirely.
vae 0.084B F32 0.31 GB Converts between pixels and the compressed latent space. Small, but its decode pass is a memory spike.

These figures were measured from the weight file headers.

Memory by precision

Everything resident, at the model's native output size, on a card large enough that precision is the only constraint.

PrecisionPeak VRAMQualityWhat it costs you
BF16 7.99 GB 100% How the weights are published. No loss, and the largest footprint.
FP8 4.84 GB 97% Halves the denoiser with a small, usually invisible cost. Needs Ada or newer.
GGUF Q8_0 5.04 GB 98% Works on any card, unlike FP8. Slightly slower than native precision.
GGUF Q5_K_M 3.93 GB 95% A middle step when Q8 will not fit.
GGUF Q4_K_M 3.59 GB 91% The usual way a 12B image model gets onto an 8 GB card. Detail softens.
NF4 3.42 GB 89% Aggressive 4-bit. Fast to load, noticeably looser on fine detail.

Memory by arrangement

The other lever: the same weights at the same precision, moved around differently. On this model quantising is the stronger lever: the denoiser is 74% of the pipeline and stays resident whatever you rearrange.

ArrangementPeak VRAMTimeHow it works
Everything resident 7.99 GB 100 ms All components stay on the GPU. Fastest, and needs the most memory.
Text encoder on CPU 5.99 GB 100 ms The prompt is encoded once on the processor, so the encoder never touches the GPU at all. Standard practice on video models, whose encoders are often larger than their denoisers.
Component offload 5.84 GB 100 ms One component on the GPU at a time. The text encoder runs, then makes way for the denoiser. Costs a few seconds per generation.
Sequential offload 1.79 GB 300 ms Weights stream layer by layer from system RAM. Runs almost anything on almost anything, and is many times slower.

What a bigger output costs

Memory climbs with the pixel count, and the VAE decode pass climbs with it.

OutputLatent tokensPeak VRAMTime
512 x 512 4,096 7.99 GB 100 ms
768 x 768 9,216 8.78 GB 200 ms
1024 x 1024 16,384 9.88 GB 400 ms
1536 x 1536 36,864 13.02 GB 900 ms
2048 x 2048 65,536 17.43 GB 1.5 s

Measured at BF16 with everything resident on an RTX 4090, so the columns compare with each other rather than with your machine.

Which hardware runs SDXL Turbo

118 of 118 consumer devices run it in some arrangement. Each row shows the fastest arrangement that fits on that device.

DeviceMemoryVerdictArrangementPeakTime
GeForce RTX 5090
NVIDIA
32 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 5080
NVIDIA
16 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 5070 Ti
NVIDIA
16 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 5070
NVIDIA
12 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 4090
NVIDIA
24 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 4080 SUPER
NVIDIA
16 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 4080
NVIDIA
16 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 4070 Ti SUPER
NVIDIA
16 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 4070 Ti
NVIDIA
12 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 4070 SUPER
NVIDIA
12 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 3090 Ti
NVIDIA
24 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 3090
NVIDIA
24 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 3080 Ti
NVIDIA
12 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 4090 Laptop
NVIDIA
16 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 4080 Laptop
NVIDIA
12 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 5090 Laptop
NVIDIA
24 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 5080 Laptop
NVIDIA
16 GB Comfortable BF16
everything resident
7.99 GB 100 ms
RTX PRO 6000 Blackwell
NVIDIA
96 GB Comfortable BF16
everything resident
7.99 GB 100 ms
RTX 6000 Ada Generation
NVIDIA
48 GB Comfortable BF16
everything resident
7.99 GB 100 ms
RTX A6000
NVIDIA
48 GB Comfortable BF16
everything resident
7.99 GB 100 ms
NVIDIA DGX Spark 128GB
NVIDIA
128 GB Comfortable BF16
everything resident
7.99 GB 100 ms
GeForce RTX 5060 Ti 16GB
NVIDIA
16 GB Comfortable BF16
everything resident
7.99 GB 200 ms
GeForce RTX 5060 Ti 8GB
NVIDIA
8 GB Comfortable GGUF Q8_0
everything resident
5.04 GB 200 ms
GeForce RTX 5060
NVIDIA
8 GB Comfortable GGUF Q8_0
everything resident
5.04 GB 200 ms
GeForce RTX 4070
NVIDIA
12 GB Comfortable BF16
everything resident
7.99 GB 200 ms
GeForce RTX 4060 Ti 16GB
NVIDIA
16 GB Comfortable BF16
everything resident
7.99 GB 200 ms
GeForce RTX 4060 Ti 8GB
NVIDIA
8 GB Comfortable GGUF Q8_0
everything resident
5.04 GB 200 ms
GeForce RTX 4060
NVIDIA
8 GB Comfortable GGUF Q8_0
everything resident
5.04 GB 200 ms
GeForce RTX 3080 12GB
NVIDIA
12 GB Comfortable BF16
everything resident
7.99 GB 200 ms
GeForce RTX 3080 10GB
NVIDIA
10 GB Comfortable BF16
everything resident
7.99 GB 200 ms
GeForce RTX 3070 Ti
NVIDIA
8 GB Comfortable GGUF Q8_0
everything resident
5.04 GB 200 ms
GeForce RTX 3070
NVIDIA
8 GB Comfortable GGUF Q8_0
everything resident
5.04 GB 200 ms
GeForce RTX 3060 Ti
NVIDIA
8 GB Comfortable GGUF Q8_0
everything resident
5.04 GB 200 ms
GeForce RTX 2080 Ti
NVIDIA
11 GB Comfortable BF16
everything resident
7.99 GB 200 ms
GeForce RTX 4070 Laptop
NVIDIA
8 GB Comfortable GGUF Q8_0
everything resident
5.04 GB 200 ms
GeForce RTX 4060 Laptop
NVIDIA
8 GB Comfortable GGUF Q8_0
everything resident
5.04 GB 200 ms
RTX A5000
NVIDIA
24 GB Comfortable BF16
everything resident
7.99 GB 200 ms
RTX A4000
NVIDIA
16 GB Comfortable BF16
everything resident
7.99 GB 200 ms
Radeon RX 9070 XT
AMD
16 GB Comfortable BF16
everything resident
7.99 GB 200 ms
Radeon RX 7900 XTX
AMD
24 GB Comfortable BF16
everything resident
7.99 GB 200 ms
Radeon RX 7900 XT
AMD
20 GB Comfortable BF16
everything resident
7.99 GB 200 ms
Radeon RX 7900 GRE
AMD
16 GB Comfortable BF16
everything resident
7.99 GB 200 ms
Radeon PRO W7900
AMD
48 GB Comfortable BF16
everything resident
7.99 GB 200 ms
Jetson AGX Orin 32GB
NVIDIA
32 GB Comfortable BF16
everything resident
7.99 GB 200 ms
Jetson AGX Orin 64GB
NVIDIA
64 GB Comfortable BF16
everything resident
7.99 GB 200 ms

Source: stabilityai/sdxl-turbo . Downloaded 0.9 million times in the last month. See how we calculate, or browse every image model.