Hardware
Models
Learn
Each size lists the models that fit that much graphics memory, largest first. Memory totals are estimates.
FREE VRAM CHEAT SHEET + ALERTS
The Q4_K_M / Q5 / Q8 VRAM and tok/s table across 29 GPUs, plus an email when a new open model fits a size from 8 GB to 128 GB.