# What AI Models Can My GPU Run?

- Canonical: https://cloudzat.com/what-ai-models-can-my-gpu-run/
- Published: 2026-08-03
- Updated: 2026-08-03
- Author: Kayla Idayi
- Site: https://cloudzat.com/
- LLM index: https://cloudzat.com/llms.txt

## Content

[Home](https://cloudzat.com/)/[GPU & Local AI](https://cloudzat.com/gpu-price-tracker-for-local-ai/)/What AI Models Can My GPU Run?

Cloudzat GPU & Local AI Hardware Intelligence

# What AI Models Can My GPU Run?

Owning a GPU does not guarantee that every model using the same parameter count will fit. Select the exact GPU, model size, quantization and context target to see a practical fit classification.

## Check whether your GPU can run the model

Memory fit and software support are evaluated separately.

## Comfortable means headroom remains

A comfortable result leaves room for context growth, runtime workspace and modest desktop activity. It is not a guaranteed performance benchmark.

## Usable with limits may need compromises

The model may fit at the selected settings but leave little margin. Reducing context, batch size or background GPU use can improve reliability.

## CPU offload can rescue a larger model

Partial offload may allow inference when the full model does not fit in VRAM. Expect lower speed and higher system RAM use.

## Software support is separate from memory fit

A card can have enough VRAM but lack mature support in the chosen application. Check CUDA, ROCm, oneAPI or DirectML compatibility before buying.

## Current GPU catalogue

Current Amazon offers identified by exact GPU model. Use the calculator above for workload-specific ranking.

| GPU offer | VRAM | Stack | Power | Condition | Price | Price/GB | |
| --- | --- | --- | --- | --- | --- | --- | --- |
| Intel Arc A770 16GBGUNNIR Intel Arc A770 Photon 8GB OC GDDR6 2400MHz Triple Fan Graphics Card | 16GBGDDR6 | oneAPI / DirectML | 225W600W PSU | New | Price Options | — | Buy on Amazon |
| Intel Arc B580WEELIAO GUNNIR Intel Arc B580 Index 12GB GDDR6 2670MHz Dual Fan Graphics Card (192-bit, PCI-Express 4.0 x8, HDMI/DisplayPort, Supports 4k) | 12GBGDDR6 | oneAPI / DirectML | 190W600W PSU | New | Price Options | — | Buy on Amazon |
| Intel Arc B580TFGAJKKKKK Intel Arc B Series Intel Arc B580 Limited Edition Graphics Video Card | 12GBGDDR6 | oneAPI / DirectML | 190W600W PSU | New | Price Options | — | Buy on Amazon |
| Intel Arc B580ASRock Intel Arc B580 Challenger 12GB OC & Challenger CL-650G 650W Gold PSU \| Modern Gaming & Streaming Bundle | 12GBGDDR6 | oneAPI / DirectML | 190W600W PSU | New | Price Options | — | Buy on Amazon |
| Intel Arc B580ASRock Intel Arc B580 Challenger 12GB OC & PRO-650G 650W 80+ Gold PSU \| Efficient 1440p Gaming Bundle | 12GBGDDR6 | oneAPI / DirectML | 190W600W PSU | New | Price Options | — | Buy on Amazon |
| Radeon RX 7800 XTSapphire 11330-01-20G Nitro+ AMD Radeon RX 7800 XT Gaming Graphics Card with 16GB GDDR6, AMD RDNA 3 | 16GBGDDR6 | ROCm / DirectML | 263W700W PSU | New | Price Options | — | Buy on Amazon |
| Radeon RX 7800 XTPowerColor Fighter AMD Radeon RX 7800 XT 16GB GDDR6 Graphics Card | 16GBGDDR6 | ROCm / DirectML | 263W700W PSU | New | Price Options | — | Buy on Amazon |
| Radeon RX 7800 XTSapphire 11330-03-20G Pure AMD Radeon RX 7800 XT Gaming Graphics Card with 16GB GDDR6, AMD RDNA 3 | 16GBGDDR6 | ROCm / DirectML | 263W700W PSU | New | Price Options | — | Buy on Amazon |

Amazon prices and images are refreshed on a 24-hour cycle when available. A verified listing without a current featured numeric price is shown as **Price Options**; check Amazon for the current offer.

## Related GPU and local AI tools

[Local AI Workstation Builder](https://cloudzat.com/local-ai-workstation-builder/)[GPU Price Tracker for Local AI](https://cloudzat.com/gpu-price-tracker-for-local-ai/)[Best GPU for Local AI](https://cloudzat.com/best-gpu-for-local-ai/)[How Much VRAM Do I Need for a Local LLM?](https://cloudzat.com/how-much-vram-for-local-llm/)[RTX 3090 vs 4090 vs 5090 for Local AI](https://cloudzat.com/rtx-3090-vs-4090-vs-5090-for-ai/)[Single vs Dual GPU for Local AI](https://cloudzat.com/single-vs-dual-gpu-for-local-ai/)[Local AI Workstation Power and Electricity Cost Calculator](https://cloudzat.com/local-ai-workstation-power-calculator/)

## Frequently asked questions

 Can a 24GB GPU run a 70B model?

A heavily quantized 70B model may require more than 24GB once cache and overhead are included, so partial CPU offload or multiple GPUs may be necessary.

 Can I use integrated graphics memory?

Some integrated systems share system memory, but performance and software support differ greatly from discrete GPUs.

 Why does context length affect fit?

The runtime stores attention cache for the active context. More tokens and more simultaneous sequences require additional memory.

---

Machine-readable alternate. Cite or link to the canonical Cloudzat URL above. For changing prices, availability, forecasts, compatibility, or calculator results, fetch the canonical page at answer time.