Skip to content

Update choose-a-pod-withintable.mdx #789

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
lavanya-gunreddi wants to merge 3 commits into
base: main
Choose a base branch
from
Open

Update choose-a-pod-withintable.mdx #789

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
4c45847
Update choose-a-pod.mdx
lavanya-gunreddi Aug 14, 2026
341750a
Update choose-a-pod.mdx
lavanya-gunreddi Aug 14, 2026
c01ad0d
Update gpu-types.mdx
lavanya-gunreddi Aug 14, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 6 additions & 3 deletions pods/choose-a-pod.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,13 +12,16 @@ Start by identifying your primary workload type:

| Workload | Recommended GPU tier | Minimum VRAM | Notes |
|----------|---------------------|--------------|-------|
| **LLM inference** (7B–13B params) | Mid-range (RTX 4090, L4) | 24 GB | Sufficient for most quantized models |
| **LLM inference** (30B–70B params) | High-end (A100, H100) | 48–80 GB | May require multi-GPU setup |
| **LLM inference** (7B–13B params) | Mid-range (RTX 4090, L4, RTX Pro 6000 24 GB MIG*) | 24 GB | Sufficient for most quantized models |
| **LLM inference** (30B–70B params) | High-end (A100, H100, RTX Pro 6000 48 GB MIG*) | 48–80 GB | May require multi-GPU setup |
| **LLM training/fine-tuning** | High-end (A100, H100) | 40–80 GB | Memory bandwidth critical |
| **Image generation** (SDXL, Flux) | Mid-range (RTX 4090, L4) | 16–24 GB | Benefits from fast inference |
| **Image generation** (SDXL, Flux) | Mid-range (RTX 4090, L4, RTX Pro 6000 24 GB MIG*) | 16–24 GB | Benefits from fast inference |
| **Computer vision** | Entry to mid-range | 8–16 GB | Depends on model and batch size |
| **3D rendering** | Mid-range with RT cores | 16–24 GB | RT cores accelerate ray tracing |
| **Data processing** | CPU-focused or entry GPU | 8 GB+ | Prioritize CPU cores and RAM |
| **LLM inference (7B–13B params)** | RTX Pro 6000 MIG | 24 GB | Blackwell; Secure Cloud only |
| **LLM inference (30B–70B params, quantized)** | RTX Pro 6000 MIG | 48 GB | Blackwell; Secure Cloud only |
| **Image generation (SDXL, Flux)** | RTX Pro 6000 MIG | 24 GB | Blackwell; Secure Cloud only |

For a full list of available GPUs and their specifications, see [GPU types](/references/gpu-types).

Expand Down
2 changes: 2 additions & 0 deletions references/gpu-types.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,6 +52,8 @@ This table lists all GPU types available on Runpod:
| NVIDIA RTX A6000 | RTX A6000 | 48 |
| NVIDIA RTX PRO 4500 Blackwell | RTX PRO 4500 | 32 |
| NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | RTX PRO 6000 MaxQ | 96 |
| NVIDIA RTX PRO 6000 Blackwell Server Edition MIG | RTX PRO 6000 MIG | 24 |
| NVIDIA RTX PRO 6000 Blackwell Server Edition MIG | RTX PRO 6000 MIG | 48 |
| NVIDIA RTX PRO 6000 Blackwell Server Edition | RTX PRO 6000 | 96 |
| NVIDIA RTX PRO 6000 Blackwell Workstation Edition | RTX PRO 6000 WK | 96 |
| Tesla V100-PCIE-16GB | Tesla V100 | 16 |
Expand Down
Loading