Skip to content

Update choose-a-pod.mdx #784

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
lavanya-gunreddi wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Update choose-a-pod.mdx #784

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
64e4d85
Update choose-a-pod.mdx
lavanya-gunreddi Aug 13, 2026
f6bd2ee
Update choose-a-pod.mdx
lavanya-gunreddi Aug 13, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions pods/choose-a-pod.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,17 @@ Start by identifying your primary workload type:
| **3D rendering** | Mid-range with RT cores | 16–24 GB | RT cores accelerate ray tracing |
| **Data processing** | CPU-focused or entry GPU | 8 GB+ | Prioritize CPU cores and RAM |

## Multi-Instance GPU (MIG) pods

RTX Pro 6000 Multi-Instance GPU (MIG) slices are partitioned GPU instances with dedicated memory and compute. Available on Secure Cloud only. All MIG slices use Blackwell architecture. Verify your CUDA version and framework versions support Blackwell before deploying.

| Workload | GPU | VRAM | Notes |
|---|---|---|---|
| LLM inference (7B–13B params) | RTX Pro 6000 MIG | 24 GB | Good alternative to RTX 4090 for inference |
| LLM inference (30B–70B params, quantized) | RTX Pro 6000 MIG | 48 GB | More VRAM than mid-range without full A100 cost |
| Image generation (SDXL, Flux) | RTX Pro 6000 MIG | 24 GB | Benefits from fast inference |
| Development and prototyping | RTX Pro 6000 MIG | 24 GB | Isolated environment with dedicated resources |

For a full list of available GPUs and their specifications, see [GPU types](/references/gpu-types).

## Estimate VRAM requirements
Expand Down
Loading