From 4c458479f9dd6951fd3c91cc52a669f8759d91fb Mon Sep 17 00:00:00 2001 From: lgunreddi Date: Fri, 14 Aug 2026 10:00:23 -0400 Subject: [PATCH 1/3] Update choose-a-pod.mdx --- pods/choose-a-pod.mdx | 9 ++++++--- 1 file changed, 6 insertions(+), 3 deletions(-) diff --git a/pods/choose-a-pod.mdx b/pods/choose-a-pod.mdx index df09d5b2b..5c05cbf24 100644 --- a/pods/choose-a-pod.mdx +++ b/pods/choose-a-pod.mdx @@ -12,13 +12,16 @@ Start by identifying your primary workload type: | Workload | Recommended GPU tier | Minimum VRAM | Notes | |----------|---------------------|--------------|-------| -| **LLM inference** (7B–13B params) | Mid-range (RTX 4090, L4) | 24 GB | Sufficient for most quantized models | -| **LLM inference** (30B–70B params) | High-end (A100, H100) | 48–80 GB | May require multi-GPU setup | +| **LLM inference** (7B–13B params) | Mid-range (RTX 4090, L4, RTX Pro 6000 24 GB MIG*) | 24 GB | Sufficient for most quantized models | +| **LLM inference** (30B–70B params) | High-end (A100, H100, RTX Pro 6000 48 GB MIG*) | 48–80 GB | May require multi-GPU setup | | **LLM training/fine-tuning** | High-end (A100, H100) | 40–80 GB | Memory bandwidth critical | -| **Image generation** (SDXL, Flux) | Mid-range (RTX 4090, L4) | 16–24 GB | Benefits from fast inference | +| **Image generation** (SDXL, Flux) | Mid-range (RTX 4090, L4, RTX Pro 6000 24 GB MIG*) | 16–24 GB | Benefits from fast inference | | **Computer vision** | Entry to mid-range | 8–16 GB | Depends on model and batch size | | **3D rendering** | Mid-range with RT cores | 16–24 GB | RT cores accelerate ray tracing | | **Data processing** | CPU-focused or entry GPU | 8 GB+ | Prioritize CPU cores and RAM | +| LLM inference (7B–13B params) | RTX Pro 6000 MIG | 24 GB | Blackwell; Secure Cloud only | +| LLM inference (30B–70B params, quantized) | RTX Pro 6000 MIG | 48 GB | Blackwell; Secure Cloud only | +| Image generation (SDXL, Flux) | RTX Pro 6000 MIG | 24 GB | Blackwell; Secure Cloud only | For a full list of available GPUs and their specifications, see [GPU types](/references/gpu-types). From 341750a1b3de866f240e9d51452ebc8c05a28a72 Mon Sep 17 00:00:00 2001 From: lgunreddi Date: Fri, 14 Aug 2026 10:05:02 -0400 Subject: [PATCH 2/3] Update choose-a-pod.mdx --- pods/choose-a-pod.mdx | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/pods/choose-a-pod.mdx b/pods/choose-a-pod.mdx index 5c05cbf24..02448ec70 100644 --- a/pods/choose-a-pod.mdx +++ b/pods/choose-a-pod.mdx @@ -19,9 +19,9 @@ Start by identifying your primary workload type: | **Computer vision** | Entry to mid-range | 8–16 GB | Depends on model and batch size | | **3D rendering** | Mid-range with RT cores | 16–24 GB | RT cores accelerate ray tracing | | **Data processing** | CPU-focused or entry GPU | 8 GB+ | Prioritize CPU cores and RAM | -| LLM inference (7B–13B params) | RTX Pro 6000 MIG | 24 GB | Blackwell; Secure Cloud only | -| LLM inference (30B–70B params, quantized) | RTX Pro 6000 MIG | 48 GB | Blackwell; Secure Cloud only | -| Image generation (SDXL, Flux) | RTX Pro 6000 MIG | 24 GB | Blackwell; Secure Cloud only | +| **LLM inference (7B–13B params)** | RTX Pro 6000 MIG | 24 GB | Blackwell; Secure Cloud only | +| **LLM inference (30B–70B params, quantized)** | RTX Pro 6000 MIG | 48 GB | Blackwell; Secure Cloud only | +| **Image generation (SDXL, Flux)** | RTX Pro 6000 MIG | 24 GB | Blackwell; Secure Cloud only | For a full list of available GPUs and their specifications, see [GPU types](/references/gpu-types). From c01ad0d75ff9574e6641e91dae3726eb265ca95e Mon Sep 17 00:00:00 2001 From: lgunreddi Date: Fri, 14 Aug 2026 10:10:07 -0400 Subject: [PATCH 3/3] Update gpu-types.mdx --- references/gpu-types.mdx | 2 ++ 1 file changed, 2 insertions(+) diff --git a/references/gpu-types.mdx b/references/gpu-types.mdx index e250640fb..97148e7b0 100644 --- a/references/gpu-types.mdx +++ b/references/gpu-types.mdx @@ -52,6 +52,8 @@ This table lists all GPU types available on Runpod: | NVIDIA RTX A6000 | RTX A6000 | 48 | | NVIDIA RTX PRO 4500 Blackwell | RTX PRO 4500 | 32 | | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | RTX PRO 6000 MaxQ | 96 | +| NVIDIA RTX PRO 6000 Blackwell Server Edition MIG | RTX PRO 6000 MIG | 24 | +| NVIDIA RTX PRO 6000 Blackwell Server Edition MIG | RTX PRO 6000 MIG | 48 | | NVIDIA RTX PRO 6000 Blackwell Server Edition | RTX PRO 6000 | 96 | | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | RTX PRO 6000 WK | 96 | | Tesla V100-PCIE-16GB | Tesla V100 | 16 |