diff --git a/release-notes.mdx b/release-notes.mdx index 12f832ce..71ae0c5c 100644 --- a/release-notes.mdx +++ b/release-notes.mdx @@ -3,8 +3,85 @@ title: "Product updates" sidebarTitle: "Product updates" description: "New features, fixes, and improvements for the Runpod platform." --- +{/* ## ECR Integration now in beta New Release + + You can now pull private container images from AWS ECR into [Pods and Serverless endpoints](/pods/overview) without migrating registries or managing credentials. ECR delegation is available in beta. + */} - + + + +

New Release High-Performance Network Volumes now available

+ + You can now attach high-performance network volumes to [Pods, Serverless endpoints, and Instant Clusters](/storage/network-volumes) for significantly faster model load times. Look for the purple diamond icon to identify compatible datacenters. + +

New Release Deploy When Available

+ + You can now request a GPU that's currently out of capacity and get notified by email when it becomes available. Runpod saves your pod configuration so you can deploy immediately when capacity returns. + +

Improvement Hub navigation consolidated

+ + Hub navigation items are now consolidated into a single unified entry, making it easier to find templates and repos. + +

Bug Fix Billing records now show correct data for deleted resources

+ + SKU, region, and creation timestamps now appear correctly in [billing views and exports](/pods/pricing) for deleted Pods and network volumes. + + + + +

New Release Async Jobs for Serverless

+ + You can now submit a job to a [Serverless endpoint](/serverless/overview) and retrieve the result asynchronously when capacity is available. Jobs queue and process automatically when a worker is free, with no always-on workers or polling loops required. + +

New Release Serverless Worker Fitness Checks

+ + Serverless workers now run automated health checks before accepting jobs. Runpod automatically removes unhealthy workers from rotation, reducing failed requests and improving endpoint reliability. + +

New Release 24GB MiG instances now available

+ + You can now partition H100 and RTX PRO 6000 GPUs into up to seven independent [24GB MiG instances](/references/gpu-types), giving you more granular, lower-cost access without reserving a full card. + +

New Release Cost Centers now generally available

+ + [Cost Centers](/get-started/manage-accounts) let teams allocate and track GPU spend by project, team, or business unit. Detailed cost breakdowns are now available in billing, and all users receive itemized invoices as of May 1. + +

Improvement New Pod deploy flow with workload-first GPU selection

+ + The Pod deployment experience has been redesigned. Instead of picking a GPU first, you now choose a template or workload type and get recommended GPUs ranked as recommended, compatible, or incompatible. The new flow includes Save as Template, AI-assisted GPU selection, and a Notify Me When Available option for out-of-capacity cards. + + + + +

New Release Flash is now generally available

+ + [Flash](/flash/overview) is now generally available. You can run Python functions on cloud GPUs with a single `@Endpoint` decorator, with no containers or infrastructure setup required. Workers scale automatically, dependencies install on remote workers, and you can deploy production APIs with `flash deploy`. + +

New Release Instant Cluster Expansion and Priority FlashBoot now live

+ + [Instant Clusters](/instant-clusters/overview) can now expand to more nodes faster. Priority FlashBoot reduces cold-start times for cluster workers. Both features are live with no configuration changes needed. Expanding an existing cluster is currently only available to Runpod admins. To add nodes to an existing cluster, reach out to the Runpod team. + +

New Release FlashBoot for CPU Serverless now in public beta

+ + CPU Serverless workers now support FlashBoot, dramatically reducing cold-start times for your CPU endpoints. GA is planned for later this quarter. + +

Improvement GPU price reductions across popular SKUs

+ + GPU prices have been reduced across a range of SKUs, lowering the cost of your training and inference workloads. Updated pricing is reflected in the console and [pricing page](/pods/pricing). + +

Bug Fix Serverless GPU exclusions now correctly respected

+ + GPU type exclusions set on Serverless endpoints were not being enforced, causing workloads to land on excluded GPU types and resulting in incorrect billing. The issue is now fixed, and new alerting has been added to detect recurrence. + + + + + We've updated our release notes format for easier navigation. Updates from April 2026 onwards are listed above. Browse earlier releases by year and month in the archive below. + + + + + ## Flash beta: Run Python functions on cloud GPUs [Flash](/flash/overview) is now in public beta. Flash is a Python SDK that lets you run functions on Runpod Serverless GPUs with a single decorator: @@ -56,9 +133,9 @@ print("Done!") # This runs locally Flash now supports deploying endpoints to [multiple datacenters](/flash/configuration/parameters#datacenter) simultaneously. Pass a list of datacenters to distribute your workload across regions for improved availability and reduced latency. You can also attach [network volumes per datacenter](/flash/configuration/storage#multi-datacenter-volumes) for region-specific data access. - + - + ## New Public Endpoints and expanded examples **[New Public Endpoints](/public-endpoints/reference):** Expansion of available models across all categories. @@ -82,58 +159,61 @@ Flash now supports deploying endpoints to [multiple datacenters](/flash/configur - [Run Ollama on Pods](/tutorials/pods/run-ollama): Set up Ollama for LLM inference. - [Build Docker images with Bazel](/tutorials/pods/build-docker-images): Containerize your applications. - + - + ## GitHub release rollback GA and load balancing Serverless repos in beta - [GitHub release rollback](/serverless/workers/github-integration#roll-back-to-a-previous-build): Roll back your Serverless endpoint to any previous build from the console. Restore an earlier version when you encounter issues without waiting for a new GitHub release. - [Load balancing Serverless repos (beta)](/hub/publishing-guide): Load balancing endpoints are now available in the Hub. Publish or convert any listing to load balancer type by setting `"endpointType": "LB"` in your hub.json file, then deploy as a Serverless endpoint or Pod from the Hub page. Maintain a single listing for your model and let users choose their deployment method—autoscaling Serverless or dedicated Pod resources. + + + - - - + + + ## Pod migration in beta and Serverless development guides - [Pod migration (beta)](/references/troubleshooting/pod-migration): Migrate your Pod to a new machine when your stopped Pod's GPU is occupied. Provisions a new Pod with the same specifications and automatically transfers your data to an available machine. - [New Serverless development guides](/serverless/overview): We've added a comprehensive new set of guides for developing, testing, and debugging Serverless endpoints. - + - + ## Slurm Clusters GA, cached models in beta, and new Public Endpoints available - [Slurm Clusters are now generally available](/instant-clusters/slurm-clusters): Deploy production-ready HPC clusters in seconds. These clusters support multi-node performance for distributed training and large-scale simulations with pay-as-you-go billing and no idle costs. - [Cached models are now in beta](/serverless/endpoints/model-caching): Eliminate model download times when starting workers. The system places cached models on host machines before workers start, prioritizing hosts with your model already available for instant startup. - [New Public Endpoints available](/public-endpoints/overview): [WAN 2.5](/public-endpoints/models/wan-2-5) combines image and audio to create lifelike videos, while [Nano Banana](/public-endpoints/models/nano-banana-edit) merges multiple images for composite creations. - + - + ## Hub revenue sharing launches and Pods UI gets refreshed - [Hub revenue share model](/hub/revenue-sharing): Publish to the Runpod Hub and earn credits when others deploy your repo. Earn up to 7% of compute revenue through monthly tiers with credits auto-deposited into your account. - [Pods UI updated](/pods/overview): Refreshed modern interface for interacting with Runpod Pods. - + - + ## Public Endpoints arrive, Slurm Clusters in beta - [Public Endpoints](/public-endpoints/overview): Access state-of-the-art AI models through simple API calls with an integrated playground. Available endpoints include [Qwen Image Edit](/public-endpoints/models/qwen-image-edit), [Flux Kontext](/public-endpoints/models/flux-kontext-dev), [Cogito 671B](/public-endpoints/models/cogito-671b), and [Minimax Speech](/public-endpoints/models/minimax-speech). - [Slurm Clusters (beta)](/instant-clusters/slurm-clusters): Create on-demand multi-node clusters instantly with full Slurm scheduling support. - + - + ## S3-compatible storage and updated referral program - [S3-compatible API for network volumes](/storage/s3-api): Upload and retrieve files from your network volumes without compute using AWS S3 CLI or Boto3. Integrate Runpod storage into any AI pipeline with zero-config ease and object-level control. - [Referral program revamp](/references/referrals): Updated rewards and tiers with clearer dashboards to track performance. - + - + ## Port labeling, price drops, Runpod Hub, and Tetra beta test - [Port labeling](/pods/overview): Name exposed ports in the UI and API to help team members identify services like Jupyter or TensorBoard. @@ -141,18 +221,18 @@ Flash now supports deploying endpoints to [multiple datacenters](/flash/configur - [Runpod Hub](/hub/overview): A curated catalog of one-click endpoints and templates for deploying community projects without starting from scratch. - **Tetra beta test**: A Python library for running code on GPU with Runpod. Add a `@remote()` decorator to functions that need GPU power while the rest of your code runs locally. - + - + ## GitHub login, RTX 5090s, and global networking expansion - **Login with GitHub**: OAuth sign-in and linking for faster onboarding and repo-driven workflows. - **RTX 5090s on Runpod**: High-performance RTX 5090 availability for cost-efficient training and inference. - [Global networking expansion](/pods/networking): Rollout to additional data centers approaching full global coverage. - + - + ## Enterprise features arrive, REST API goes GA, Instant Clusters in beta, and APAC expansion - [CPU Pods get network storage access](/storage/network-volumes): GA support for network volumes on CPU Pods for persistent, shareable storage. @@ -162,27 +242,31 @@ Flash now supports deploying endpoints to [multiple datacenters](/flash/configur - **Bare metal**: Reserve dedicated GPU servers for maximum control, performance, and long-term savings. - **AP-JP-1**: New Fukushima region for low-latency APAC access and in-country data residency. - + - + ## REST API enters beta with full-time community manager - [REST API beta test](/api-reference/overview): RESTful endpoints for Pods, endpoints, and volumes for simpler automation than GraphQL. - **Full-time community manager hire**: Dedicated programs, content, and faster community response. - [Serverless GitHub integration release](/serverless/workers/github-integration): GA for GitHub-based Serverless deploys with production-ready stability. - + - + ## New silicon and LLM-focused Serverless upgrades - **CPU Pods v2**: Docker runtime parity with GPU Pods for faster starts with network volume support. - [H200s on Runpod](/references/gpu-types): NVIDIA H200 GPUs available for larger models and higher memory bandwidth. - [Serverless upgrades](/serverless/overview): Higher GPU counts per worker, new quick-deploy runtimes, and simpler model selection. - + + + - + + + ## Global networking expands and GitHub deploys enter beta - [Global networking expansion](/pods/networking): Added to CA-MTL-3, US-GA-1, US-GA-2, and US-KS-2 for expanded private mesh coverage. @@ -190,26 +274,26 @@ Flash now supports deploying endpoints to [multiple datacenters](/flash/configur - **Scoped API keys**: Least-privilege tokens with fine-grained scopes and expirations for safer automation. - **Passkey auth**: Passwordless WebAuthn sign-in for phishing-resistant account access. - + - + ## Storage expansion and private cross-data-center connectivity - [US-GA-2 added to network storage](/storage/network-volumes): Enable network volumes in US-GA-2. - [Global networking](/pods/networking): Private cross-data-center networking with internal DNS for secure service-to-service traffic. - + - + ## Storage coverage grows with major price cuts and revamped referrals - **US-TX-3 and EUR-IS-1 added to network storage**: Network volumes available in more regions for local persistence. - **Runpod slashes GPU prices**: Broad GPU price reductions to lower training and inference total cost of ownership. - [Referral program revamp](/references/referrals): Updated commissions and bonuses with an affiliate tier and improved tracking. - + - + ## $20M seed round, community event, and broader Serverless options - **$20M seed by Intel Capital and Dell Technologies Capital**: Funds infrastructure expansion and product acceleration. @@ -217,26 +301,30 @@ Flash now supports deploying endpoints to [multiple datacenters](/flash/configur - [Serverless CPU Pods](/references/cpu-types): Scale-to-zero CPU endpoints for services that don't need a GPU. - [AMD GPUs](/references/gpu-types): AMD ROCm-compatible GPU SKUs as cost and performance alternatives to NVIDIA. - + - + ## CPU compute and first-class automation tooling - **CPU Pods**: CPU-only instances with the same networking and storage primitives for cheaper non-GPU stages. - [runpodctl](/runpodctl/overview): Official CLI for Pods, endpoints, and volumes to enable scripting and CI/CD workflows. - + - + ## Console navigation overhaul and documentation refresh - **New navigational changes to Runpod UI**: Consolidated menus, consistent action placement, and fewer clicks for common tasks. - **Docs revamp**: New information architecture, improved search, and more runnable examples and quickstarts. - **Zhen AMA**: Roadmap Q&A and community feedback session. - + + + - + + + ## New regions and investment in community support - **US-OR-1**: Additional US region for lower latency and more capacity in the Pacific Northwest. @@ -244,18 +332,18 @@ Flash now supports deploying endpoints to [multiple datacenters](/flash/configur - **First community manager hire**: Dedicated community programs and faster feedback loops. - **Building out the support team**: Expanded coverage and expertise for complex issues. - + - + ## Faster template starts and better multi-region hygiene - **Serverless quick deploy**: One-click deploy of curated model templates with sensible defaults. - **EU domain for Serverless**: EU-specific domain briefly offered for data residency, superseded by other region controls. - **Data-center filter for Serverless**: Filter and manage endpoints by region for multi-region fleets. - + - + ## Self-service upgrades, clearer metrics, new pricing model, and cost visibility - **Self-service worker upgrade**: Rebuild and roll workers from the dashboard without support tickets. @@ -264,9 +352,9 @@ Flash now supports deploying endpoints to [multiple datacenters](/flash/configur - [Flex and active workers](/serverless/pricing): Always-on "active" workers for baseline load with on-demand "flex" workers for bursts. - **Billing explorer**: Inspect costs by resource, region, and time to identify optimization opportunities. - + - + ## Team governance, storage expansion, and better debugging - [Teams](/get-started/manage-accounts): Organization workspaces with role-based access control for Pods, endpoints, and billing. @@ -276,27 +364,27 @@ Flash now supports deploying endpoints to [multiple datacenters](/flash/configur - **Serverless health endpoint**: Lightweight /health probe returning endpoint and worker status without creating a billable job. - **SOC 2 Type II compliant**: Security and compliance certification for enterprise customers. - + - + ## Observability, top-tier GPUs, and commitment-based savings - **Serverless metrics page**: Time-series charts for pXX latencies, queue delay, throughput, and worker states for faster debugging and tuning. - [H100s on Runpod](/references/gpu-types): NVIDIA H100 instances for higher throughput and larger model footprints. - [Savings plans](/pods/pricing): Commitment-based discounts for predictable workloads to lower effective hourly rates. - + - + ## Smoother auth and multi-region Serverless with persistent storage - **The new and improved Runpod login experience**: Streamlined sign-in and team access for faster, more consistent auth flows. - [Network volumes added to Serverless](/storage/network-volumes): Attach persistent storage to Serverless workers to retain models and artifacts across restarts and speed cold starts through caching. - **Serverless region support**: Pin or allow specific regions for endpoints to reduce latency and meet data-residency needs. - + - + ## Deeper autoscaling controls, richer metrics, persistent storage, and job cancellation - **Serverless scaling strategies**: Scale by queue delay and/or concurrency with min/max worker bounds to balance latency and cost. @@ -306,26 +394,33 @@ Flash now supports deploying endpoints to [multiple datacenters](/flash/configur - **Network storage beta**: Region-scoped, attachable volumes shareable across Pods and endpoints for model caches and datasets. - **Job cancel API**: Programmatically terminate queued or running jobs to free capacity and enforce client timeouts. - + - + ## Serverless platform hardens with cleaner API - **Serverless API v2**: Revised request and response schema with improved error semantics and new endpoints for better control over job lifecycle and observability. - + - + ## Better control over notifications and GPU allocation - **Notification preferences**: Configure which platform events trigger alerts to reduce noise for teams and CI systems. - **GPU priorities**: Influence scheduling by marking workloads as higher priority to reduce queue time for critical jobs. - + + + - + + + ## Encrypted volumes for persistent data - **Runpod now offers encrypted volumes**: Enable at-rest encryption for persistent volumes with no application changes required using platform-managed keys. - + + + +