Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
73 commits
Select commit Hold shift + click to select a range
b02905a
workflows comfy
giurgiur99 Aug 4, 2026
08f1e0d
fix template
giurgiur99 Aug 4, 2026
248fe1d
fix download
giurgiur99 Aug 4, 2026
dc783b0
split in two bundles
giurgiur99 Aug 5, 2026
233942c
workflow id
giurgiur99 Aug 5, 2026
613b017
multiscene test
giurgiur99 Aug 5, 2026
11fb2ea
multishoot v2
giurgiur99 Aug 6, 2026
6231b06
fix v2
giurgiur99 Aug 6, 2026
c0f74d5
v3 try
giurgiur99 Aug 6, 2026
3866a6e
voice concat
giurgiur99 Aug 6, 2026
989a93a
update ugc product template to include new fields necessary on dashboard
dnsi0 Aug 6, 2026
6e87150
concat voices too
giurgiur99 Aug 6, 2026
434f221
install missing services
giurgiur99 Aug 7, 2026
3fe722e
cut to new scene
giurgiur99 Aug 7, 2026
26f8dde
remove sizeGb
dnsi0 Aug 11, 2026
803503a
cleanup
giurgiur99 Aug 11, 2026
01a6c2d
Merge branch 'feat/ltx-video-ugc-template' of https://github.com/ocea…
giurgiur99 Aug 11, 2026
373bff2
readd sizegb and schema
giurgiur99 Aug 11, 2026
07ec8c7
minimax flow
giurgiur99 Aug 12, 2026
db1dc33
simplify
giurgiur99 Aug 12, 2026
4a18194
minimax h3 v2
giurgiur99 Aug 12, 2026
be813f1
v3 h3
giurgiur99 Aug 12, 2026
f8f3e0b
h3 v4
giurgiur99 Aug 12, 2026
c791959
image defaults
giurgiur99 Aug 12, 2026
c34cb01
speed improvement
giurgiur99 Aug 12, 2026
5486dc9
fixes
giurgiur99 Aug 13, 2026
fcd927f
fix box sizes
giurgiur99 Aug 13, 2026
2c6ac40
fix corrupt model download
giurgiur99 Aug 13, 2026
e83c4bb
new carachters
giurgiur99 Aug 13, 2026
8ff1fe6
fix tail sound
giurgiur99 Aug 13, 2026
93640b7
add prompt creation model
giurgiur99 Aug 14, 2026
8495e25
add minimax-music3 template
dnsi0 Aug 14, 2026
e88e4a4
ltx 2.5
giurgiur99 Aug 17, 2026
9e753f5
Merge branch 'feat/ltx-video-ugc-template' of https://github.com/ocea…
giurgiur99 Aug 17, 2026
e94fd88
space out boxes ltx 2.5
giurgiur99 Aug 17, 2026
adaa5fc
fix template id
giurgiur99 Aug 17, 2026
f992df0
simplify flow
giurgiur99 Aug 17, 2026
a5864f4
fix bugs
giurgiur99 Aug 17, 2026
d847cec
fix wrong img size
giurgiur99 Aug 17, 2026
a5deb5a
fixes from official docs
giurgiur99 Aug 17, 2026
67a8261
fix input out of range
giurgiur99 Aug 17, 2026
e31c579
minimax h3 fix models
giurgiur99 Aug 18, 2026
3234865
fix new carachters
giurgiur99 Aug 18, 2026
d4f7d21
minimax fixes
giurgiur99 Aug 18, 2026
0ae6611
find old videos
giurgiur99 Aug 18, 2026
d00d5c6
fixes ltx 2.5
giurgiur99 Aug 18, 2026
388b3fd
try open github minimax flow
giurgiur99 Aug 18, 2026
60f472a
live preview
giurgiur99 Aug 18, 2026
61fa51d
allinone fixes
giurgiur99 Aug 18, 2026
02c8cfe
portarait mode
giurgiur99 Aug 18, 2026
c02a081
more allinone fixes
giurgiur99 Aug 19, 2026
7fa8d44
fix extend video
giurgiur99 Aug 19, 2026
9edadff
fix libraries
giurgiur99 Aug 19, 2026
9694c95
add muse, qwen38 templates
dnsi0 Aug 19, 2026
b4015ff
fix openweb ui bootstrap
dnsi0 Aug 19, 2026
c10f9c3
remove pre configured admin
dnsi0 Aug 19, 2026
fc47be5
fix muse tag
dnsi0 Aug 19, 2026
9661d15
Merge branch 'next-4' into feat/ltx-video-ugc-template
alexcos20 Aug 20, 2026
f7d347e
ui flows
giurgiur99 Aug 20, 2026
ea3cbfe
add glm 5.2 template
dnsi0 Aug 20, 2026
ca53033
remove comment
dnsi0 Aug 20, 2026
78ab9f0
remove incorrect comment
dnsi0 Aug 20, 2026
975e9cd
ecommerce flow fixes
giurgiur99 Aug 20, 2026
2ef625e
update templates to run with opencode
dnsi0 Aug 20, 2026
9f3e0e9
Merge branch 'feat/ltx-video-ugc-template' into template-glm-5.2
dnsi0 Aug 20, 2026
8530f5d
adapt description
dnsi0 Aug 20, 2026
beacb3d
text changes
giurgiur99 Aug 20, 2026
d4a8009
Merge branch 'feat/ltx-video-ugc-template' of https://github.com/ocea…
giurgiur99 Aug 20, 2026
46bae73
fixes ecom
giurgiur99 Aug 20, 2026
8bbb287
Merge branch 'feat/ltx-video-ugc-template' into template-glm-5.2
giurgiur99 Aug 20, 2026
d1e8754
fixes for ecom
giurgiur99 Aug 20, 2026
5d8d150
update glm5.2 template
dnsi0 Aug 20, 2026
24739d1
reduce context
dnsi0 Aug 20, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
55 changes: 54 additions & 1 deletion docs/compute.md
Original file line number Diff line number Diff line change
Expand Up @@ -110,7 +110,7 @@ These fields go in the `resources` array at the Docker-connection level:
| `driverVersion` | GPU driver version string |
| `memoryTotal` | GPU VRAM string (e.g. `"40960 MiB"`) |
| `platform` | GPU vendor: `"nvidia"`, `"amd"`, `"intel"` |
| `init` | Docker container configuration (`deviceRequests` for NVIDIA, `advanced` for AMD/Intel). Makes `kind` default to `"discrete"`. |
| `init` | Docker container configuration (`deviceRequests` for NVIDIA, `advanced` for AMD/Intel, and `advanced` on any vendor for shared-memory/pids settings — see [Multi-GPU workloads](#multi-gpu-workloads-shared-memory)). Makes `kind` default to `"discrete"`. |
| `constraints` | Companion resource requirements — see [Resource constraints](#resource-constraints). |

### CPU pinning with `cpuList`
Expand Down Expand Up @@ -228,6 +228,59 @@ The environment references it by `id`.
> to the owner of the job/service, alongside its container metrics. Set `GPU_METRICS=off` to
> disable.

### Multi-GPU workloads (shared memory)

A workload that spans **more than one GPU** needs two extra settings that Docker does not
provide by default. Add them under `init.advanced`, alongside `deviceRequests` — the two
blocks combine, they are not alternatives.

Why: a model server running on N GPUs starts **one worker process per GPU**, and those
processes exchange tensors and collectives through POSIX shared memory (`/dev/shm`) — both
the server's own message queues and NCCL's bootstrap. Docker gives a container a private
`/dev/shm` of just **64 MB**, which is far too small: the container hangs during startup or
dies with a bus error. Single-GPU workloads never touch this, so it only appears the first
time a resource is used by something that spans cards.

| Key | Purpose | Typical value |
| --- | --- | --- |
| `ShmSize` | Size of the container's `/dev/shm`, in bytes | `17179869184` (16 GB) |
| `IpcMode` | Set to `"host"` to share the host IPC namespace instead of getting a private one (equivalent to `docker run --ipc=host`, which most inference servers document as a requirement) | `"host"` |
| `PidsLimit` | Raises the per-container process/thread cap from the built-in default of 512. N worker processes each with their own thread pools can exceed it | `4096` |

Setting `ShmSize` alone is usually enough and keeps the container's IPC namespace isolated;
prefer it, and reach for `IpcMode: "host"` only if the workload actually requires it.

Add the block to **each** GPU resource the workload will request, since the effective values
are resolved from the resources a given job or service asks for:

```json
{
"id": "gpu0",
"kind": "discrete",
"type": "gpu",
"total": 1,
"description": "NVIDIA H200 (card 0)",
"platform": "nvidia",
"memoryTotal": "143771 MiB",
"init": {
"deviceRequests": {
"Driver": "nvidia",
"DeviceIDs": ["GPU-xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx"],
"Capabilities": [["gpu"]]
},
"advanced": {
"ShmSize": 17179869184,
"PidsLimit": 4096
}
},
"constraints": [{ "id": "ram", "min": 32 }, { "id": "cpu", "min": 4 }]
}
```

Both compute jobs and services honour these. When they are absent, containers keep Docker's
defaults and the 512-process cap.


### AMD Radeon (ROCm)

Install [ROCm](https://rocm.docs.amd.com/projects/radeon/en/latest/docs/install/wsl/install-radeon.html),
Expand Down
712 changes: 711 additions & 1 deletion docs/serviceTemplates/README.md

Large diffs are not rendered by default.

709 changes: 709 additions & 0 deletions docs/serviceTemplates/comfyui-ugc-bootstrap.sh

Large diffs are not rendered by default.

168 changes: 168 additions & 0 deletions docs/serviceTemplates/ecommerce-studio.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,168 @@
{
"id": "ecommerce-studio",
"name": "ComfyUI \u2014 E-commerce studio (product images, angles, creatives, motion)",
"description": "ComfyUI preloaded with Qwen-Image-Edit 2509 and LTX-2.3 behind five workflows that turn one product photo into the asset set a listing needs. Background puts a packshot into a generated scene. Relight matches the light to a reference photo. Angles makes a full 360 of the product at 45-degree steps, plus a close-up and a loop that starts on your own photo. Creative turns the product photo into an ad poster with your headline written on it. Motion makes a 9:16 clip of up to 5 seconds. Pick a workflow in the tab bar, upload one photo, press Queue. The edit backbone is 2509 and not the newer 2511, because the four product LoRAs this template uses exist only for 2509. Weights are 74.87 GB. The 9.4 GB Qwen2.5-VL text encoder is shared by the four image workflows, and one 20.4 GB edit backbone is shared by all four. Motion uses LTX-2.3, the same 43 GB weight set as the ltx-video-ugc-product template: if you launch with the bucket you already used for that template, those files are on disk and do not download again. Only one diffusion model is in VRAM per generation, because ComfyUI unloads between passes. Select a persistent-storage bucket on launch, or the weights download every time and the renders are lost on stop. Outputs save flat to the bucket root with ecom_ prefixes. Needs a CUDA GPU: the image workflows need about 30 GB, and Motion needs about 40 GB, so 48 GB runs everything. A model invents every image these workflows make. Check labels, small print and prices before you publish. At 135, 180 and 225 degrees the Angles workflow invents the side of the product it cannot see.",
"kind": "bundle",
"service": "comfyui",
"outcome": "Turn one product photo into scene shots, relights, a 360, an ad creative and a clip.",
"category": "image",
"includes": [
{
"name": "Qwen2.5-VL 7B text encoder (fp8 scaled)",
"kind": "model",
"sizeGb": 9.38,
"repoId": "Comfy-Org/Qwen-Image_ComfyUI"
},
{
"name": "Qwen-Image VAE",
"kind": "model",
"sizeGb": 0.25,
"repoId": "Comfy-Org/Qwen-Image_ComfyUI"
},
{
"name": "Qwen-Image-Edit 2509 (fp8 e4m3fn)",
"kind": "model",
"sizeGb": 20.43,
"repoId": "Comfy-Org/Qwen-Image-Edit_ComfyUI"
},
{
"name": "Qwen-Image-Edit 2509 White-to-Scene LoRA",
"kind": "model",
"sizeGb": 0.24,
"repoId": "Comfy-Org/Qwen-Image-Edit_ComfyUI"
},
{
"name": "Qwen-Image-Edit 2509 Relight LoRA",
"kind": "model",
"sizeGb": 0.24,
"repoId": "Comfy-Org/Qwen-Image-Edit_ComfyUI"
},
{
"name": "Qwen-Image-Edit 2509 Light-Migration LoRA",
"kind": "model",
"sizeGb": 0.24,
"repoId": "Comfy-Org/Qwen-Image-Edit_ComfyUI"
},
{
"name": "Qwen-Image-Edit 2509 Multiple-Angles LoRA",
"kind": "model",
"sizeGb": 0.24,
"repoId": "Comfy-Org/Qwen-Image-Edit_ComfyUI"
},
{
"name": "Qwen-Image-Edit 2509 Lightning 4-step LoRA (bf16)",
"kind": "model",
"sizeGb": 0.85,
"repoId": "lightx2v/Qwen-Image-Lightning"
},
{
"name": "LTX-2.3 22B dev (fp8)",
"kind": "model",
"sizeGb": 29.2,
"repoId": "Lightricks/LTX-2.3-fp8"
},
{
"name": "Gemma-3-12B-it text encoder (fp4 mixed)",
"kind": "model",
"sizeGb": 9.5,
"repoId": "Comfy-Org/ltx-2"
},
{
"name": "LTX-2.3 22B distilled LoRA (rank 111)",
"kind": "model",
"sizeGb": 2.7,
"repoId": "Comfy-Org/ltx-2.3"
},
{
"name": "LTX-2.3 spatial upscaler x2",
"kind": "model",
"sizeGb": 1.0,
"repoId": "Lightricks/LTX-2.3"
},
{
"name": "Gemma-3-12B-it abliterated LoRA (rank 64)",
"kind": "model",
"sizeGb": 0.6,
"repoId": "Comfy-Org/ltx-2"
}
],
"image": "yanwk/comfyui-boot",
"tag": "cu130-megapak-pt211-20260814",
"exposedPorts": [
8188
],
"entrypoint": [
"/bin/bash",
"-c"
],
"commandFile": "comfyui-ugc-bootstrap.sh",
"workflows": [
{
"id": "ocean_ecom_background",
"name": "Background \u2014 packshot into a scene",
"description": "Upload a product photo on a plain background and describe the scene you want. The model keeps the product's shape, label and detail and rebuilds everything around it. Saves as ecom_background_00001_.png.",
"file": "workflows/ocean_ecom_background.json"
},
{
"id": "ocean_ecom_relight",
"name": "Relight \u2014 match the light to a reference",
"description": "Upload your product plus a photo whose lighting you want, and the product is re-lit to match. Swap one widget to switch to prompt-driven relighting instead. Saves as ecom_relight_00001_.png.",
"file": "workflows/ocean_ecom_relight.json"
},
{
"id": "ocean_ecom_multiview",
"name": "Angles \u2014 a full 360 of the product",
"description": "Upload one photo. Get 7 rotation steps at 45 degrees, a close-up, and a 360 loop that starts on your own photo. Saves as ecom_angle_045 to ecom_angle_315, ecom_closeup, and ecom_turntable_00001_.webp. Check the back views: the model invents the side it cannot see.",
"file": "workflows/ocean_ecom_multiview.json"
},
{
"id": "ocean_ecom_creative",
"name": "Creative \u2014 ad poster with your headline",
"description": "Upload your product photo and describe the background and the headline you want. One pass writes the words and the background around your product. Saves as ecom_creative_00001_.png.",
"file": "workflows/ocean_ecom_creative.json"
},
{
"id": "ocean_ecom_motion",
"name": "Motion \u2014 a 9:16 product clip",
"description": "Upload one photo and describe the motion, not the product. LTX-2.3 makes a 9:16 clip of up to 5 seconds at 25 fps. Saves as ecom_motion_00001_.mp4.",
"file": "workflows/ocean_ecom_motion.json"
}
],
"userConfigurableEnvVars": [
{
"key": "COMFY_WORKFLOW_ID",
"validation": "^[A-Za-z0-9_-]+$"
},
{
"key": "COMFY_WORKFLOW"
}
],
"requiredResources": [
{
"id": "cpu",
"min": 8,
"recommended": 16,
"unit": "cores"
},
{
"id": "ram",
"min": 64,
"recommended": 128,
"unit": "GB"
},
{
"id": "disk",
"min": 110,
"recommended": 180,
"unit": "GB"
},
{
"kind": "discrete",
"type": "gpu",
"min": 1,
"recommended": 1,
"unit": "count",
"description": "One CUDA GPU. A generation holds one 20.4 GB diffusion backbone plus the 9.4 GB text encoder and a 0.25 GB VAE \u2014 about 30 GB \u2014 so a 32 GB card runs every workflow comfortably and 24 GB works with ComfyUI paging the text encoder out between passes. The two image backbones never co-reside: the Creative workflow runs its two stages as separate passes and ComfyUI unloads between them, so the 58.5 GB on disk is not a VRAM figure. The Motion workflow is the lightest, at 4.6 GB of weights plus the shared encoder. Ask for one card and not two: core ComfyUI has no tensor parallelism, a single sampling pass runs on one device, and a second GPU would be billed while idle."
}
]
}
Loading
Loading