Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 0 additions & 14 deletions docs/cli/index.md

This file was deleted.

Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
50 changes: 50 additions & 0 deletions docs/guides/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
---
id: "index"
title: "Demo"
slug: "/"
sidebar_position: 0
---

## Super Swarm in Action

<iframe
width="100%"
style={{aspectRatio: '16/9'}}
src="https://www.youtube.com/embed/jAH9-CVTN4M"
title="Super Swarm in Action"
frameBorder="0"
allowFullScreen
/>

## Confidential LLM Deployment

<iframe
width="100%"
style={{aspectRatio: '16/9'}}
src="https://www.youtube.com/embed/GfVSwvl_BrY"
title="Confidential LLM Deployment"
frameBorder="0"
allowFullScreen
/>

## Confidential Healthcare AI – LangGraph Clinical Agent

<iframe
width="100%"
style={{aspectRatio: '16/9'}}
src="https://www.youtube.com/embed/lBBjLpeNrbM"
title="Confidential Healthcare AI – LangGraph Clinical Agent"
frameBorder="0"
allowFullScreen
/>

## Confidential Healthcare AI – MONAI CT Segmentation

<iframe
width="100%"
style={{aspectRatio: '16/9'}}
src="https://www.youtube.com/embed/xXc1jP9zqdg"
title="Confidential Healthcare AI – MONAI CT Segmentation"
frameBorder="0"
allowFullScreen
/>
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
id: "swarm-vllm-openwebui"
title: "Deploy vLLM + Open WebUI"
slug: "/guides/swarm-vllm-openwebui"
slug: "/swarm-vllm-openwebui"
sidebar_position: 1
---

Expand All @@ -26,27 +26,27 @@ Modify the deployment parameters if you are using another model.

In the Super Swarm dashboard, sign in using either Google (recommended) or MetaMask.

<img src={require('../images/swarm-sign-in.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-sign-in.png').default} width="auto" height="auto" border="1"/>
<br/>

## 3. Create a Kubernetes cluster

**3.1.** Go to **Kubernetes** and click **Create Cluster**:

<img src={require('../images/swarm-kubernetes-create-cluster.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-kubernetes-create-cluster.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

**3.2.** Provide a name, add a **GPU** to the cluster, allocate resources, and click **Create Cluster**:

<img src={require('../images/swarm-create-kubernetes-space.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-create-kubernetes-space.png').default} width="auto" height="auto" border="1"/>
<br/>

## 4. Download the cluster configuration file

Download the `kubeconfig`:

<img src={require('../images/swarm-kubernetes-download-kubeconfig.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-kubernetes-download-kubeconfig.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

Expand Down Expand Up @@ -93,26 +93,19 @@ max-num-batched-tokens=2048

Back in the Super Swarm dashboard, go to **Ingresses** and note two hostnames listed there.

```
<img src={require('../images/swarm-ingresses-vllm-openwebui.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-ingresses-vllm-openwebui.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>
```

At your DNS provider, add a CNAME record pointing to a hostname and a TXT record for domain verification. Do this for both hostnames.
At your DNS provider, add a TXT record for domain verification and a CNAME record pointing to a hostname (DNS only, no proxy). Do this for both hostnames.

Back in the Super Swarm dashboard, ensure the statuses have changed to **Verified** and **Delegated**. This may take a couple of minutes.

```
<img src={require('../images/swarm-ingresses-vllm-openwebui-verified.png').default} width="auto" height="auto" border="1"/>
<br/>
```

## 8. Publish the cluster

Go to **Kubernetes** and publish the cluster.

<img src={require('../images/swarm-kubernetes-publish-cluster.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-kubernetes-publish-cluster.png').default} width="auto" height="auto" border="1"/>
<br/>

## 9. Test the deployment
Expand Down
36 changes: 18 additions & 18 deletions docs/cli/Guides/swarm-vllm-s3.md → docs/guides/swarm-vllm-s3.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
id: "swarm-vllm-s3"
title: "Deploy LLM from S3 Storage"
slug: "/guides/swarm-vllm-s3"
slug: "/swarm-vllm-s3"
sidebar_position: 2
---

Expand All @@ -26,53 +26,53 @@ Modify the deployment configuration and `vllmConfig` if you are deploying anothe

In the Super Swarm dashboard, sign in using either Google (recommended) or MetaMask.

<img src={require('../images/swarm-sign-in.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-sign-in.png').default} width="auto" height="auto" border="1"/>
<br/>

## 3. Create a service account

**3.1.** Open **Service Accounts** and click **Create Service Account**:

<img src={require('../images/swarm-create-service-account.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-create-service-account.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

**3.2.** Provide a name and click **Create**:

<img src={require('../images/swarm-create-service-account-window.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-create-service-account-window.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

**3.3.** Copy and save both Access and Secret keys and click **Done**:

<img src={require('../images/swarm-create-service-account-keys.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-create-service-account-keys.png').default} width="auto" height="auto" border="1"/>
<br/>

## 4. Create a bucket

**4.1.** Open **Object Storage** and click **Create Bucket**:

<img src={require('../images/swarm-object-storage.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-object-storage.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

**4.2.** Provide a name for the bucket and click **Create Bucket**:

<img src={require('../images/swarm-create-bucket.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-create-bucket.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

## 5. Provide access to the bucket

**5.1.** In **Object Storage**, click **Policy Rules**:

<img src={require('../images/swarm-object-storage-policy-rules.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-object-storage-policy-rules.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

**5.2.** Click **+Grant Access** in the top-right corner, select a **Service Account**, and click **Grant Access**:

<img src={require('../images/swarm-policy-rules-grant-access.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-policy-rules-grant-access.png').default} width="auto" height="auto" border="1"/>
<br/>

## 6. Download a model from Hugging Face
Expand All @@ -91,11 +91,11 @@ hf download Qwen/Qwen2.5-1.5B-Instruct --local-dir ./qwen-1.5b

**7.1.** In **Object Storage**, click **Connect Info** to see your S3 Endpoint, Bucket ID, and the region:

<img src={require('../images/swarm-object-storage-connect-info.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-object-storage-connect-info.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

<img src={require('../images/swarm-connect-info.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-connect-info.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

Expand All @@ -110,7 +110,7 @@ export S3_BUCKET="<YOUR_BUCKET_ID>"
```

Replace:
- `<YOUR_ACCESS_KEY>` and `<YOUR_SECRET_KEY>` with the keys you obtained in [Step 3](/cli/guides/swarm-vllm-s3#3-create-a-service-account).
- `<YOUR_ACCESS_KEY>` and `<YOUR_SECRET_KEY>` with the keys you obtained in [Step 3](/guides/swarm-vllm-s3#3-create-a-service-account).
- `<YOUR_S3_ENDPOINT>` and `<YOUR_BUCKET_ID>` with corresponding values in the **Connect Info**.

Ensure `AWS_DEFAULT_REGION` matches the region in the **Connect Info**.
Expand All @@ -134,18 +134,18 @@ aws s3 ls s3://${S3_BUCKET}/models/qwen-1.5b/ \

**8.1.** Go to **Kubernetes** and click **Create Cluster**:

<img src={require('../images/swarm-kubernetes-create-cluster.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-kubernetes-create-cluster.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

**8.2.** Provide a name, add a **GPU** to the cluster, allocate resources, and click **Create Cluster**:

<img src={require('../images/swarm-create-kubernetes-space.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-create-kubernetes-space.png').default} width="auto" height="auto" border="1"/>
<br/>

## 9. Download the cluster configuration file

<img src={require('../images/swarm-kubernetes-download-kubeconfig.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-kubernetes-download-kubeconfig.png').default} width="auto" height="auto" border="1"/>
<br/>

## 10. Point `kubectl` to the configuration file
Expand Down Expand Up @@ -178,22 +178,22 @@ bash deploy_qwen_s3.sh

Back in the Super Swarm dashboard, go to **Ingresses** and check the hostname listed there:

<img src={require('../images/swarm-ingresses-s3.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-ingresses-s3.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

At your DNS provider, add a CNAME record pointing to the hostname and a TXT record for domain verification.

Ensure the statuses have changed to **Verified** and **Delegated**. This may take a couple of minutes.

<img src={require('../images/swarm-ingresses-s3-verified.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-ingresses-s3-verified.png').default} width="auto" height="auto" border="1"/>
<br/>

## 14. Publish the cluster

Go to **Kubernetes** and publish the cluster.

<img src={require('../images/swarm-kubernetes-publish-cluster.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-kubernetes-publish-cluster.png').default} width="auto" height="auto" border="1"/>
<br/>


Expand Down
22 changes: 10 additions & 12 deletions docs/cli/Guides/swarm-vllm.md → docs/guides/swarm-vllm.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,8 @@
---
id: "swarm-vllm"
title: "Super Swarm: LLM Deployment (API)"
slug: "/guides/swarm-vllm"
sidebar_position: 99
displayed_sidebar: null
unlisted: true
title: "Deploy LLM (API)"
slug: "/swarm-vllm"
sidebar_position: 3
---

import Tabs from '@theme/Tabs';
Expand Down Expand Up @@ -38,25 +36,25 @@ Modify the deployment parameters if you are using another model.

In the Super Swarm dashboard, sign in using either Google (recommended) or MetaMask.

<img src={require('../images/swarm-sign-in.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-sign-in.png').default} width="auto" height="auto" border="1"/>
<br/>

## 3. Create a Kubernetes cluster

**3.1.** Go to **Kubernetes** and click **Create Cluster**:

<img src={require('../images/swarm-kubernetes-create-cluster.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-kubernetes-create-cluster.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

**3.2.** Provide a name, add a **GPU** to the cluster, allocate resources, and click **Create Cluster**:

<img src={require('../images/swarm-create-kubernetes-space.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-create-kubernetes-space.png').default} width="auto" height="auto" border="1"/>
<br/>

## 4. Download the cluster configuration file

<img src={require('../images/swarm-kubernetes-download-kubeconfig.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-kubernetes-download-kubeconfig.png').default} width="auto" height="auto" border="1"/>
<br/>

## 5. Point `kubectl` to the configuration file
Expand Down Expand Up @@ -136,22 +134,22 @@ Expected output:

Back in the Super Swarm dashboard, go to **Ingresses** and note a hostname listed there.

<img src={require('../images/swarm-ingresses-vllm.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-ingresses-vllm.png').default} width="auto" height="auto" border="1"/>
<br/>
<br/>

At your DNS provider, add a CNAME record pointing to the hostname and a TXT record for domain verification.

Back in the Super Swarm dashboard, ensure the statuses are **Verified** and **Delegated**. This may take a couple of minutes.

<img src={require('../images/swarm-ingresses-vllm-verified.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-ingresses-vllm-verified.png').default} width="auto" height="auto" border="1"/>
<br/>

## 10. Publish the cluster

Go to **Kubernetes** and publish the cluster.

<img src={require('../images/swarm-kubernetes-publish-cluster.png').default} width="auto" height="auto" border="1"/>
<img src={require('./images/swarm-kubernetes-publish-cluster.png').default} width="auto" height="auto" border="1"/>
<br/>

## 11. Send test requests
Expand Down
Loading
Loading