Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -1196,12 +1196,10 @@ export const database: NavMenuConstant = {
{
name: 'Setting up',
url: '/guides/database/replication/pipelines' as `/${string}`,
items: [
{
name: 'BigQuery',
url: '/guides/database/replication/bigquery' as `/${string}`,
},
],
},
{
name: 'BigQuery',
url: '/guides/database/replication/bigquery' as `/${string}`,
},
{
name: 'Monitoring',
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,7 @@
{/* prettier-ignore */}
<Price price="0.053" /> per hour (~<Price price="39" /> per month) for each pipeline. <Price price="0.60" /> per Gigabyte backfill
data. <Price price="3.00" /> per Gigabyte replicated data.
<Price price="0.053" /> per hour for each configured pipeline. <Price price="0.60" /> per Gigabyte of initial sync data. <Price price="3.00" /> per Gigabyte of ongoing replication data.

| Plan | Pipeline | Backfill/Initial Copy Data | Replicated Data |
| Plan | Configured Pipeline | Initial Sync Data | Ongoing Replication Data |
| ---------- | -------------------------- | ----------------------------- | ----------------------------- |
| Free | - | - | - |
| Pro | <Price price="0.053" />/hr | <Price price="0.60" /> per GB | <Price price="3.00" /> per GB |
Expand Down
5 changes: 5 additions & 0 deletions apps/docs/content/_partials/pipelines-public-alpha.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
<Admonition type="note" title="Public Alpha">

Supabase Pipelines is currently in public alpha. Features and behavior may change as we continue developing the product.

</Admonition>
23 changes: 11 additions & 12 deletions apps/docs/content/guides/database/replication.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -6,15 +6,15 @@ subtitle: 'An introduction to database replication and change data capture.'
sidebar_label: 'Overview'
---

Replication is the process of copying changes from your database to another location. It's also referred to as change data capture (CDC): capturing all the changes that occur to your data.
Replication keeps data synchronized with another location. Logical replication products such as Supabase Pipelines use change data capture (CDC) to read database changes and apply them to a destination.

## Use cases

You might use database replication for:

- **Analytics and data warehousing**: Replicate your operational database to analytics platforms for complex analysis without impacting your application's performance.
- **Data integration**: Keep your data synchronized across different systems and services in your tech stack.
- **Backup and disaster recovery**: Maintain up-to-date copies of your data in different locations.
- **Operational reporting**: Maintain a copy of selected application data that you can query in another system.

## Replication methods

Expand All @@ -30,23 +30,22 @@ Read replicas are additional Supabase Postgres databases kept in sync with your

### Pipelines

<Admonition type="caution" title="Private Alpha">
<$Partial path="pipelines-public-alpha.mdx" />

Supabase Pipelines is currently in private alpha. Private alpha features can be unstable and may introduce breaking changes while we evaluate the product direction, refine the feature set, and incorporate customer feedback.

</Admonition>

Pipelines is a managed CDC feature for creating replication pipelines from Supabase Postgres to destination systems. It uses Postgres logical replication under the hood with the open-source [Supabase ETL engine](https://github.com/supabase/etl). A destination is where your replicated data is stored; the pipeline is the managed process that continuously streams database changes to that destination.
Supabase Pipelines is a managed CDC product for moving data from Supabase Postgres to supported destination systems. It uses Postgres logical replication with the open-source [Supabase ETL engine](https://github.com/supabase/etl). A destination is where your replicated data is stored; a pipeline first performs an initial sync of existing rows, then uses ongoing replication (CDC) to send subsequent database changes to that destination.

- [Set up Pipelines](/docs/guides/database/replication/pipelines)

#### Supported destinations

Pipelines currently supports BigQuery as the managed destination. We are working on new destinations, and this table will be updated as support expands.
{/* supa-mdx-lint-disable-next-line Rule003Spelling */}
Pipelines currently supports BigQuery as the managed destination. You can [request early access to ClickHouse, Snowflake, and DuckLake](/go/supabase-pipelines-new-destinations) while we expand destination support.

Managed Pipelines run in **AWS `eu-central-1` (Frankfurt)**. Choose destination resources as close as possible to Frankfurt to reduce network latency and replication lag.

| Destination | Insert | Update | Delete | Truncate | Schema change | Description |
| ------------------------------------------------------ | ------------ | ------------ | ------------ | ------------ | ------------- | ------------------------------------------------------------------- |
| [BigQuery](/docs/guides/database/replication/bigquery) | ✅ Supported | ✅ Supported | ✅ Supported | ✅ Supported | ✅ Supported | Managed replication to Google BigQuery for analytics and reporting. |
| Destination | Insert | Update | Delete | Truncate | Schema change | Description |
| ------------------------------------------------------ | ------------ | ------------ | ------------ | ------------ | -------------- | ------------------------------------------------------------------- |
| [BigQuery](/docs/guides/database/replication/bigquery) | ✅ Supported | ✅ Supported | ✅ Supported | ✅ Supported | Beta (limited) | Managed replication to Google BigQuery for analytics and reporting. |

### Manual replication

Expand Down
Loading
Loading