feat: add E2E CI and harden Docker build migrations

[AnishSarkar22]

Description

• Added GA CI pipeline for E2E testing
• Enhnaced backend dockerfile with multi staged builds and e2e test support
• Improved readme files for e2e testing
• Made some alembic migrations idempotent
• Enhanced docker-build.yml with updated action versions
• Added ffmpeg dep in backend dockerfile
• Added pnpm configuration for only built dependencies in package.json
• Updated pnpm to v10.26.0
• Added pnpm-workspace.yaml for allowBuilds feature.
• Updated biome.json to add additional test-related directories and files

Motivation and Context

FIX #

Screenshots

API Changes

• This PR includes API changes

Change Type

• Bug fix
• New feature
• Performance improvement
• Refactoring
• Documentation
• Dependency/Build system
• Breaking change
• Other (specify):

Testing Performed

• Tested locally
• Manual/QA verification

Checklist

• Follows project coding standards and conventions
• Documentation updated as needed
• Dependencies updated as needed
• No lint/build errors or new warnings
• All relevant tests are passing

High-level PR Summary

This PR introduces a GitHub Actions workflow for end-to-end testing using Playwright. The workflow sets up a complete testing environment with PostgreSQL (pgvector), Redis, a FastAPI backend, Celery workers, and the Next.js frontend. It includes sophisticated service orchestration with custom E2E entrypoints that hijack sys.modules to replace real external API calls (Composio, OpenAI, Anthropic) with fakes, uses sentinel API keys to prevent accidental real API calls, and configures proxy settings to block external HTTP traffic except for HuggingFace model downloads. The workflow runs on pull requests to main/dev branches when relevant paths change and includes comprehensive health checks, caching strategies for dependencies and models, and artifact uploads for test reports and logs.

⏱️ Estimated Review Time: 15-30 minutes

💡 Review Order Suggestion

Order	File Path
1	.github/workflows/e2e-tests.yml

[vercel]

@AnishSarkar22 is attempting to deploy a commit to the Rohan Verma's projects Team on Vercel.

A member of the Team first needs to authorize it.

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: e9a7b92a-f470-4093-9167-655011b7cd51

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

Tip

💬 Introducing Slack Agent: The best way for teams to turn conversations into code.

Slack Agent is built on CodeRabbit's deep understanding of your code, so your team can collaborate across the entire SDLC without losing context.

• Generate code and open pull requests
• Plan features and break down work
• Investigate incidents and troubleshoot customer tickets together
• Automate recurring tasks and respond to alerts with triggers
• Summarize progress and report instantly

Built for teams:

• Shared memory across your entire org—no repeating context
• Per-thread sandboxes to safely plan and execute work
• Governance built-in—scoped access, auditability, and budget controls

One agent for your entire SDLC. Right inside Slack.

👉 Get started

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}