Skip to content

test: run test suites against Haystack v3 branch (do not merge)#3532

Draft
julian-risch wants to merge 1 commit into
mainfrom
test/haystack-v3
Draft

test: run test suites against Haystack v3 branch (do not merge)#3532
julian-risch wants to merge 1 commit into
mainfrom
test/haystack-v3

Conversation

@julian-risch

@julian-risch julian-risch commented Jul 2, 2026

Copy link
Copy Markdown
Member

Related Issues

Proposed Changes:

  • Point the haystack-ai dependency of all 92 integrations at the Haystack v3 draft branch (haystack-ai @ git+https://github.com/deepset-ai/haystack.git@v3) so every integration's CI workflow runs against the 3.0 draft
  • Add [tool.hatch.metadata] allow-direct-references = true where missing, so hatch accepts the git dependency
  • Remove --reruns 3 --reruns-delay 30 -x from the unit-cov-retry script so CI reports all unit-test failures instead of stopping at the first one

This follows the approach from #3467, extended to all integrations and targeting v3 instead of lifecycle.

⚠️ Draft / do not merge — this PR only exists to collect CI results against the v3 draft.

How did you test it?

Verified locally for the anthropic integration that hatch resolves and installs Haystack from the v3 branch and that the unit tests run. Two tests already fail there against v3 (test_to_dict_with_parameters, test_serde_in_pipeline — serialization output differences), which is exactly the kind of incompatibility this PR is meant to surface.

Notes for the reviewer

The CI results on this PR are the deliverable: each integration's workflow shows which test suites break against the v3 draft.

Checklist

🤖 Generated with Claude Code

@julian-risch @claude
test: run test suites against Haystack v3 branch
9710d2b 
Point every integration's haystack-ai dependency at the v3 draft branch
to surface incompatibilities ahead of the 3.0 release. Reruns and
fail-fast are removed from unit-cov-retry so CI reports all failures.

Not meant to be merged.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (pyversity)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (openapi)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (azure_doc_intelligence)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (snowflake)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (twelvelabs)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (e2b)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (falkordb)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (weave)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (dspy)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (weaviate)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (funasr)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (google_drive)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (supabase)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (libreoffice)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (valkey)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (lara)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (oracle)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (spacy)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (whisper)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (vespa)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (sentence_transformers)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (docling)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (chonkie)

This PR does not seem to contain any modification to coverable code.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Coverage report (unstructured)

This PR does not seem to contain any modification to coverable code.

This was referenced Jul 2, 2026
Merged
Merged
Merged
Open
Merged
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

integration:aimlapi integration:alloydb integration:amazon-bedrock integration:amazon-sagemaker integration:amazon-textract integration:anthropic integration:arangodb integration:arcadedb integration:astra integration:azure-ai-search integration:azure-doc-intelligence integration:azure-form-recognizer integration:brave integration:chonkie integration:chroma integration:cognee integration:cohere integration:cometapi integration:datadog integration:deepeval integration:docling integration:docling-serve integration:dspy integration:e2b integration:elasticsearch integration:faiss integration:falkordb integration:fastembed integration:firecrawl integration:funasr integration:github integration:google-ai integration:google-drive integration:google-genai integration:google-vertex integration:hanlp integration:huggingface-api integration:jina integration:kreuzberg integration:langdetect integration:langfuse integration:lara integration:libreoffice integration:litellm integration:llama_cpp integration:llama_stack integration:markitdown integration:mcp integration:mem0 integration:meta-llama integration:microsoft-sharepoint integration:mistral integration:mongodb-atlas integration:nvidia integration:oauth integration:ollama integration:openapi integration:openrouter integration:opensearch integration:opentelemetry integration:optimum integration:orcarouter integration:paddleocr integration:perplexity integration:pgvector integration:pinecone integration:presidio integration:pyversity integration:qdrant integration:ragas integration:searchapi integration:sentence-transformers integration:serperdev integration:snowflake integration:spacy integration:sqlalchemy integration:stackit integration:supabase integration:tavily integration:tika integration:togetherai integration:transformers integration:twelvelabs integration:unstructured-fileconverter integration:valkey integration:vespa integration:vllm integration:watsonx integration:weave components coming from Weights and Biases integration:weaviate integration:whisper

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@julian-risch