Skip to content

fix: set chunk_size=32000 and fix input format for contextualizedembeddings#3502

Open
fzowl wants to merge 4 commits into
deepset-ai:mainfrom
fzowl:feat/embedding-model-voyage-context-4
Open

fix: set chunk_size=32000 and fix input format for contextualizedembeddings#3502
fzowl wants to merge 4 commits into
deepset-ai:mainfrom
fzowl:feat/embedding-model-voyage-context-4

Conversation

@fzowl

@fzowl fzowl commented Jun 25, 2026

Copy link
Copy Markdown

Add Voyage AI integration with text, document, and contextualized document embedders. Supports voyage-context-4 with chunk_size=32000.

@fzowl fzowl requested a review from a team as a code owner June 25, 2026 15:46
@fzowl fzowl requested review from davidsbatista and removed request for a team June 25, 2026 15:46
@CLAassistant

CLAassistant commented Jun 25, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@socket-security

socket-security Bot commented Jun 25, 2026

Copy link
Copy Markdown

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff Package Supply Chain
Security
Vulnerability Quality Maintenance License
Addedpypi/​voyageai@​0.4.198100100100100

View full report

@github-actions github-actions Bot added the type:documentation Improvements or additions to documentation label Jun 25, 2026
@fzowl fzowl force-pushed the feat/embedding-model-voyage-context-4 branch from c52056f to 2d5620f Compare June 25, 2026 16:07
@fzowl fzowl force-pushed the feat/embedding-model-voyage-context-4 branch 2 times, most recently from ceeef73 to 1dbb360 Compare June 25, 2026 16:14
fzowl added 3 commits June 25, 2026 18:17
…upport

Add a new voyage-haystack integration providing VoyageTextEmbedder,
VoyageDocumentEmbedder, and VoyageContextualizedDocumentEmbedder. The
contextualized embedder supports the voyage-context-4 contextualized chunk
embedding model via the /v1/contextualizedembeddings endpoint, grouping
chunks of the same source document so each embedding is document-aware.
@fzowl fzowl force-pushed the feat/embedding-model-voyage-context-4 branch from 1dbb360 to 5402c50 Compare June 25, 2026 16:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

topic:CI topic:DX type:documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants