Repository navigation
feat(core): complete native local hybrid search - #1097
Merged
JingsongLi merged 1 commit intoOct 11, 2026
Merged
Conversation
leaves12138
approved these changes
Oct 11, 2026
leaves12138
left a comment
There was a problem hiding this comment.
Reviewed the native local hybrid search implementation against the Java HybridSearchBuilder and ranker semantics. Snapshot pinning, per-route filtering before Top-K, address-space validation, route concurrency, score fusion, primary-key materialization, and DataFusion score projection are consistent. Validation passed with cargo fmt, the targeted paimon hybrid-search tests (20 passed), and the targeted DataFusion hybrid-search tests (4 passed). No blocking issues found.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Complete the Rust execution needed to move PyPaimon's existing local hybrid search into one native operation.
The implementation follows HybridSearchBuilderImpl, HybridSearchRanker and the existing Java vector/full-text route readers.
Verification
cargo test --locked -p paimon --lib --features fulltext hybrid_search_builder: 20 passed.cargo test --locked -p paimon-datafusion --features fulltext --test read_tables hybrid_search: 5 passed.cargo +1.98.0 clippy --locked -p paimon -p paimon-datafusion -p pypaimon_rust --all-targets --features fulltext,vortex -- -D warnings: passed.cargo check --locked -p paimon --libwithout fulltext: passed.cargo fmt --all -- --checkandgit diff --check: passed.Regressions cover real vector/full-text/scalar indexes, partial coverage, filtering before Top-K, all three rankers, more routes than the worker bound, authoritative REST snapshots and errors, fixed empty views, retained tags, malformed DSL, unsupported literals and query authorization. Two independent review passes found and fixed the missing-column and caller-pinned-view issues.