Repository navigation

[SPARK-60720][CONNECT] Encode guarded pandas string columns directly in Rust - #144

Closed

dbtsai wants to merge 23 commits into

apache:masterfrom

dbtsai:codex/spark-60720-narrow-publication-v13-candidate

Closed

[SPARK-60720][CONNECT] Encode guarded pandas string columns directly in Rust#144
dbtsai wants to merge 23 commits into
apache:masterfrom
dbtsai:codex/spark-60720-narrow-publication-v13-candidate

Commits on Nov 5, 2026
- [SPARK-60676][CONNECT] Use Arrow columns for signed int64 pandas inputs
  dbtsai
  committed
  dc29a19
- [SPARK-60676][CONNECT] Validate integer upload scales against mock RPC
  dbtsai
  committed
  3e79f91
- [SPARK-60676][CONNECT] Cover leading null inference and non-nullable schemas
  dbtsai
  committed
  8c705c0
- [SPARK-60676][CONNECT] Exercise named schemas through mock rename relations
  dbtsai
  committed
  fb996d9
- [SPARK-60676][CONNECT] Avoid Arrow configuration overhead for small NumPy frames
  dbtsai
  committed
  79d3faf
- [SPARK-60676][CONNECT] Retain IPC row fallback for NUL field names
  dbtsai
  committed
  e266e8e
- [SPARK-60676][CONNECT] Include pandas regressions in the existing Arrow CI suite
  dbtsai
  committed
  9942f21
- [SPARK-60676][CONNECT] Preserve integer pandas schema and fallback semantics
  
  dbtsai
  and
  Isaac
  committed
  5edd700
- [SPARK-60676][TESTS] Preserve subclass column labels on pandas 3
  
  dbtsai
  and
  Isaac
  committed
  080aa16
- [SPARK-60676][CONNECT] Preserve customized pandas columns hooks
  
  dbtsai
  and
  Isaac
  committed
  abbc23a
- [SPARK-60676][CONNECT] Preserve rebound pandas index storage ordering
  
  dbtsai
  and
  Isaac
  committed
  7961bde
- Preserve integer pandas fallback with missing Arrow aliases
  
  dbtsai
  and
  Isaac
  committed
  3e3a8f5
- [SPARK-60676][TESTS] Retain current master coverage after rebase
  
  dbtsai
  and
  Isaac
  committed
  f058ac9
- Preserve current pandas label iteration and fallback order after rebase
  
  dbtsai
  and
  Isaac
  committed
  121a141
- Keep canonical string storage guard module identity
  
  dbtsai
  and
  Isaac
  committed
  aca1d02
Commits on Nov 6, 2026
- [CONNECT] Reconcile remaining change with current inference architecture
  
  dbtsai
  and
  Isaac
  committed
  ecdd67a
- [CONNECT] Reconcile remaining change with current inference architecture
  
  dbtsai
  and
  Isaac
  committed
  e7ae71a
- [CONNECT] Reconcile remaining change with current inference architecture
  
  dbtsai
  and
  Isaac
  committed
  40e5266
- [SPARK-60720][CONNECT] Encode guarded pandas String input inline
  
  dbtsai
  and
  Isaac
  committed
  26be6ab
- [SPARK-60720][CONNECT] Remove extra EOF blank lines
  
  dbtsai
  and
  Isaac
  committed
  09d0b13
- Reconcile current master interfaces and formatting after rebase
  
  dbtsai
  and
  Isaac
  committed
  4304062
- Align string label regression tests with current native iteration
  
  dbtsai
  and
  Isaac
  committed
  b2274e4
- [CONNECT] Reconcile remaining change with current inference architecture
  
  dbtsai
  and
  Isaac
  committed
  e31aad6

Commits

Commits on Nov 5, 2026

Commits on Nov 6, 2026