feat: mask data overlay files in scalar and vector index queries#7411

Draft

wjones127 wants to merge 9 commits into

lance-format:mainfrom

wjones127:will/oss-1325-indexes-mask-data-overlay-files-correctly

Commits on Jun 23, 2026

docs: specify data overlay files for the table format

wjones127
and
claude
committed
feat: add DataOverlay transaction operation

wjones127
and
claude
committed
chore: compile against DataOverlay proto, reject unsupported overlays

wjones127
and
claude
committed
feat: data overlay file model, feature flag, and DataOverlay transaction

wjones127
and
claude
committed
feat: refuse reads of fragments with overlays until merge lands

wjones127
and
claude
committed
feat: overlay cell-resolution core (newest-first, rank, NULL override)

wjones127
and
claude
committed
feat(file): v2 writer/reader support columns of unequal length

wjones127
and
claude
committed
feat: resolve data overlay files on the take and scan read paths

wjones127
and
claude
committed
feat: mask data overlay files in scalar and vector index queries

wjones127
and
claude
committed