Skip to content

[codex] Add Flink blob null-on-missing-file option#7798

Draft
leaves12138 wants to merge 8 commits intoapache:masterfrom
leaves12138:codex/blob-null-on-unreadable
Draft

[codex] Add Flink blob null-on-missing-file option#7798
leaves12138 wants to merge 8 commits intoapache:masterfrom
leaves12138:codex/blob-null-on-unreadable

Conversation

@leaves12138
Copy link
Copy Markdown
Contributor

@leaves12138 leaves12138 commented May 9, 2026

What

  • Add blob-write-null-on-missing-file to let Flink writes return NULL for descriptor BLOB values whose referenced file does not exist.
  • Move the existence check into FlinkRowWrapper before BlobRecord.fromDescriptor(...), so missing descriptor files are handled at row conversion time with a WARN log.
  • Reuse UriReaderFactory for descriptor existence checks, so file readers and their FileIO are cached by URI scheme/authority.

Validation

  • mvn -pl paimon-common,paimon-flink/paimon-flink-common -am -Pfast-build -DfailIfNoTests=false -Dtest=UriReaderFactoryTest,FlinkRowWrapperTest test
  • git diff --check

@leaves12138 leaves12138 changed the title [codex] Add blob null-on-unreadable write option [codex] Add Flink blob null-on-missing-descriptor option May 9, 2026
@leaves12138 leaves12138 changed the title [codex] Add Flink blob null-on-missing-descriptor option [codex] Add Flink blob null-on-missing-file option May 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant