Skip to content

fix: validate data evolution matched row ids#312

Merged
JingsongLi merged 1 commit into
apache:mainfrom
QuakeWang:fix-row-id
May 12, 2026
Merged

fix: validate data evolution matched row ids#312
JingsongLi merged 1 commit into
apache:mainfrom
QuakeWang:fix-row-id

Conversation

@QuakeWang
Copy link
Copy Markdown
Contributor

Purpose

Fix DataEvolutionWriter validation for data-evolution MERGE/UPDATE.

Brief change log

  • Reject null _ROW_ID.
  • Reject duplicate updates to the same target row.
  • Validate update columns against each matched batch schema.
  • Add core unit tests and a DataFusion MERGE integration test.

Tests

API and Format

Documentation

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>
Copy link
Copy Markdown
Contributor

@JingsongLi JingsongLi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@JingsongLi JingsongLi merged commit 53e6e8e into apache:main May 12, 2026
8 checks passed
jerry-024 added a commit to jerry-024/paimon-rust that referenced this pull request May 12, 2026
* upstream/main:
  fix: validate data evolution matched row ids (apache#312)
  feat: support fixed-bucket partial-update merge engine (apache#263)
  Display partition stats in manifests system table (apache#308)
  ci: cherry-pick CI fixes from release-0.1 to main (apache#311)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants