Skip to content

Add Update/Merge command base classes and refactor delta-33x - #13626

Merged
nartal1 merged 1 commit into
NVIDIA:branch-25.12from
nartal1:delta_lake_400_update_and_merge_cmd
Oct 20, 2025
Merged

Add Update/Merge command base classes and refactor delta-33x#13626
nartal1 merged 1 commit into
NVIDIA:branch-25.12from
nartal1:delta_lake_400_update_and_merge_cmd

Conversation

@nartal1

@nartal1 nartal1 commented Oct 20, 2025

Copy link
Copy Markdown
Collaborator

Contributes to #13339

Description

In this PR, we mainly refactored delta-33x Update and Merge command to use base classes.

  • Add UpdateCommandMetaBase, GpuUpdateCommandBase and MergeIntoCommandMetaBase in common directory
  • Refactor delta-33x UpdateCommandMeta, GpuUpdateCommand and MergeIntoCommandMeta to use base classes
  • Functionality of delta-33x is preserved, just moved to base classes.

Testing:

Delta 3.3.0 (Scala 2.12, Spark 3.5.6): BUILD SUCCESS, Ran delta integration tests locally.
Delta 4.0.0 (Scala 2.13, Spark 4.0.0): BUILD SUCCESS

Checklists

  • This PR has added documentation for new or modified features or behaviors.
  • This PR has added new tests or modified existing tests to cover new code paths.
    (Please explain in the PR description how the new code paths are tested, such as names of the new/existing tests that cover them.)
  • Performance testing has been performed and its results are added in the PR description. Or, an issue has been filed with a link in the PR description.

- Add UpdateCommandMetaBase, GpuUpdateCommandBase and MergeIntoCommandMetaBase  in common directory
- Refactor delta-33x UpdateCommandMeta, GpuUpdateCommand and MergeIntoCommandMeta to use base classes
- Functionality of delta-33x is preserved, just moved to base classes.

Tested:
- Delta 3.3.0 (buildver=356): BUILD SUCCESS
- Delta 4.0.0 (buildver=400): BUILD SUCCESS

Signed-off-by: Niranjan Artal <nartal@nvidia.com>
@nartal1 nartal1 self-assigned this Oct 20, 2025
@nartal1 nartal1 added task Work required that improves the product but is not user facing delta labels Oct 20, 2025
@nartal1

nartal1 commented Oct 20, 2025

Copy link
Copy Markdown
Collaborator Author

build

@nartal1 nartal1 mentioned this pull request Oct 20, 2025
10 tasks

@gerashegalov gerashegalov left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@nartal1
nartal1 merged commit fc3647c into NVIDIA:branch-25.12 Oct 20, 2025
63 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

delta task Work required that improves the product but is not user facing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants