Skip to content

Add Delta Lake 4.0.x module skeleton and build infrastructure - #13613

Merged
nartal1 merged 3 commits into
NVIDIA:branch-25.12from
nartal1:delta_lake_pr1_module_skeleton
Oct 17, 2025
Merged

Add Delta Lake 4.0.x module skeleton and build infrastructure#13613
nartal1 merged 3 commits into
NVIDIA:branch-25.12from
nartal1:delta_lake_pr1_module_skeleton

Conversation

@nartal1

@nartal1 nartal1 commented Oct 15, 2025

Copy link
Copy Markdown
Collaborator

Contributes to #13339

Description

This is the first PR to add delta-4.0 support. This is to make the review easier than going over the big PR - #13570. There will be subsequent PR's to add delta-lake-4.0 support and
consolidation of common code between delta-330 and delta-400.
In this PR,

  • Added delta-40x module with basic directory structure
  • Added pom.xml for delta-40x module
  • Added stub DeltaProbeImpl that returns NoDeltaProvider
  • Updated root pom.xml and scala2.13/pom.xml to include delta-40x for buildver=400
  • Added delta40x.version property (4.0.0)

This PR creates the skeleton for Delta Lake 4.0.x support. The module compiles but does not provide actual Delta functionality yet (returns NoDeltaProvider).

Testing

Built successuly without compile errors:
Delta 3.3.0 (Scala 2.12, Spark 3.5.6)
Delta 4.0.0 (Scala 2.13, Spark 4.0.0)

Checklists

  • This PR has added documentation for new or modified features or behaviors.
  • This PR has added new tests or modified existing tests to cover new code paths.
    (Please explain in the PR description how the new code paths are tested, such as names of the new/existing tests that cover them.)
  • Performance testing has been performed and its results are added in the PR description. Or, an issue has been filed with a link in the PR description.

- Add delta-40x module with basic directory structure
- Add pom.xml for delta-40x module (Scala 2.12 and 2.13)
- Add stub DeltaProbeImpl that returns NoDeltaProvider
- Update root pom.xml and scala2.13/pom.xml to include delta-40x for buildver=400
- Add delta40x.version property (4.0.0)
- Update Delta Lake README to document delta-40x module

This PR creates the skeleton for Delta Lake 4.0.x support. The module compiles but
does not provide actual Delta functionality yet (returns NoDeltaProvider).
@nartal1 nartal1 self-assigned this Oct 15, 2025
@nartal1
nartal1 requested a review from a team as a code owner October 15, 2025 17:51
@nartal1 nartal1 added build Related to CI / CD or cleanly building task Work required that improves the product but is not user facing labels Oct 15, 2025
Signed-off-by: Niranjan Artal <nartal@nvidia.com>
@nartal1
nartal1 force-pushed the delta_lake_pr1_module_skeleton branch from d8262aa to ce429d3 Compare October 15, 2025 17:53
@nartal1

nartal1 commented Oct 15, 2025

Copy link
Copy Markdown
Collaborator Author

build

@gerashegalov gerashegalov left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@nartal1
nartal1 merged commit 5ccaa87 into NVIDIA:branch-25.12 Oct 17, 2025
61 of 63 checks passed

@razajafri razajafri left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@nartal1 nartal1 mentioned this pull request Oct 20, 2025
10 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

build Related to CI / CD or cleanly building task Work required that improves the product but is not user facing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants