Skip to content

Commit 828de75

Browse files
authored
[DOC] update download page for 26.08 release [skip ci] (#15509)
Closes #15059. ### Description This PR updates the download and archive documentation for the v26.08.0 release, adds the Databricks compatibility guidance requested in #15059 directly to the download page, and aligns the Code of Conduct contact with the cuDF Spark project name. Changes include: - Update `docs/download.md` to list v26.08.0 artifacts, Maven coordinates, signature verification commands, supported Spark versions, and concise release notes. - Add an inline Databricks compatibility section to `docs/download.md`, covering the current DBR 14.3/17.3 Spark, Scala, JDK, CUDA, driver, Delta feature, and fallback guidance without introducing a separate support page. - Update DBR 17.3 coverage for v26.08 liquid clustering and CTAS/RTAS support based on #15278 and #15320. - Move the previous current release, v26.06.1, into `docs/archive.md` as the newest archived release. - Replace `spark-rapids-conduct@nvidia.com` with `cudf-spark-conduct@nvidia.com` in `CODE_OF_CONDUCT.md`. - Verify the Spark support matrix against `pom.xml` on `release/26.08`. - Verify every PR referenced by the release notes is included in `release/26.08`. - Verify the archived v26.06.1 requirements and artifacts against the `v26.06.1` tag. Validation: - `git diff --check -- CODE_OF_CONDUCT.md docs/download.md docs/archive.md` - IDE lints for all three documentation files - Verified the inline Databricks matrix excludes the unsupported DBR 13.3 line ### Checklists Documentation - [x] Updated for new or modified user-facing features or behaviors - [ ] No user-facing change Testing - [ ] Added or modified tests to cover new code paths - [ ] Covered by existing tests (Please provide the names of the existing tests in the PR description.) - [x] Not required Performance - [ ] Tests ran and results are added in the PR description - [ ] Issue filed with a link in the PR description - [x] Not required --------- Signed-off-by: liyuan <yuali@nvidia.com>
1 parent 2ffbdbc commit 828de75

3 files changed

Lines changed: 175 additions & 28 deletions

File tree

CODE_OF_CONDUCT.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ This Code of Conduct applies both within project spaces and in public spaces whe
4242

4343
## Enforcement
4444

45-
Instances of abusive, harassing, or otherwise unacceptable behavior may be reported by contacting the project team at [spark-rapids-conduct@nvidia.com](mailto:spark-rapids-conduct@nvidia.com) All complaints will be reviewed and investigated and will result in a response that is deemed necessary and appropriate to the circumstances. The project team is obligated to maintain confidentiality with regard to the reporter of an incident. Further details of specific enforcement policies may be posted separately.
45+
Instances of abusive, harassing, or otherwise unacceptable behavior may be reported by contacting the project team at [cudf-spark-conduct@nvidia.com](mailto:cudf-spark-conduct@nvidia.com) All complaints will be reviewed and investigated and will result in a response that is deemed necessary and appropriate to the circumstances. The project team is obligated to maintain confidentiality with regard to the reporter of an incident. Further details of specific enforcement policies may be posted separately.
4646

4747
Project maintainers who do not follow or enforce the Code of Conduct in good faith may face temporary or permanent repercussions as determined by other members of the project’s leadership.
4848

docs/archive.md

Lines changed: 109 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,115 @@ nav_order: 15
55
---
66
Below are archived releases for RAPIDS Accelerator for Apache Spark.
77

8+
## Release v26.06.1
9+
### Hardware Requirements:
10+
11+
The plugin is designed to work on NVIDIA Volta, Turing, Ampere, Ada Lovelace, Hopper and Blackwell generation datacenter GPUs. The plugin jar is tested on the following GPUs:
12+
13+
GPU Models: NVIDIA V100, T4, A10, A100, L4, H100 and B100 GPUs
14+
15+
### Software Requirements:
16+
17+
OS: Spark RAPIDS is compatible with any Linux distribution with glibc >= 2.28 (Please check ldd --version output). glibc 2.28 was released August 1, 2018.
18+
Tested on Ubuntu 22.04, Ubuntu 24.04, Rocky Linux 8 and Rocky Linux 9
19+
20+
NVIDIA Driver*: R525+
21+
22+
Runtime:
23+
Scala 2.12, 2.13
24+
Python, Java Virtual Machine (JVM) compatible with your spark-version.
25+
26+
* Check the Spark documentation for Python and Java version compatibility with your specific
27+
Spark version. For instance, visit `https://spark.apache.org/docs/3.4.1` for Spark 3.4.1.
28+
29+
Supported Spark versions:
30+
Apache Spark 3.3.0, 3.3.1, 3.3.2, 3.3.3, 3.3.4
31+
Apache Spark 3.4.0, 3.4.1, 3.4.2, 3.4.3, 3.4.4
32+
Apache Spark 3.5.0, 3.5.1, 3.5.2, 3.5.3, 3.5.4, 3.5.5, 3.5.6, 3.5.7, 3.5.8
33+
Apache Spark 4.0.0, 4.0.1, 4.0.2
34+
Apache Spark 4.1.1
35+
Scala 2.12: Spark 3.3.0 through 3.5.8
36+
Scala 2.13: Spark 3.5.0 through 3.5.8, and Spark 4.0.0, 4.0.1, 4.0.2, and 4.1.1
37+
38+
Supported Databricks runtime versions for Azure and AWS:
39+
Databricks 13.3 ML LTS (GPU, Scala 2.12, Spark 3.4.1)
40+
Databricks 14.3 ML LTS (GPU, Scala 2.12, Spark 3.5.0)
41+
Databricks 17.3 ML LTS (GPU, Scala 2.13, Spark 4.0.0)
42+
43+
Supported Dataproc versions (Debian/Ubuntu/Rocky):
44+
GCP Dataproc 2.1
45+
GCP Dataproc 2.2
46+
GCP Dataproc 2.3
47+
48+
Supported Dataproc Serverless versions:
49+
Spark runtime 1.2 LTS
50+
Spark runtime 2.2 LTS
51+
Spark runtime 2.3 LTS
52+
Spark runtime 3.0
53+
54+
*Some hardware may have a minimum driver version greater than R470. Check the GPU spec sheet
55+
for your hardware's minimum driver version.
56+
57+
*For EMR support, please refer to the
58+
[Distributions](https://docs.nvidia.com/spark-rapids/user-guide/latest/faq.html#which-distributions-are-supported) section of the FAQ.
59+
60+
### RAPIDS Accelerator's Support Policy for Apache Spark
61+
The RAPIDS Accelerator maintains support for Apache Spark versions available for download from [Apache Spark](https://spark.apache.org/downloads.html)
62+
63+
### Download RAPIDS Accelerator for Apache Spark v26.06.1
64+
65+
#### CUDA 12
66+
67+
| Processor | Scala Version | Download Jar | Download Signature | Download From Maven |
68+
|-----------|---------------|--------------|--------------------|---------------------|
69+
| x86_64 | Scala 2.12 | [RAPIDS Accelerator v26.06.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/26.06.1/rapids-4-spark_2.12-26.06.1.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/26.06.1/rapids-4-spark_2.12-26.06.1.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.12&lt;/artifactId&gt;<br/> &lt;version&gt;26.06.1&lt;/version&gt;<br/>&lt;/dependency&gt;</pre> |
70+
| x86_64 | Scala 2.13 | [RAPIDS Accelerator v26.06.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/26.06.1/rapids-4-spark_2.13-26.06.1.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/26.06.1/rapids-4-spark_2.13-26.06.1.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.13&lt;/artifactId&gt;<br/> &lt;version&gt;26.06.1&lt;/version&gt;<br/>&lt;/dependency&gt;</pre> |
71+
| arm64 | Scala 2.12 | [RAPIDS Accelerator v26.06.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/26.06.1/rapids-4-spark_2.12-26.06.1-cuda12-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/26.06.1/rapids-4-spark_2.12-26.06.1-cuda12-arm64.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.12&lt;/artifactId&gt;<br/> &lt;version&gt;26.06.1&lt;/version&gt;<br/> &lt;classifier&gt;cuda12-arm64&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
72+
| arm64 | Scala 2.13 | [RAPIDS Accelerator v26.06.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/26.06.1/rapids-4-spark_2.13-26.06.1-cuda12-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/26.06.1/rapids-4-spark_2.13-26.06.1-cuda12-arm64.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.13&lt;/artifactId&gt;<br/> &lt;version&gt;26.06.1&lt;/version&gt;<br/> &lt;classifier&gt;cuda12-arm64&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
73+
74+
75+
#### CUDA 13
76+
77+
| Processor | Scala Version | Download Jar | Download Signature | Download From Maven |
78+
|-----------|---------------|--------------|--------------------|---------------------|
79+
| x86_64 | Scala 2.12 | [RAPIDS Accelerator v26.06.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/26.06.1/rapids-4-spark_2.12-26.06.1-cuda13.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/26.06.1/rapids-4-spark_2.12-26.06.1-cuda13.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.12&lt;/artifactId&gt;<br/> &lt;version&gt;26.06.1&lt;/version&gt;<br/> &lt;classifier&gt;cuda13&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
80+
| x86_64 | Scala 2.13 | [RAPIDS Accelerator v26.06.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/26.06.1/rapids-4-spark_2.13-26.06.1-cuda13.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/26.06.1/rapids-4-spark_2.13-26.06.1-cuda13.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.13&lt;/artifactId&gt;<br/> &lt;version&gt;26.06.1&lt;/version&gt;<br/> &lt;classifier&gt;cuda13&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
81+
| arm64 | Scala 2.12 | [RAPIDS Accelerator v26.06.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/26.06.1/rapids-4-spark_2.12-26.06.1-cuda13-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/26.06.1/rapids-4-spark_2.12-26.06.1-cuda13-arm64.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.12&lt;/artifactId&gt;<br/> &lt;version&gt;26.06.1&lt;/version&gt;<br/> &lt;classifier&gt;cuda13-arm64&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
82+
| arm64 | Scala 2.13 | [RAPIDS Accelerator v26.06.1](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/26.06.1/rapids-4-spark_2.13-26.06.1-cuda13-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/26.06.1/rapids-4-spark_2.13-26.06.1-cuda13-arm64.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.13&lt;/artifactId&gt;<br/> &lt;version&gt;26.06.1&lt;/version&gt;<br/> &lt;classifier&gt;cuda13-arm64&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
83+
84+
85+
The above packages are built against CUDA 12.9 or CUDA 13.1. They are tested on V100, T4, A10, A100, L4, H100 and GB100 GPUs.
86+
87+
### Verify signature
88+
* Download the [PUB_KEY](https://keys.openpgp.org/search?q=sw-spark@nvidia.com).
89+
* Import the public key: `gpg --import PUB_KEY`
90+
* Verify the signature for Scala 2.12 jar:
91+
`gpg --verify rapids-4-spark_2.12-26.06.1.jar.asc rapids-4-spark_2.12-26.06.1.jar`
92+
* Verify the signature for Scala 2.13 jar:
93+
`gpg --verify rapids-4-spark_2.13-26.06.1.jar.asc rapids-4-spark_2.13-26.06.1.jar`
94+
95+
The output of signature verify:
96+
97+
gpg: Good signature from "NVIDIA Spark (For the signature of spark-rapids release jars) <sw-spark@nvidia.com>"
98+
99+
### Release Notes
100+
v26.06.1 is a hotfix release on top of v26.06.0 with the following fixes:
101+
* Use the configured `parquet.read.allocation.size` copy buffer for Hadoop vectored reads, restoring the 8 MiB default for S3A, GCS, and other Hadoop-backed filesystem fallbacks ([#15164](https://github.com/NVIDIA/cudf-spark/pull/15164))
102+
* Restore Databricks 17.3 build compatibility after the `SessionCatalog` partition-listing API change ([#15211](https://github.com/NVIDIA/cudf-spark/pull/15211))
103+
104+
The full v26.06.0 release notes are also included below.
105+
106+
v26.06.0 includes the following updates:
107+
* Databricks 17.3 ML LTS Delta Lake support now includes native deletion vector reads, Delta writes, DELETE, UPDATE, MERGE, OPTIMIZE, and auto compaction on GPU ([#14787](https://github.com/NVIDIA/cudf-spark/pull/14787), [#14716](https://github.com/NVIDIA/cudf-spark/pull/14716), [#14810](https://github.com/NVIDIA/cudf-spark/pull/14810), [#14820](https://github.com/NVIDIA/cudf-spark/pull/14820), [#14847](https://github.com/NVIDIA/cudf-spark/pull/14847))
108+
* Iceberg support adds nested and binary GPU writes, read-path optimizations, per-table scan-option overrides, and fixes for newly-added nested MAP/LIST fields ([#14611](https://github.com/NVIDIA/cudf-spark/pull/14611), [#14674](https://github.com/NVIDIA/cudf-spark/pull/14674), [#14754](https://github.com/NVIDIA/cudf-spark/pull/14754), [#14880](https://github.com/NVIDIA/cudf-spark/pull/14880))
109+
* Added GPU support for array aggregate SUM, PRODUCT, MAX, MIN, ALL, and ANY, plus additional string expression support for `replace(col, targetExpr, replExpr)` and GBK `StringDecode` ([#14652](https://github.com/NVIDIA/cudf-spark/pull/14652), [#14623](https://github.com/NVIDIA/cudf-spark/pull/14623), [#14545](https://github.com/NVIDIA/cudf-spark/pull/14545))
110+
* Improved expression performance for timestamp parsing, complex type casts, null handling, `hypot`, `format_number`, regex extract, and substring operations ([#14706](https://github.com/NVIDIA/cudf-spark/pull/14706), [#14842](https://github.com/NVIDIA/cudf-spark/pull/14842), [#14817](https://github.com/NVIDIA/cudf-spark/pull/14817), [#14818](https://github.com/NVIDIA/cudf-spark/pull/14818), [#14830](https://github.com/NVIDIA/cudf-spark/pull/14830), [#14586](https://github.com/NVIDIA/cudf-spark/pull/14586), [#14647](https://github.com/NVIDIA/cudf-spark/pull/14647), [#14819](https://github.com/NVIDIA/cudf-spark/pull/14819))
111+
* Improved retry and resource handling for GPU project execution, row-to-column transitions, asynchronous cloud output writes, and host column extraction ([#14724](https://github.com/NVIDIA/cudf-spark/pull/14724), [#14865](https://github.com/NVIDIA/cudf-spark/pull/14865), [#14759](https://github.com/NVIDIA/cudf-spark/pull/14759))
112+
* Fixed several query correctness and compatibility issues, including join conditions with casts, non-deterministic expression preservation, JSON/CSV path decoding, and row transitions for final AQE exchanges ([#14793](https://github.com/NVIDIA/cudf-spark/pull/14793), [#14792](https://github.com/NVIDIA/cudf-spark/pull/14792), [#14778](https://github.com/NVIDIA/cudf-spark/pull/14778), [#14914](https://github.com/NVIDIA/cudf-spark/pull/14914))
113+
114+
For a detailed list of changes, please refer to the
115+
[CHANGELOG](https://github.com/NVIDIA/cudf-spark/blob/main/CHANGELOG.md).
116+
8117
## Release v26.06.0
9118
### Hardware Requirements:
10119

0 commit comments

Comments
 (0)