Skip to content

Commit aef93fe

Browse files
authored
[DOC] update for download page 2512 release [skip ci] (#14011)
update the download doc for 2512 release (same as #13984 13984) Signed-off-by: liyuan <yuali@nvidia.com> Signed-off-by: liyuan <yuali@nvidia.com>
1 parent 7e29d0c commit aef93fe

File tree

2 files changed

+107
-18
lines changed

2 files changed

+107
-18
lines changed

docs/archive.md

Lines changed: 91 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,97 @@ nav_order: 15
55
---
66
Below are archived releases for RAPIDS Accelerator for Apache Spark.
77

8+
## Release v25.10.0
9+
### Hardware Requirements:
10+
11+
The plugin is designed to work on NVIDIA Volta, Turing, Ampere, Ada Lovelace, Hopper and Blackwell generation datacenter GPUs. The plugin jar is tested on the following GPUs:
12+
13+
GPU Models: NVIDIA V100, T4, A10, A100, L4, H100 and B100 GPUs
14+
15+
### Software Requirements:
16+
17+
OS: Spark RAPIDS is compatible with any Linux distribution with glibc >= 2.28 (Please check ldd --version output). glibc 2.28 was released August 1, 2018.
18+
Tested on Ubuntu 22.04, Ubuntu 24.04, Rocky Linux 8 and Rocky Linux 9
19+
20+
NVIDIA Driver*: R525+
21+
22+
Runtime:
23+
Scala 2.12, 2.13
24+
Python, Java Virtual Machine (JVM) compatible with your spark-version.
25+
26+
* Check the Spark documentation for Python and Java version compatibility with your specific
27+
Spark version. For instance, visit `https://spark.apache.org/docs/3.4.1` for Spark 3.4.1.
28+
29+
Supported Spark versions:
30+
Apache Spark 3.2.0, 3.2.1, 3.2.2, 3.2.3, 3.2.4
31+
Apache Spark 3.3.0, 3.3.1, 3.3.2, 3.3.3, 3.3.4
32+
Apache Spark 3.4.0, 3.4.1, 3.4.2, 3.4.3, 3.4.4
33+
Apache Spark 3.5.0, 3.5.1, 3.5.2, 3.5.3, 3.5.4, 3.5.5, 3.5.6
34+
Apache Spark 4.0.0, 4.0.1
35+
36+
Supported Databricks runtime versions for Azure and AWS:
37+
Databricks 12.2 ML LTS (GPU, Scala 2.12, Spark 3.3.2)
38+
Databricks 13.3 ML LTS (GPU, Scala 2.12, Spark 3.4.1)
39+
Databricks 14.3 ML LTS (GPU, Scala 2.12, Spark 3.5.0)
40+
41+
Supported Dataproc versions (Debian/Ubuntu/Rocky):
42+
GCP Dataproc 2.1
43+
GCP Dataproc 2.2
44+
GCP Dataproc 2.3
45+
46+
Supported Dataproc Serverless versions:
47+
Spark runtime 1.1 LTS
48+
Spark runtime 1.2
49+
Spark runtime 2.0
50+
Spark runtime 2.1
51+
Spark runtime 2.2
52+
53+
*Some hardware may have a minimum driver version greater than R470. Check the GPU spec sheet
54+
for your hardware's minimum driver version.
55+
56+
*For Cloudera and EMR support, please refer to the
57+
[Distributions](https://docs.nvidia.com/spark-rapids/user-guide/latest/faq.html#which-distributions-are-supported) section of the FAQ.
58+
59+
### RAPIDS Accelerator's Support Policy for Apache Spark
60+
The RAPIDS Accelerator maintains support for Apache Spark versions available for download from [Apache Spark](https://spark.apache.org/downloads.html)
61+
62+
### Download RAPIDS Accelerator for Apache Spark v25.10.0
63+
64+
| Processor | Scala Version | Download Jar | Download Signature | Download From Maven |
65+
|-----------|---------------|--------------|--------------------|---------------------|
66+
| x86_64 | Scala 2.12 | [RAPIDS Accelerator v25.10.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.10.0/rapids-4-spark_2.12-25.10.0.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.10.0/rapids-4-spark_2.12-25.10.0.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.12&lt;/artifactId&gt;<br/> &lt;version&gt;25.10.0&lt;/version&gt;<br/>&lt;/dependency&gt;</pre> |
67+
| x86_64 | Scala 2.13 | [RAPIDS Accelerator v25.10.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.10.0/rapids-4-spark_2.13-25.10.0.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.10.0/rapids-4-spark_2.13-25.10.0.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.13&lt;/artifactId&gt;<br/> &lt;version&gt;25.10.0&lt;/version&gt;<br/>&lt;/dependency&gt;</pre> |
68+
| arm64 | Scala 2.12 | [RAPIDS Accelerator v25.10.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.10.0/rapids-4-spark_2.12-25.10.0-cuda12-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.10.0/rapids-4-spark_2.12-25.10.0-cuda12-arm64.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.12&lt;/artifactId&gt;<br/> &lt;version&gt;25.10.0&lt;/version&gt;<br/> &lt;classifier&gt;cuda12-arm64&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
69+
| arm64 | Scala 2.13 | [RAPIDS Accelerator v25.10.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.10.0/rapids-4-spark_2.13-25.10.0-cuda12-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.10.0/rapids-4-spark_2.13-25.10.0-cuda12-arm64.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.13&lt;/artifactId&gt;<br/> &lt;version&gt;25.10.0&lt;/version&gt;<br/> &lt;classifier&gt;cuda12-arm64&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
70+
71+
This package is built against CUDA 12.9. It is tested on V100, T4, A10, A100, L4, H100 and GB100 GPUs with
72+
CUDA 12.9.
73+
74+
### Verify signature
75+
* Download the [PUB_KEY](https://keys.openpgp.org/search?q=sw-spark@nvidia.com).
76+
* Import the public key: `gpg --import PUB_KEY`
77+
* Verify the signature for Scala 2.12 jar:
78+
`gpg --verify rapids-4-spark_2.12-25.10.0.jar.asc rapids-4-spark_2.12-25.10.0.jar`
79+
* Verify the signature for Scala 2.13 jar:
80+
`gpg --verify rapids-4-spark_2.13-25.10.0.jar.asc rapids-4-spark_2.13-25.10.0.jar`
81+
82+
The output of signature verify:
83+
84+
gpg: Good signature from "NVIDIA Spark (For the signature of spark-rapids release jars) <sw-spark@nvidia.com>"
85+
86+
### Release Notes
87+
* Delta Lake liquid clustering read/write/optimize support
88+
* Delta Lake optimize support
89+
* Delta Lake deletion vector support with two caveats: need to set `useMetadataRowIndex=false` and deletion vector support will fall back to the CPU when using the coalescing file reader (these limitations to be removed in a future release)
90+
* Iceberg insert operations support and improved write job statistics tracking
91+
* Improved performance for stddev and variance operations in hash based group by aggregations
92+
* Support for uuid
93+
* Added Spark 4.0.1 support
94+
* Added CUDA 13 support, in addition to CUDA 12 support.
95+
96+
Note: There is a known issue in the 25.10.0 release when decompressing gzip files on H100 GPUs.
97+
Please find more details in [issue-16661](https://github.com/rapidsai/cudf/issues/16661).
98+
899
## Release v25.08.0
9100
### Hardware Requirements:
10101

docs/download.md

Lines changed: 16 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ cuDF jar, that is either preinstalled in the Spark classpath on all nodes or sub
1818
that uses the RAPIDS Accelerator For Apache Spark. See the [getting-started
1919
guide](https://docs.nvidia.com/spark-rapids/user-guide/latest/getting-started/overview.html) for more details.
2020

21-
## Release v25.10.0
21+
## Release v25.12.0
2222
### Hardware Requirements:
2323

2424
The plugin is designed to work on NVIDIA Volta, Turing, Ampere, Ada Lovelace, Hopper and Blackwell generation datacenter GPUs. The plugin jar is tested on the following GPUs:
@@ -72,14 +72,14 @@ for your hardware's minimum driver version.
7272
### RAPIDS Accelerator's Support Policy for Apache Spark
7373
The RAPIDS Accelerator maintains support for Apache Spark versions available for download from [Apache Spark](https://spark.apache.org/downloads.html)
7474

75-
### Download RAPIDS Accelerator for Apache Spark v25.10.0
75+
### Download RAPIDS Accelerator for Apache Spark v25.12.0
7676

7777
| Processor | Scala Version | Download Jar | Download Signature | Download From Maven |
7878
|-----------|---------------|--------------|--------------------|---------------------|
79-
| x86_64 | Scala 2.12 | [RAPIDS Accelerator v25.10.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.10.0/rapids-4-spark_2.12-25.10.0.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.10.0/rapids-4-spark_2.12-25.10.0.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.12&lt;/artifactId&gt;<br/> &lt;version&gt;25.10.0&lt;/version&gt;<br/>&lt;/dependency&gt;</pre> |
80-
| x86_64 | Scala 2.13 | [RAPIDS Accelerator v25.10.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.10.0/rapids-4-spark_2.13-25.10.0.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.10.0/rapids-4-spark_2.13-25.10.0.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.13&lt;/artifactId&gt;<br/> &lt;version&gt;25.10.0&lt;/version&gt;<br/>&lt;/dependency&gt;</pre> |
81-
| arm64 | Scala 2.12 | [RAPIDS Accelerator v25.10.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.10.0/rapids-4-spark_2.12-25.10.0-cuda12-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.10.0/rapids-4-spark_2.12-25.10.0-cuda12-arm64.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.12&lt;/artifactId&gt;<br/> &lt;version&gt;25.10.0&lt;/version&gt;<br/> &lt;classifier&gt;cuda12-arm64&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
82-
| arm64 | Scala 2.13 | [RAPIDS Accelerator v25.10.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.10.0/rapids-4-spark_2.13-25.10.0-cuda12-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.10.0/rapids-4-spark_2.13-25.10.0-cuda12-arm64.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.13&lt;/artifactId&gt;<br/> &lt;version&gt;25.10.0&lt;/version&gt;<br/> &lt;classifier&gt;cuda12-arm64&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
79+
| x86_64 | Scala 2.12 | [RAPIDS Accelerator v25.12.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.12.0/rapids-4-spark_2.12-25.12.0.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.12.0/rapids-4-spark_2.12-25.12.0.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.12&lt;/artifactId&gt;<br/> &lt;version&gt;25.12.0&lt;/version&gt;<br/>&lt;/dependency&gt;</pre> |
80+
| x86_64 | Scala 2.13 | [RAPIDS Accelerator v25.12.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.12.0/rapids-4-spark_2.13-25.12.0.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.12.0/rapids-4-spark_2.13-25.12.0.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.13&lt;/artifactId&gt;<br/> &lt;version&gt;25.12.0&lt;/version&gt;<br/>&lt;/dependency&gt;</pre> |
81+
| arm64 | Scala 2.12 | [RAPIDS Accelerator v25.12.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.12.0/rapids-4-spark_2.12-25.12.0-cuda12-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/25.12.0/rapids-4-spark_2.12-25.12.0-cuda12-arm64.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.12&lt;/artifactId&gt;<br/> &lt;version&gt;25.12.0&lt;/version&gt;<br/> &lt;classifier&gt;cuda12-arm64&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
82+
| arm64 | Scala 2.13 | [RAPIDS Accelerator v25.12.0](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.12.0/rapids-4-spark_2.13-25.12.0-cuda12-arm64.jar) | [Signature](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.13/25.12.0/rapids-4-spark_2.13-25.12.0-cuda12-arm64.jar.asc) | <pre>&lt;dependency&gt;<br/> &lt;groupId&gt;com.nvidia&lt;/groupId&gt;<br/> &lt;artifactId&gt;rapids-4-spark_2.13&lt;/artifactId&gt;<br/> &lt;version&gt;25.12.0&lt;/version&gt;<br/> &lt;classifier&gt;cuda12-arm64&lt;/classifier&gt;<br/>&lt;/dependency&gt;</pre> |
8383

8484
This package is built against CUDA 12.9. It is tested on V100, T4, A10, A100, L4, H100 and GB100 GPUs with
8585
CUDA 12.9.
@@ -88,25 +88,23 @@ CUDA 12.9.
8888
* Download the [PUB_KEY](https://keys.openpgp.org/search?q=sw-spark@nvidia.com).
8989
* Import the public key: `gpg --import PUB_KEY`
9090
* Verify the signature for Scala 2.12 jar:
91-
`gpg --verify rapids-4-spark_2.12-25.10.0.jar.asc rapids-4-spark_2.12-25.10.0.jar`
91+
`gpg --verify rapids-4-spark_2.12-25.12.0.jar.asc rapids-4-spark_2.12-25.12.0.jar`
9292
* Verify the signature for Scala 2.13 jar:
93-
`gpg --verify rapids-4-spark_2.13-25.10.0.jar.asc rapids-4-spark_2.13-25.10.0.jar`
93+
`gpg --verify rapids-4-spark_2.13-25.12.0.jar.asc rapids-4-spark_2.13-25.12.0.jar`
9494

9595
The output of signature verify:
9696

9797
gpg: Good signature from "NVIDIA Spark (For the signature of spark-rapids release jars) <sw-spark@nvidia.com>"
9898

9999
### Release Notes
100-
* Delta Lake liquid clustering read/write/optimize support
101-
* Delta Lake optimize support
102-
* Delta Lake deletion vector support with two caveats: need to set `useMetadataRowIndex=false` and deletion vector support will fall back to the CPU when using the coalescing file reader (these limitations to be removed in a future release)
103-
* Iceberg insert operations support and improved write job statistics tracking
104-
* Improved performance for stddev and variance operations in hash based group by aggregations
105-
* Support for uuid
106-
* Added Spark 4.0.1 support
107-
* Added CUDA 13 support, in addition to CUDA 12 support.
108-
109-
Note: There is a known issue in the 25.10.0 release when decompressing gzip files on H100 GPUs.
100+
* Iceberg enhancements including DML operations (delete, update, merge) for merge-on-read tables, partition transforms (year/month/day/hour/truncate), and write operations enabled by default.
101+
* Delta Lake clustered tables DML support including update, merge, and delete operations with deletion vector enabled GPU by default.
102+
* Join improvements including support for left-outer joins with no columns, new join strategies with logging and heuristic configurations, and improved gather map ordering.
103+
* CSV support for GBK encoded data.
104+
* Refine GpuTaskMetrics over the spill framework.
105+
* Fix race condition due to premature disk handle exposure.
106+
107+
Note: There is a known issue in the 25.12.0 release when decompressing gzip files on H100 GPUs.
110108
Please find more details in [issue-16661](https://github.com/rapidsai/cudf/issues/16661).
111109

112110
For a detailed list of changes, please refer to the

0 commit comments

Comments
 (0)