NVIDIA spark-rapids Q A · Discussions · GitHub

Welcome to spark-rapids Discussions!
General sameerz

Sort by: Latest activity

Q&A Discussions

Ask the community for help

You must be logged in to vote

Cache input data in GPU memory between consecutive queries

andygongyb asked Sep 8, 2025 in Q&A · Answered

2
You must be logged in to vote

Looking for feedback on my GPU-accelerated Spark pipeline

adil-faiyaz98 asked Jul 22, 2025 in Q&A · Closed · Answered

2
You must be logged in to vote

Can't achieve a significant performance/$ reduction on a benchmark.

MaxNevermind asked Jan 21, 2025 in Q&A · Unanswered

34
You must be logged in to vote

High CPU utlization with all query operators/stages GPU based.

MaxNevermind asked Jan 14, 2025 in Q&A · Answered

13
You must be logged in to vote

The ideal use-case for Spark-Rapids for the best performance/$ improvements.

MaxNevermind asked Jan 7, 2025 in Q&A · Answered

3
You must be logged in to vote

CPU OutOfMemory: could not split inputs and retry

SidWeng asked Sep 13, 2024 in Q&A · Unanswered

6
You must be logged in to vote

Understanding the non-cudf kernels in Nsight System Profling results

AsaMyth asked Dec 1, 2024 in Q&A · Closed · Answered

2
You must be logged in to vote

Using a certain number of GPUs for Spark on YARN

an-ys asked Oct 8, 2024 in Q&A · Answered

5
You must be logged in to vote

Spark RAPIDS tuning on Nvidia HGX

melvin-koh asked Sep 6, 2024 in Q&A · Unanswered

5
You must be logged in to vote

Spark RAPIDS takes a long time to initialise GPU memory

melvin-koh asked Sep 4, 2024 in Q&A · Closed · Answered

2
You must be logged in to vote

How do I set the rapids parameter so that all GPUs are used?

onefanwu asked Jul 12, 2024 in Q&A · Closed · Answered

7
You must be logged in to vote

Custom spark 3.5.0 image built with spark connect giving serialization error with rapids libs

kkdatta asked Mar 19, 2024 in Q&A · Answered

11
You must be logged in to vote

GPU Integration Challenges with Spark Rapids on Standalone Spark Clusters

reysand asked Jun 7, 2024 in Q&A · Closed · Answered

3
You must be logged in to vote

GPU not works with spark rapids

resyner asked Jun 7, 2024 in Q&A · Closed · Unanswered

0
You must be logged in to vote

[BUG] Unable to use Spark Rapids with Spark Thrift Server

LIN-Yu-Ting asked Nov 27, 2023 in Q&A · Answered

19
You must be logged in to vote

is there anyway to have the usecase of dynamic allocation with UCX mode in rapids shuffle manager?

kkdatta asked Mar 21, 2024 in Q&A · Unanswered

1
You must be logged in to vote

How do I handle "large" datasets in spark-rapids-ml benchmarks

an-ys asked Mar 8, 2024 in Q&A · Answered

4
You must be logged in to vote

Compatability with Databricks runtime 13.3 ML

carlosram17 asked Dec 22, 2023 in Q&A · Closed · Answered

2
You must be logged in to vote

What is the correct way of using only a certain number of GPUs?

an-ys asked Oct 13, 2023 in Q&A · Closed · Answered

4
You must be logged in to vote

Can CNN or RNN Deep learning models be implemented using spark-rapids-ml in Spark Rapids?

leehaoun asked Nov 20, 2023 in Q&A · Answered

2
You must be logged in to vote

Rapids Shuffle Manager on Anaconda3, Missing UCX library

leehaoun asked Nov 24, 2023 in Q&A · Unanswered

1
You must be logged in to vote

Blank Page on Storage Tab in UI for Spark Jobs

Nikhilpa1 asked Oct 20, 2023 in Q&A · Unanswered

1
You must be logged in to vote

how to print out GPUOverrides

jackie71111 asked Aug 25, 2023 in Q&A · Unanswered

12
You must be logged in to vote

Building Docker image to run Spark on Ray with RAPIDS

chenya-zhang asked Apr 9, 2023 in Q&A · Unanswered

22
You must be logged in to vote

Understanding UCX Shuffle Plugin

Nikhilpa1 asked Apr 23, 2023 in Q&A · Closed · Answered

2