Skip to content

Commit 662d181

Browse files
authored
Add NVIDIA library installs for DBR 13.0 (#93)
This just also adds a commented-out cell with the right NVIDIA lib installs for Databricks 13.0 ML
1 parent 905e58a commit 662d181

File tree

2 files changed

+31
-9
lines changed

2 files changed

+31
-9
lines changed

.gitignore

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,9 @@
11
.dbx/
22
venv/
33
.venv/
4+
.idea/
45
.python-version
56
__pycache__/
67
htmlcov/
78
.pytest_cache/
8-
.coverage
9+
.coverage

train_dolly.py

Lines changed: 29 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -29,14 +29,35 @@
2929

3030
# COMMAND ----------
3131

32-
# MAGIC !wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcusparse-dev-11-3_11.5.0.58-1_amd64.deb -O /tmp/libcusparse-dev-11-3_11.5.0.58-1_amd64.deb && \
33-
# MAGIC wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcublas-dev-11-3_11.5.1.109-1_amd64.deb -O /tmp/libcublas-dev-11-3_11.5.1.109-1_amd64.deb && \
34-
# MAGIC wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcusolver-dev-11-3_11.1.2.109-1_amd64.deb -O /tmp/libcusolver-dev-11-3_11.1.2.109-1_amd64.deb && \
35-
# MAGIC wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcurand-dev-11-3_10.2.4.109-1_amd64.deb -O /tmp/libcurand-dev-11-3_10.2.4.109-1_amd64.deb && \
36-
# MAGIC dpkg -i /tmp/libcusparse-dev-11-3_11.5.0.58-1_amd64.deb && \
37-
# MAGIC dpkg -i /tmp/libcublas-dev-11-3_11.5.1.109-1_amd64.deb && \
38-
# MAGIC dpkg -i /tmp/libcusolver-dev-11-3_11.1.2.109-1_amd64.deb && \
39-
# MAGIC dpkg -i /tmp/libcurand-dev-11-3_10.2.4.109-1_amd64.deb
32+
# MAGIC %md
33+
# MAGIC Install these additional NVIDIA libraries for Databricks Runtime 12.2 ML:
34+
35+
# COMMAND ----------
36+
37+
!wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcusparse-dev-11-3_11.5.0.58-1_amd64.deb -O /tmp/libcusparse-dev-11-3_11.5.0.58-1_amd64.deb && \
38+
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcublas-dev-11-3_11.5.1.109-1_amd64.deb -O /tmp/libcublas-dev-11-3_11.5.1.109-1_amd64.deb && \
39+
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcusolver-dev-11-3_11.1.2.109-1_amd64.deb -O /tmp/libcusolver-dev-11-3_11.1.2.109-1_amd64.deb && \
40+
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcurand-dev-11-3_10.2.4.109-1_amd64.deb -O /tmp/libcurand-dev-11-3_10.2.4.109-1_amd64.deb && \
41+
dpkg -i /tmp/libcusparse-dev-11-3_11.5.0.58-1_amd64.deb && \
42+
dpkg -i /tmp/libcublas-dev-11-3_11.5.1.109-1_amd64.deb && \
43+
dpkg -i /tmp/libcusolver-dev-11-3_11.1.2.109-1_amd64.deb && \
44+
dpkg -i /tmp/libcurand-dev-11-3_10.2.4.109-1_amd64.deb
45+
46+
# COMMAND ----------
47+
48+
# MAGIC %md
49+
# MAGIC Install these additional NVIDIA libraries for Databricks Runtime 13.0 ML (uncomment first):
50+
51+
# COMMAND ----------
52+
53+
#!wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcusparse-dev-11-7_11.7.3.50-1_amd64.deb -O /tmp/libcusparse-dev-11-7_11.7.3.50-1_amd64.deb && \
54+
# wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcublas-dev-11-7_11.10.1.25-1_amd64.deb -O /tmp/libcublas-dev-11-7_11.10.1.25-1_amd64.deb && \
55+
# wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcusolver-dev-11-7_11.4.0.1-1_amd64.deb -O /tmp/libcusolver-dev-11-7_11.4.0.1-1_amd64.deb && \
56+
# wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/libcurand-dev-11-7_10.2.10.91-1_amd64.deb -O /tmp/libcurand-dev-11-7_10.2.10.91-1_amd64.deb && \
57+
# dpkg -i /tmp/libcusparse-dev-11-7_11.7.3.50-1_amd64.deb && \
58+
# dpkg -i /tmp/libcublas-dev-11-7_11.10.1.25-1_amd64.deb && \
59+
# dpkg -i /tmp/libcusolver-dev-11-7_11.4.0.1-1_amd64.deb && \
60+
# dpkg -i /tmp/libcurand-dev-11-7_10.2.10.91-1_amd64.deb
4061

4162
# COMMAND ----------
4263

0 commit comments

Comments
 (0)