You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/source/installation.mdx
+32-1Lines changed: 32 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
3
3
Welcome to the installation guide for the `bitsandbytes` library! This document provides step-by-step instructions to install `bitsandbytes` across various platforms and hardware configurations.
4
4
5
-
We provide official support for NVIDIA GPUs, CPUs, Intel XPUs, and Intel Gaudi platforms. We also have experimental support for
5
+
We provide official support for NVIDIA GPUs, CPUs, Intel XPUs, Intel Gaudi, and Ascend NPU platforms. We also have experimental support for
6
6
additional platforms such as AMD ROCm.
7
7
8
8
## Table of Contents
@@ -15,6 +15,8 @@ additional platforms such as AMD ROCm.
15
15
-[Installation via PyPI](#xpu-pip)
16
16
-[Intel Gaudi](#gaudi)
17
17
-[Installation via PyPI](#gaudi-pip)
18
+
-[Ascend NPU](#npu)
19
+
-[Compile from Source](#npu-compile)
18
20
-[CPU](#cpu)
19
21
-[Installation via PyPI](#cpu-pip)
20
22
-[Compile from Source](#cpu-compile)
@@ -156,6 +158,35 @@ Use `pip` or `uv` to install the latest release:
156
158
pip install bitsandbytes
157
159
```
158
160
161
+
## Ascend NPU[[npu]]
162
+
163
+
Please refer to [the official Ascend installations instructions](https://www.hiascend.com/document/detail/zh/Pytorch/60RC3/configandinstg/instg/insg_0001.html) for guidance on how to install the necessary `torch_npu` dependency.
164
+
165
+
### Compile from Source[[npu-compile]]
166
+
167
+
> [!WARNING]
168
+
> Before building on Ascend NPU:
169
+
>
170
+
> Make sure to source the CANN environment script (adjust path based on your installation):
> CANN toolkit can be downloaded from: [https://www.hiascend.com/zh/developer/download/community/result?module=cann](https://www.hiascend.com/zh/developer/download/community/result?module=cann)
177
+
178
+
```bash
179
+
# Install bitsandbytes from source
180
+
# Clone bitsandbytes repo, Ascend NPU backend is currently enabled on main branch
0 commit comments