You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/source/installation.mdx
+11-11Lines changed: 11 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -46,7 +46,7 @@ The library can be built using CUDA Toolkit versions as old as **11.8**.
46
46
> For the best results, a Turing generation device or newer is recommended.
47
47
48
48
49
-
####Installation via PyPI[[cuda-pip]]
49
+
### Installation via PyPI[[cuda-pip]]
50
50
51
51
This is the most straightforward and recommended installation option.
52
52
@@ -120,11 +120,11 @@ Big thanks to [wkpark](https://github.com/wkpark), [Jamezo97](https://github.com
120
120
</hfoption>
121
121
</hfoptions>
122
122
123
-
###Intel XPU[[xpu]]
123
+
## Intel XPU[[xpu]]
124
124
125
125
* A compatible PyTorch version with Intel XPU support is required. The current minimum is **PyTorch 2.6.0.**. It is recommended to use the latest stable release. See [Getting Started on Intel GPU](https://docs.pytorch.org/docs/stable/notes/get_start_xpu.html) for guidance.
126
126
127
-
####Installation via PyPI[[xpu-pip]]
127
+
### Installation via PyPI[[xpu-pip]]
128
128
129
129
This is the most straightforward and recommended installation option.
130
130
@@ -143,22 +143,22 @@ Use `pip` or `uv` to install the latest release:
143
143
pip install bitsandbytes
144
144
```
145
145
146
-
###Intel Gaudi[[gaudi]]
146
+
## Intel Gaudi[[gaudi]]
147
147
148
148
* A compatible PyTorch version with Intel Gaudi support is required. The current minimum is **Gaudi v1.21** with **PyTorch 2.6.0.**. It is recommended to use the latest stable release. See the Gaudi software [installation guide](https://docs.habana.ai/en/latest/Installation_Guide/index.html) for guidance.
149
149
150
150
151
-
####Installation from PyPI[[gaudi-pip]]
151
+
### Installation from PyPI[[gaudi-pip]]
152
152
153
153
Use `pip` or `uv` to install the latest release:
154
154
155
155
```bash
156
156
pip install bitsandbytes
157
157
```
158
158
159
-
###CPU[[cpu]]
159
+
## CPU[[cpu]]
160
160
161
-
####Installation from PyPI[[cpu-pip]]
161
+
### Installation from PyPI[[cpu-pip]]
162
162
163
163
This is the most straightforward and recommended installation option.
164
164
@@ -178,7 +178,7 @@ Use `pip` or `uv` to install the latest release:
178
178
pip install bitsandbytes
179
179
```
180
180
181
-
####Compile from Source[[cpu-compile]]
181
+
### Compile from Source[[cpu-compile]]
182
182
183
183
To compile from source, simply install the package from source using `pip`. The package will be built for CPU only at this time.
184
184
@@ -187,12 +187,12 @@ git clone https://github.com/bitsandbytes-foundation/bitsandbytes.git && cd bits
187
187
pip install -e .
188
188
```
189
189
190
-
###AMD ROCm (Preview)[[rocm]]
190
+
## AMD ROCm (Preview)[[rocm]]
191
191
192
192
* A compatible PyTorch version with AMD ROCm support is required. The current minimum is **Gaudi v1.21** with **PyTorch 2.6.0.**. It is recommended to use the latest stable release. See [PyTorch on ROCm](https://rocm.docs.amd.com/projects/install-on-linux/en/latest/install/3rd-party/pytorch-install.html) for guidance.
193
193
* ROCm support is currently only available in our preview wheels or when building from source.
194
194
195
-
####Preview Wheels from `main`[[rocm-preview]]
195
+
### Preview Wheels from `main`[[rocm-preview]]
196
196
197
197
The currently distributed preview `bitsandbytes` are built with the following configurations:
198
198
@@ -208,7 +208,7 @@ The currently distributed preview `bitsandbytes` are built with the following co
208
208
209
209
Please see [Preview Wheels](#preview-wheels) for installation instructions.
210
210
211
-
####Compile from Source[[rocm-compile]]
211
+
### Compile from Source[[rocm-compile]]
212
212
213
213
bitsandbytes can be compiled from ROCm 6.1 - ROCm 7.0.
0 commit comments