@@ -38,24 +38,27 @@ Some features (especially fine-tuning with FSDP + PEFT) currently require PyTorc
38
38
### Installing
39
39
Llama-recipes provides a pip distribution for easy install and usage in other projects. Alternatively, it can be installed from source.
40
40
41
+ > [ !NOTE]
42
+ > Ensure you use the correct CUDA version (from ` nvidia-smi ` ) when installing the PyTorch wheels. Here we are using 11.8 as ` cu118 `
43
+
41
44
#### Install with pip
42
45
```
43
- pip install --extra-index-url https://download.pytorch.org/whl/test/ cu118 llama-recipes
46
+ pip install --extra-index-url https://download.pytorch.org/whl/cu118 llama-recipes
44
47
```
45
48
46
49
#### Install with optional dependencies
47
50
Llama-recipes offers the installation of optional packages. There are three optional dependency groups.
48
51
To run the unit tests we can install the required dependencies with:
49
52
```
50
- pip install --extra-index-url https://download.pytorch.org/whl/test/ cu118 llama-recipes[tests]
53
+ pip install --extra-index-url https://download.pytorch.org/whl/cu118 llama-recipes[tests]
51
54
```
52
55
For the vLLM example we need additional requirements that can be installed with:
53
56
```
54
- pip install --extra-index-url https://download.pytorch.org/whl/test/ cu118 llama-recipes[vllm]
57
+ pip install --extra-index-url https://download.pytorch.org/whl/cu118 llama-recipes[vllm]
55
58
```
56
59
To use the sensitive topics safety checker install with:
57
60
```
58
- pip install --extra-index-url https://download.pytorch.org/whl/test/ cu118 llama-recipes[auditnlg]
61
+ pip install --extra-index-url https://download.pytorch.org/whl/cu118 llama-recipes[auditnlg]
59
62
```
60
63
Optional dependencies can also be combines with [ option1,option2] .
61
64
@@ -65,14 +68,14 @@ To install from source e.g. for development use these commands. We're using hatc
65
68
git clone [email protected] :meta-llama/llama-recipes.git
66
69
cd llama-recipes
67
70
pip install -U pip setuptools
68
- pip install --extra-index-url https://download.pytorch.org/whl/test/ cu118 -e .
71
+ pip install --extra-index-url https://download.pytorch.org/whl/cu118 -e .
69
72
```
70
73
For development and contributing to llama-recipes please install all optional dependencies:
71
74
```
72
75
git clone [email protected] :meta-llama/llama-recipes.git
73
76
cd llama-recipes
74
77
pip install -U pip setuptools
75
- pip install --extra-index-url https://download.pytorch.org/whl/test/ cu118 -e .[tests,auditnlg,vllm]
78
+ pip install --extra-index-url https://download.pytorch.org/whl/cu118 -e .[tests,auditnlg,vllm]
76
79
```
77
80
78
81
0 commit comments