We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 18e827d commit 57cfbcbCopy full SHA for 57cfbcb
README.md
@@ -38,7 +38,7 @@ python setup.py install
38
```python
39
from transformers import AutoModelForCausalLM
40
model = AutoModelForCausalLM.from_pretrained(
41
- 'decapoda-research/llama-7b-hf,
+ 'decapoda-research/llama-7b-hf',
42
device_map='auto',
43
load_in_8bit=True,
44
max_memory=f'{int(torch.cuda.mem_get_info()[0]/1024**3)-2}GB')
0 commit comments