Skip to content

Commit 1c017ad

Browse files
committed
Update LLM instructions: add HF_HUB_OFFLINE = '1' in addition to TRANSFORMERS_OFFLINE = '1'
1 parent f9a99b2 commit 1c017ad

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

triton/apps/llms.rst

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -133,6 +133,7 @@ To access Huggingface models:
133133
134134
import os
135135
os.environ['TRANSFORMERS_OFFLINE'] = '1'
136+
os.environ['HF_HUB_OFFLINE'] = '1'
136137
os.environ['HF_HOME']='/scratch/shareddata/dldata/huggingface-hub-cache'
137138
138139
@@ -144,6 +145,7 @@ Here is a Python script using huggingface model.
144145
## !!!!!! NOTE: this must be in front of import transformers.
145146
import os
146147
os.environ['TRANSFORMERS_OFFLINE'] = '1'
148+
os.environ['HF_HUB_OFFLINE'] = '1'
147149
148150
from transformers import AutoModelForCausalLM, AutoTokenizer
149151

0 commit comments

Comments
 (0)