-
Notifications
You must be signed in to change notification settings - Fork 77
Open
Description
from transformers import AutoTokenizer, AutoModelForCausalLM, AutoConfig, AutoModelForSequenceClassification
from jetmoe import JetMoEForCausalLM, JetMoEConfig, JetMoEForSequenceClassification
AutoConfig.register("jetmoe", JetMoEConfig)
AutoModelForCausalLM.register(JetMoEConfig, JetMoEForCausalLM)
AutoModelForSequenceClassification.register(JetMoEConfig, JetMoEForSequenceClassification)
tokenizer = AutoTokenizer.from_pretrained('jetmoe/jetmoe-8b')
model = AutoModelForCausalLM.from_pretrained('jetmoe/jetmoe-8b')
after I loaded them, how to use them?
and, I'm downloading lots of data, like 16GB of them? where do they stored? I could not find them after downloading in my venv environment, do I need redownload them each time?
Metadata
Metadata
Assignees
Labels
No labels