Skip to content
This repository was archived by the owner on Sep 10, 2025. It is now read-only.

Conversation

@Jack-Khuu
Copy link
Contributor

These are fields that were already supported in torchchat, but were simply suppressed in the help menu.

This just unsurpassed them

python3 torchchat.py generate --help

usage: torchchat generate [-h] [--checkpoint-path CHECKPOINT_PATH] [--params-path PARAMS_PATH]
                          [--tokenizer-path TOKENIZER_PATH] [--compile] [--compile-prefill]
                          [--dtype {fp32,fp16,bf16,float,half,float32,float16,bfloat16,fast,fast16}] [--quantize QUANTIZE]
                          [--device {fast,cpu,cuda,mps}] [--dso-path DSO_PATH | --pte-path PTE_PATH] [--prompt PROMPT]
                          [--num-samples NUM_SAMPLES] [--image-prompts IMAGE_PROMPTS [IMAGE_PROMPTS ...]]
                          [--max-new-tokens MAX_NEW_TOKENS] [--top-k TOP_K] [--temperature TEMPERATURE] [--max-autotune]
                          [--hf-token HF_TOKEN] [--model-directory MODEL_DIRECTORY] [-v] [--seed SEED]
                          [model]

options:
  -h, --help            show this help message and exit
  -v, --verbose         Verbose output
  --seed SEED           Initialize torch seed

Model Specification:
  A base model is required: `model` XOR `checkpoint-path`

  model                 Model name for well-known models
  --checkpoint-path CHECKPOINT_PATH
                        Use the specified model checkpoint path
  --params-path PARAMS_PATH
                        Use the specified parameter file, instead of one specified under torchchat.model_params
  --tokenizer-path TOKENIZER_PATH
                        Use the specified model tokenizer file, instead of the one downloaded from HuggingFace

...

@pytorch-bot
Copy link

pytorch-bot bot commented Sep 19, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchchat/1165

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 53140c8 with merge base 75b877a (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Sep 19, 2024
@Gasoonjia Gasoonjia merged commit 0f2849b into main Sep 19, 2024
51 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants