@@ -576,6 +576,50 @@ response = model.chat(tokenizer, pixel_values, question, generation_config)
576576
577577</details >
578578
579+ ## Chat Web Demo
580+
581+ <details >
582+ <summary >Launch a local chat demo (click to expand)</summary >
583+
584+ ** Launch a controller**
585+
586+ ``` shell
587+ # run the command in the `internvl_chat_llava` folder
588+ python -m llava.serve.controller --host 0.0.0.0 --port 10000
589+ ```
590+
591+ ** Launch a gradio web server**
592+
593+ ``` shell
594+ # run the command in the `internvl_chat_llava` folder
595+ python -m llava.serve.gradio_web_server --controller http://localhost:10000 --model-list-mode reload
596+ ```
597+
598+ ** Launch a model worker**
599+
600+ ``` shell
601+ # OpenGVLab/InternVL-Chat-ViT-6B-Vicuna-7B
602+ # run the command in the `internvl_chat_llava` folder
603+ python -m llava.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40000 --worker http://localhost:40000 --model-path ./path/to/InternVL-Chat-ViT-6B-Vicuna-7B
604+
605+ # OpenGVLab/InternVL-Chat-ViT-6B-Vicuna-13B
606+ # run the command in the `internvl_chat_llava` folder
607+ python -m llava.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40001 --worker http://localhost:40001 --model-path ./path/to/InternVL-Chat-ViT-6B-Vicuna-13B
608+
609+ # OpenGVLab/InternVL-Chat-Chinese-V1-1
610+ # run the command in the `internvl_chat` folder
611+ python -m internvl.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40002 --worker http://localhost:40002 --model-path ./path/to/InternVL-Chat-Chinese-V1-1
612+
613+ # OpenGVLab/InternVL-Chat-Chinese-V1-2
614+ # run the command in the `internvl_chat` folder
615+ python -m internvl.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40003 --worker http://localhost:40003 --model-path ./path/to/InternVL-Chat-Chinese-V1-2
616+
617+ # OpenGVLab/InternVL-Chat-Chinese-V1-2-Plus
618+ # run the command in the `internvl_chat` folder
619+ python -m internvl.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40004 --worker http://localhost:40004 --model-path ./path/to/InternVL-Chat-Chinese-V1-2-Plus
620+ ```
621+ </details >
622+
579623## Schedule
580624
581625- [x] Release high-resolution models
0 commit comments