|
1 | | -# <img width="60" alt="image" src="https://github.com/OpenGVLab/InternVL/assets/8529570/5aa4cda8-b453-40a0-9336-17012b430ae8"> InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks —— An Open-Source Alternative to ViT-22B |
| 1 | +# <img width="60" alt="image" src="https://github.com/OpenGVLab/InternVL/assets/8529570/5aa4cda8-b453-40a0-9336-17012b430ae8"> InternVL Family: Closing the Gap to Commercial Multimodal Models with Open-Source Suites —— A Pioneering Open-Source Alternative to GPT-4V |
2 | 2 |
|
3 | | -\[[Update Blog](./BLOG.md)\] \[[Paper](https://arxiv.org/abs/2312.14238)\] \[[Chat Demo](https://internvl.opengvlab.com/)\] \[[Quick Start](#quick-start-with-huggingface)\] \[[中文解读](https://zhuanlan.zhihu.com/p/675877376)\] |
| 3 | +\[[Update Blog](./BLOG.md)\] \[[Paper](https://arxiv.org/abs/2312.14238)\] \[[InternVL 1.5 Technical Report](https://arxiv.org/abs/2404.16821)\] \[[Chat Demo](https://internvl.opengvlab.com/)\] \[[Quick Start](#quick-start-with-huggingface)\] \[[中文解读](https://zhuanlan.zhihu.com/p/675877376)\] |
4 | 4 |
|
5 | 5 | ## News🚀🚀🚀 |
6 | 6 |
|
|
17 | 17 |
|
18 | 18 | ## Compared with SOTA VLLMs |
19 | 19 |
|
20 | | -<img width="900" alt="image" src="https://github.com/OpenGVLab/InternVL/assets/23737120/519f3edb-951a-4ddb-9ace-31add081faad"> |
21 | | - |
22 | | -<br> |
23 | | -<br> |
24 | | - |
25 | | -<img width="1229" alt="image" src="https://github.com/OpenGVLab/InternVL/assets/23737120/dd43bb52-2fb2-4532-b9b9-c33761437ca9"> |
| 20 | +<img width="1229" alt="image" src="https://github.com/OpenGVLab/InternVL/assets/23737120/e9065a58-86fa-47ef-be9a-eb734532e73f"> |
26 | 21 |
|
27 | 22 | ## What is InternVL? |
28 | 23 |
|
@@ -599,24 +594,30 @@ response = model.chat(tokenizer, pixel_values, question, generation_config) |
599 | 594 | ```shell |
600 | 595 | # OpenGVLab/InternVL-Chat-ViT-6B-Vicuna-7B |
601 | 596 | # run the command in the `internvl_chat_llava` folder |
602 | | - python -m llava.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40000 --worker http://localhost:40000 --model-path ./path/to/InternVL-Chat-ViT-6B-Vicuna-7B |
| 597 | + python -m llava.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40000 --worker http://localhost:40000 --model-path OpenGVLab/InternVL-Chat-ViT-6B-Vicuna-7B |
603 | 598 |
|
604 | 599 | # OpenGVLab/InternVL-Chat-ViT-6B-Vicuna-13B |
605 | 600 | # run the command in the `internvl_chat_llava` folder |
606 | | - python -m llava.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40001 --worker http://localhost:40001 --model-path ./path/to/InternVL-Chat-ViT-6B-Vicuna-13B |
| 601 | + python -m llava.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40001 --worker http://localhost:40001 --model-path OpenGVLab/InternVL-Chat-ViT-6B-Vicuna-13B |
607 | 602 |
|
608 | 603 | # OpenGVLab/InternVL-Chat-V1-1 |
609 | 604 | # run the command in the `internvl_chat` folder |
610 | | - python -m internvl.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40002 --worker http://localhost:40002 --model-path ./path/to/InternVL-Chat-V1-1 |
| 605 | + python -m internvl.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40002 --worker http://localhost:40002 --model-path OpenGVLab/InternVL-Chat-V1-1 |
611 | 606 |
|
612 | 607 | # OpenGVLab/InternVL-Chat-V1-2 |
613 | 608 | # run the command in the `internvl_chat` folder |
614 | | - python -m internvl.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40003 --worker http://localhost:40003 --model-path ./path/to/InternVL-Chat-V1-2 |
| 609 | + python -m internvl.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40003 --worker http://localhost:40003 --model-path OpenGVLab/InternVL-Chat-V1-2 |
615 | 610 |
|
616 | 611 | # OpenGVLab/InternVL-Chat-V1-2-Plus |
617 | 612 | # run the command in the `internvl_chat` folder |
618 | | - python -m internvl.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40004 --worker http://localhost:40004 --model-path ./path/to/InternVL-Chat-V1-2-Plus |
619 | | - ``` |
| 613 | + python -m internvl.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40004 --worker http://localhost:40004 --model-path OpenGVLab/InternVL-Chat-V1-2-Plus |
| 614 | + |
| 615 | + # OpenGVLab/InternVL-Chat-V1-5 |
| 616 | + # run the command in the `internvl_chat` folder |
| 617 | + python -m internvl.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40005 --worker http://localhost:40005 --model-path OpenGVLab/InternVL-Chat-V1-5 |
| 618 | +``` |
| 619 | + |
| 620 | + |
620 | 621 | </details> |
621 | 622 |
|
622 | 623 | ## Schedule |
|
0 commit comments