2525 <img alt="HF Mid-Training Dataset Downloads" src="https://img.shields.io/badge/dynamic/json?url=https://huggingface.co/api/datasets/lmms-lab/LLaVA-One-Vision-1.5-Mid-Training-85M&query=downloads&label=Mid%20Training%20DATA%20Downloads&color=green&logo=huggingface&">
2626 </a >
2727 <!-- Instruct Dataset Downloads -->
28- <a href =" https://huggingface.co/datasets/lmms-lab/LLaVA-OneVision-1.5-Insturct -Data " >
29- <img alt="HF Instruct Dataset Downloads" src="https://img.shields.io/badge/dynamic/json?url=https://huggingface.co/api/datasets/lmms-lab/LLaVA-OneVision-1.5-Insturct -Data&query=downloads&label=Instruct%20DATA%20Downloads&color=blue&logo=huggingface&">
28+ <a href =" https://huggingface.co/datasets/lmms-lab/LLaVA-OneVision-1.5-Instruct -Data " >
29+ <img alt="HF Instruct Dataset Downloads" src="https://img.shields.io/badge/dynamic/json?url=https://huggingface.co/api/datasets/lmms-lab/LLaVA-OneVision-1.5-Instruct -Data&query=downloads&label=Instruct%20DATA%20Downloads&color=blue&logo=huggingface&">
3030 </a >
3131 <!-- Model Downloads -->
3232 <a href =" https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-8B-Instruct " >
@@ -114,8 +114,8 @@ Meticulously curated **pre-training and SFT data** with rigorous filtering and q
114114| --------------------------| --------------------------------------------------------------------------------------------------------| -------------|
115115| LLaVA-OV-1.5-4B-Instruct | [ 🤗 HF / 4B-Instruct] ( https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-4B-Instruct ) | [ 📈 Tensorboard] ( https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-4B-Instruct/tensorboard ) |
116116| LLaVA-OV-1.5-8B-Instruct | [ 🤗 HF / 8B-Instruct] ( https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-8B-Instruct ) | [ 📈 Tensorboard] ( https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-8B-Instruct/tensorboard ) |
117- | LLaVA-OV-1.5-4B-Base | [ 🤗 HF / 4B-Base] ( https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-4B-Base ) | [ 📈 Tensorboard] ( https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-8B -Instruct/tensorboard ) |
118- | LLaVA-OV-1.5-8B-Base | [ 🤗 HF / 8B-Base] ( https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-8B-Base ) | Uploading… |
117+ | LLaVA-OV-1.5-4B-Base | [ 🤗 HF / 4B-Base] ( https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-4B-Base ) | [ 📈 Tensorboard] ( https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-4B -Instruct/tensorboard ) |
118+ | LLaVA-OV-1.5-8B-Base | [ 🤗 HF / 8B-Base] ( https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-8B-Base ) | [ 📈 Tensorboard ] ( https://huggingface.co/lmms-lab/LLaVA-OneVision-1.5-8B-Instruct/tensorboard ) |
119119## Datasets
120120
121121![ Dataset Visualization] ( asset/dataset.jpg )
@@ -128,7 +128,7 @@ Meticulously curated **pre-training and SFT data** with rigorous filtering and q
128128| Description | Link | Status |
129129| --------------------| --------------------------------------------------------------------------------------------------------| -------------|
130130| LLaVA-OV-1.5-Mid-Training-85M | [ 🤗HF / Mid-Training 85M] ( https://huggingface.co/datasets/lmms-lab/LLaVA-One-Vision-1.5-Mid-Training-85M ) | Uploading… |
131- | LLaVA-OV-1.5-Instruct | [ 🤗HF / Insturct-Data] ( https://huggingface.co/datasets/lmms-lab/LLaVA-OneVision-1.5-Insturct -Data ) | Uploading… |
131+ | LLaVA-OV-1.5-Instruct | [ 🤗HF / Insturct-Data] ( https://huggingface.co/datasets/lmms-lab/LLaVA-OneVision-1.5-Instruct -Data ) | Uploading… |
132132
133133
134134## Evaluation Results
@@ -151,7 +151,7 @@ model = AutoModelForCausalLM.from_pretrained(
151151 model_path, torch_dtype = " auto" , device_map = " auto" , trust_remote_code = True
152152)
153153
154- # default processer
154+ # default processor
155155processor = AutoProcessor.from_pretrained(model_path, trust_remote_code = True )
156156
157157messages = [
0 commit comments