OpenGVLab

All

83 repositories

ScaleCUA
Public
ScaleCUA is the open-sourced computer use agents that can operate on corss-platform environments (Windows, macOS, Ubuntu, Android).
data models gui-agents computer-use-agents scalecua online-evaluation-suite
Python
•
Apache License 2.0
•0•5•0•0•Updated Sep 18, 2025Sep 18, 2025
GenExam
Public
GenExam: A Multidisciplinary Text-to-Image Exam
benchmark image-generation text-to-image-generation
Python
•
MIT License
•0•13•0•0•Updated Sep 18, 2025Sep 18, 2025
InternVL
Public
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
image-classification gpt multi-modal semantic-segmentation video-classification image-text-retrieval llm vision-language-model gpt-4v vit-6b
Python
•
MIT License
•708•9.2k•240•5•Updated Sep 5, 2025Sep 5, 2025
EgoExoLearn
Public
[CVPR 2024] Data and benchmark code for the EgoExoLearn dataset
Python
•
MIT License
•2•70•3•0•Updated Aug 26, 2025Aug 26, 2025
VideoChat-R1
Public
VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning
Python
•6•185•17•0•Updated Aug 18, 2025Aug 18, 2025
VRBench
Public
[ICCV 2025] A Benchmark for Multi-Step Reasoning in Long Narrative Videos
benchmark dataset video-understanding vlm evaluation-kit multi-step-reasoning video-reasoning llm
Python
•
Apache License 2.0
•0•17•0•0•Updated Aug 8, 2025Aug 8, 2025
InternVideo
Public
[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
benchmark action-recognition video-understanding video-data self-supervised multimodal video-dataset open-set-recognition video-retrieval video-question-answering
Python
•
Apache License 2.0
•126•2.1k•128•3•Updated Aug 7, 2025Aug 7, 2025
PIIP
Public
[NeurIPS 2024 Spotlight ⭐️ & TPAMI 2025] Parameter-Inverted Image Pyramid Networks (PIIP)
computer-vision image-classification object-detection semantic-segmentation instance-segmentation vision-transformer multimodal-large-language-models vision-language-models
Python
•
MIT License
•5•101•2•0•Updated Aug 5, 2025Aug 5, 2025
GUI-Odyssey
Public
[ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 episodes from 6 mobile devices, spanning 6 types of cross-app tasks, 212 apps, and 1.4K app combos.
Python
•6•128•9•0•Updated Aug 4, 2025Aug 4, 2025
LORIS
Public
[ICML2023] Long-Term Rhythmic Video Soundtracker
music-generation pytorch-implementation multi-modality diffusion-models aigc
Python
•
MIT License
•1•61•1•0•Updated Jul 28, 2025Jul 28, 2025
TPO
Public
Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
Jupyter Notebook
•1•60•1•0•Updated Jul 22, 2025Jul 22, 2025
Docopilot
Public
[CVPR 2025] Docopilot: Improving Multimodal Models for Document-Level Understanding
Python
•
MIT License
•1•33•2•0•Updated Jul 22, 2025Jul 22, 2025
Mono-InternVL
Public
[CVPR 2025] Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training
Python
•
MIT License
•0•85•6•0•Updated Jul 18, 2025Jul 18, 2025
ZeroGUI
Public
ZeroGUI: Automating Online GUI Learning at Zero Human Cost
Python
•
Apache License 2.0
•6•91•2•0•Updated Jul 17, 2025Jul 17, 2025
MUTR
Public
「AAAI 2024」 Referred by Multi-Modality: A Unified Temporal Transformers for Video Object Segmentation
Python
•
MIT License
•6•82•3•0•Updated Jun 13, 2025Jun 13, 2025
VideoChat-Flash
Public
VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling
Python
•
MIT License
•13•466•9•0•Updated Jun 13, 2025Jun 13, 2025
PVC
Public
[CVPR 2025] PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models
Python
•
MIT License
•0•47•4•0•Updated Jun 12, 2025Jun 12, 2025
FluxViT
Public
Make Your Training Flexible: Towards Deployment-Efficient Video Models
Python
•
MIT License
•0•29•1•0•Updated Jun 11, 2025Jun 11, 2025
VeBrain
Public
Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces
MIT License
•7•80•4•0•Updated Jun 6, 2025Jun 6, 2025
EfficientQAT
Public
[ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
Python
•22•302•9•0•Updated May 22, 2025May 22, 2025
OmniQuant
Public
[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
quantization large-language-models llm
Python
•
MIT License
•70•849•26•1•Updated May 22, 2025May 22, 2025
EgoVideo
Public
[CVPR 2024 Champions][ICLR 2025] Solutions for EgoVis Chanllenges in CVPR 2024
Jupyter Notebook
•4•129•9•0•Updated May 11, 2025May 11, 2025
OmniCorpus
Public
[ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
Python
•6•392•1•0•Updated May 5, 2025May 5, 2025
Diffree
Public
Diffree: Text-Guided Shape Free Object Inpainting with Diffusion Model
Python
•
Apache License 2.0
•14•239•3•0•Updated May 5, 2025May 5, 2025
PonderV2
Public
[T-PAMI 2025] PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm
3d-vision pretraining foundation-models
Python
•
MIT License
•9•359•2•0•Updated Apr 14, 2025Apr 14, 2025
TimeSuite
Public
[ICLR 2025] TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning
temporal-grounding long-video-understanding
Python
•
MIT License
•1•44•3•0•Updated Apr 7, 2025Apr 7, 2025
.github
Public
1•1•0•0•Updated Mar 28, 2025Mar 28, 2025
InternImage
Public
[CVPR 2023 Highlight] InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions
backbone semantic-segmentation deformable-convolution foundation-model object-detection
Python
•
MIT License
•255•2.7k•183•1•Updated Mar 25, 2025Mar 25, 2025
STM-Evaluation
Public
Python
•
MIT License
•6•72•1•0•Updated Mar 10, 2025Mar 10, 2025
VisionLLM
Public
VisionLLM Series
object-detection large-language-models generalist-model
Python
•
Apache License 2.0
•55•1.1k•17•0•Updated Feb 27, 2025Feb 27, 2025