Repositories list

• OmniEvalKit

  Public
  OmniEvalkit: A Unified Omni Evaluation Framework

  evaluation-frameworkmultimodalomnievalkit

  evaluation-frameworkmultimodalomnievalkit

  Python

  •00 forks•11 star•00 issues•00 pull requests•Updated Aug 1, 2026Aug 1, 2026

• CoME-VL

  Public
  CoME-VL: Scaling Complementary Multi-Encoder Vision-Language Learning

  groundingunified-modelentropy-analysis+ 4

  groundingunified-modelentropy-analysisvlmsmolmounified-multimodal-modelsmolmo2

  Python

  •

  Apache License 2.0

  •11 fork•1313 stars•00 issues•00 pull requests•Updated Aug 1, 2026Aug 1, 2026

• Awesome-LLM-Post-training

  Public
  Awesome Reasoning LLM Tutorial/Survey/Guide

  reinforcement-learningscalingreasoning+ 3

  reinforcement-learningscalingreasoningfinepost-traininglarge-language-models

  Python

  •163163 forks•2.5k2.5k stars•77 issues•33 pull requests•Updated Jul 27, 2026Jul 27, 2026

• OpenEarthAgent

  Public
  [ECCV 2026 🔥] OpenEarthAgent is a unified framework for tool-augmented geospatial agents.

  Python

  •1111 forks•9191 stars•66 issues•00 pull requests•Updated Jul 9, 2026Jul 9, 2026

• VISE

  Public
  [ECCV 2026 🔥] Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Models

  Python

  •

  Apache License 2.0

  •00 forks•1212 stars•11 issue•00 pull requests•Updated Jun 26, 2026Jun 26, 2026

• Ask-Solve-Generate

  Public
  Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards

  Python

  •

  Apache License 2.0

  •00 forks•44 stars•00 issues•00 pull requests•Updated Jun 26, 2026Jun 26, 2026

• LongShOT

  Public
  A Benchmark and Agentic Framework for Omni-Modal Reasoning and Tool Use in Long Videos

  Python

  •00 forks•2222 stars•00 issues•00 pull requests•Updated Jun 20, 2026Jun 20, 2026

• Video-CoM

  Public
  Video-CoM: Interactive Video Reasoning via Chain of Manipulations

  Python

  •

  Apache License 2.0

  •00 forks•2222 stars•22 issues•00 pull requests•Updated Jun 17, 2026Jun 17, 2026

• TimeAwareMRI

  Public
  Apache License 2.0

  •00 forks•00 stars•00 issues•00 pull requests•Updated Jun 11, 2026Jun 11, 2026

• EvoLMM

  Public
  Self Evolving Large Multimodal Models with Continuous Rewards

  Python

  •22 forks•2626 stars•11 issue•00 pull requests•Updated Jun 9, 2026Jun 9, 2026

• CoVR-R

  Public
  Reasoning Aware Composed Video Retrieval

  covrcomposed-video-retrievallarge-multimodal-models+ 2

  covrcomposed-video-retrievallarge-multimodal-modelswebvid-covrdense-webvid-covr

  Python

  •

  Apache License 2.0

  •00 forks•77 stars•11 issue•00 pull requests•Updated Jun 9, 2026Jun 9, 2026

• ThinkGeo

  Public
  [CVPR 2026 🔥] ThinkGeo is a Comprehensive Benchmark to evaluate Tool-Augmented Agents for Remote Sensing Tasks

  Python

  •

  Apache License 2.0

  •55 forks•8383 stars•44 issues•00 pull requests•Updated May 29, 2026May 29, 2026

• GeoPixel

  Public
  GeoPixel: A Pixel Grounding Large Multimodal Model for Remote Sensing is specifically developed for high-resolution remote sensing image analysis, offering adva…

  remote-sensingsegmentation-modelsfoundation-models+ 4

  remote-sensingsegmentation-modelsfoundation-modelslarge-vision-language-modelslarge-multimodal-modelsvision-language-modelsgrounding-llms

  Python

  •

  Apache License 2.0

  •2121 forks•151151 stars•1111 issues•00 pull requests•Updated May 11, 2026May 11, 2026

• VideoMathQA

  Public
  VideoMathQA is a benchmark designed to evaluate mathematical reasoning in real-world educational videos

  11 fork•2424 stars•11 issue•00 pull requests•Updated May 7, 2026May 7, 2026

• Agent-X

  Public
  ICLR 2026: Agent-X Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks

  benchmarkingvisionreasoning+ 4

  benchmarkingvisionreasoningvfmfoundation-modelsllms-benchmarkingagentic-ai

  Jupyter Notebook

  •55 forks•4343 stars•55 issues•00 pull requests•Updated Apr 28, 2026Apr 28, 2026

• MediX-R1

  Public
  Open Ended Medical Reinforcement Learning

  medical-vqamedical-vision-language-modelgrpo+ 6

  medical-vqamedical-vision-language-modelgrpodapomedical-reinforcement-learningopen-ended-medical-reasoningopen-ended-reinforcement-learningopen-ended-rlmedical-rl

  Python

  •44 forks•6565 stars•00 issues•00 pull requests•Updated Mar 15, 2026Mar 15, 2026

• NestEO

  Public
  NestEO: Nested and Aligned Earth Observation Framework with Multimodal Dataset

  Jupyter Notebook

  •

  Apache License 2.0

  •00 forks•77 stars•00 issues•00 pull requests•Updated Mar 8, 2026Mar 8, 2026

• DuwatBench

  Public
  [EACL Accepted 🔥🔥] DuwatBench: A Benchmark for Arabic Calligraphy Understanding 🖋️📜

  Python

  •

  Apache License 2.0

  •11 fork•55 stars•00 issues•00 pull requests•Updated Jan 28, 2026Jan 28, 2026

• Video-R2

  Public
  Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models

  Python

  •22 forks•1919 stars•00 issues•00 pull requests•Updated Jan 21, 2026Jan 21, 2026

• UniMed-CLIP

  Public
  Official repository of paper titled "UniMed-CLIP: Towards a Unified Image-Text Pretraining Paradigm for Diverse Medical Imaging Modalities".

  Python

  •

  Other

  •1818 forks•172172 stars•44 issues•00 pull requests•Updated Jan 19, 2026Jan 19, 2026

• FoMER-Bench

  Public
  Python

  •

  Apache License 2.0

  •00 forks•33 stars•00 issues•00 pull requests•Updated Nov 6, 2025Nov 6, 2025

• BiMediX2

  Public
  Bio-Medical EXpert LMM with English and Arabic Language Capabilities

  medical-imagingmllmvision-language-model+ 2

  medical-imagingmllmvision-language-modelmedical-vision-language-modelmedical-benchmarking

  Python

  •88 forks•7474 stars•00 issues•00 pull requests•Updated Oct 23, 2025Oct 23, 2025

• ViMUL

  Public
  Apache License 2.0

  •00 forks•00 stars•11 issue•00 pull requests•Updated Sep 6, 2025Sep 6, 2025

• MIRA

  Public
  [ACM MM 2025 🔥🔥 ] MIRA: A first-of-its-kind medical RAG framework that fuses image features and retrieved knowledge with dynamic context control to boost factua…

  Python

  •

  Apache License 2.0

  •11 fork•2323 stars•22 issues•00 pull requests•Updated Aug 28, 2025Aug 28, 2025

• FannOrFlop

  Public
  [EMNLP 2025 🔥] A Multigenre, Multiera Benchmark for Arabic Poetry Understanding in LLMs

  poetryarabicllm

  poetryarabicllm

  Python

  •

  Apache License 2.0

  •11 fork•66 stars•00 issues•00 pull requests•Updated Aug 21, 2025Aug 21, 2025

• Video-LLaVA

  Public
  PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models

  videotranscriptionlmm+ 4

  videotranscriptionlmmgroundingvideo-groundingllmvideo-conversation

  Python

  •1212 forks•264264 stars•1515 issues•00 pull requests•Updated Aug 5, 2025Aug 5, 2025

• PALO

  Public
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, Bengali and Urdu.

  Python

  •

  Apache License 2.0

  •77 forks•8585 stars•55 issues•11 pull request•Updated Aug 5, 2025Aug 5, 2025

• groundingLMM

  Public
  [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integra…

  vision-and-languagelmmfoundation-models+ 2

  vision-and-languagelmmfoundation-modelsvision-language-modelllm-agent

  Python

  •

  Apache License 2.0

  •5555 forks•965965 stars•3636 issues•11 pull request•Updated Aug 5, 2025Aug 5, 2025

• LLaVA-pp

  Public
  🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

  conversationlmmsvision-language+ 14

  conversationlmmsvision-languagellmllavallama3phi3llava-llama3llava-phi3llama3-llava+ 7

  Python

  •5858 forks•842842 stars•1717 issues•22 pull requests•Updated Aug 5, 2025Aug 5, 2025

• VideoGPT-plus

  Public
  Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding

  chatbotclipimage-encoder+ 13

  chatbotclipimage-encodervideo-encodermultimodaldual-encodervision-languagevicunagpt4vision-language-pretraining+ 6

  Python

  •

  Creative Commons Attribution 4.0 International

  •1919 forks•293293 stars•1616 issues•00 pull requests•Updated Aug 5, 2025Aug 5, 2025