Skip to content
@mbzuai-oryx

ORYX

A Library for Large Vision-Language Models

Popular repositories Loading

  1. Video-ChatGPT Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted fo…

    Python 1.3k 111

  2. Awesome-LLM-Post-training Awesome-LLM-Post-training Public

    Awesome Reasoning LLM Tutorial/Survey/Guide

    Python 1.2k 79

  3. groundingLMM groundingLMM Public

    [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

    Python 856 45

  4. LLaVA-pp LLaVA-pp Public

    🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

    Python 836 62

  5. MobiLlama MobiLlama Public

    MobiLlama : Small Language Model tailored for edge devices

    Python 628 48

  6. GeoChat GeoChat Public

    [CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

    Python 545 47

Repositories

Showing 10 of 28 repositories
  • VideoGPT-plus Public

    Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding

    Python 264 CC-BY-4.0 17 16 1 Updated Mar 29, 2025
  • Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

    Python 1,324 CC-BY-4.0 111 22 0 Updated Mar 29, 2025
  • VideoGLaMM Public

    [CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

    Python 52 1 3 0 Updated Mar 29, 2025
  • Awesome-LLM-Post-training Public

    Awesome Reasoning LLM Tutorial/Survey/Guide

    Python 1,223 79 0 0 Updated Mar 29, 2025
  • GeoPixel Public

    GeoPixel: A Pixel Grounding Large Multimodal Model for Remote Sensing is specifically developed for high-resolution remote sensing image analysis, offering advanced multi-target pixel grounding capabilities.

    Python 73 Apache-2.0 2 3 0 Updated Mar 26, 2025
  • LLMVoX Public

    LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLM

    Python 226 24 2 1 Updated Mar 20, 2025
  • KITAB-Bench Public

    A Comprehensive Multi-Domain Benchmark for Arabic OCR and Document Understanding

    Python 32 MIT 0 0 0 Updated Mar 20, 2025
  • Python 5 1 0 0 Updated Mar 17, 2025
  • TimeTravel Public

    Time Travel is a Comprehensive Benchmark to Evaluate LMMs on Historical and Cultural Artifacts

    Python 17 MIT 0 0 0 Updated Mar 16, 2025
  • DriveLMM-o1 Public

    Reasoning DriveLMM

    Python 3 0 0 0 Updated Mar 15, 2025