Repositories list

• BentoML

  Public
  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

  pythonmachine-learningdeep-learning+ 12model-servingmultimodalmlopsml-engineeringai-inferencellmgenerative-ai+ 5

  Python

  •

  Apache License 2.0

  •820•7.5k•158•3•Updated Mar 12, 2025Mar 12, 2025

• kantoku

  Public
  A Process & Socket Manager built with zmq

  Python

  •

  Other

  •258•1•0•0•Updated Mar 11, 2025Mar 11, 2025

• yatai-image-builder

  Public
  🐳 Build OCI images for Bentos in k8s

  dockerdocker-imagecontainer+ 3container-imagekubernetesk8s

  Go

  •10•17•6•9•Updated Mar 11, 2025Mar 11, 2025

• helm-charts

  Public
  0•1•0•0•Updated Mar 11, 2025Mar 11, 2025

• OpenLLM

  Public
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

  llamamistralfine-tuning+ 15mlopsbentomlvicunallmmodel-inferencellmopsllm-serving+ 8

  Python

  •

  Apache License 2.0

  •691•11k•0•0•Updated Mar 10, 2025Mar 10, 2025

• comfy-pack

  Public
  A comprehensive toolkit for reliably locking, packing and deploying environments for ComfyUI workflows.

  ai-artcomfyuigenai+ 4comfyui-managercomfyui-workflowcomfyui-nodescomfyui-api

  Python

  •

  Apache License 2.0

  •13•120•6•0•Updated Mar 10, 2025Mar 10, 2025

• openllm-models

  Public
  Python

  •12•35•0•0•Updated Mar 9, 2025Mar 9, 2025

• BentoVLLM

  Public
  Self-host LLMs with vLLM and BentoML

  Python

  •

  Apache License 2.0

  •15•92•0•0•Updated Mar 8, 2025Mar 8, 2025

• BentoMLflow

  Public
  Python

  •1•1•0•0•Updated Mar 8, 2025Mar 8, 2025

• bentocloud-homepage-news

  Public
  2•3•0•0•Updated Mar 6, 2025Mar 6, 2025

• BentoMLCLLM

  Public
  Python

  •1•3•0•0•Updated Mar 4, 2025Mar 4, 2025

• BentoXTTS

  Public
  how to build an text-to-speech application using BentoML

  Python

  •3•6•1•3•Updated Mar 3, 2025Mar 3, 2025

• BentoLangGraph

  Public
  Serving LangGraph Agent as REST API with BentoML, optionally with self-host open-source LLMs

  Python

  •3•7•0•1•Updated Feb 28, 2025Feb 28, 2025

• BentoXGBoost

  Public
  Python

  •2•0•0•0•Updated Feb 28, 2025Feb 28, 2025

• BentoShield

  Public
  Python

  •0•2•0•0•Updated Feb 27, 2025Feb 27, 2025

• yatai-common

  Public
  Go

  •5•2•0•2•Updated Feb 27, 2025Feb 27, 2025

• BentoFunctionCalling

  Public
  Python

  •1•5•0•1•Updated Feb 27, 2025Feb 27, 2025

• quickstart

  Public
  BentoML Quickstart Example

  Python

  •

  Apache License 2.0

  •5•8•0•0•Updated Feb 26, 2025Feb 26, 2025

• BentoCLIP

  Public
  building a CLIP application using BentoML

  Python

  •2•10•0•2•Updated Feb 26, 2025Feb 26, 2025

• BentoDiffusion

  Public
  BentoDiffusion: A collection of diffusion models served with BentoML

  kubernetesailora+ 4model-servingfine-tuningdiffusion-modelsstable-diffusion

  Python

  •

  Apache License 2.0

  •29•357•9•0•Updated Feb 25, 2025Feb 25, 2025

• BentoWhisperX

  Public
  Python

  •5•12•1•8•Updated Feb 18, 2025Feb 18, 2025

• BentoSGLang

  Public
  Python

  •1•2•0•0•Updated Feb 14, 2025Feb 14, 2025

• BentoOCR

  Public
  Turn any OCR models into online inference API endpoint 🚀 🌖

  ocrmodel-deploymentmodel-serving+ 2ocr-pythonai-applications

  Python

  •3•54•1•0•Updated Feb 12, 2025Feb 12, 2025

• BentoXTTSStreaming

  Public
  xtts with streaming endpoint

  Python

  •1•5•1•1•Updated Feb 11, 2025Feb 11, 2025

• LLMGateway

  Public
  Python

  •0•2•0•1•Updated Feb 11, 2025Feb 11, 2025

• BentoResnet

  Public
  Python

  •3•5•0•1•Updated Feb 11, 2025Feb 11, 2025

• BentoChatTTS

  Public
  Python

  •1•25•0•1•Updated Feb 11, 2025Feb 11, 2025

• BentoTGI

  Public
  Python

  •1•2•0•1•Updated Feb 11, 2025Feb 11, 2025

• BentoBLIP

  Public
  how to build an image captioning application on top of a BLIP model with BentoML

  Python

  •2•4•0•2•Updated Feb 1, 2025Feb 1, 2025

• BentoTwilioConversationRelay

  Public
  Python

  •2•7•1•1•Updated Jan 27, 2025Jan 27, 2025