Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving llm-inference open-source-llm llama2 openllm llm-ops llama3-1 llama3-2 llama3-2-vision

• Updated Nov 9, 2026
• Python

Model Deployment at Scale on Kubernetes 🦄️

kubernetes machine-learning k8s model-deployment model-serving mlops bentoml

• Updated May 30, 2026
• TypeScript

All the available resources to master MLOPS from scratch

git docker django shape gradio automl dvc kubeflow azure-ml mlops mlflow aws-sagemaker fastapi bentoml streamlit pycaret zenml dagshub

• Updated May 7, 2024

Pybind11 bindings for Whisper.cpp

nix bazel python3 whisper pybind11 bentoml audio-transcription mlops-workflow whisper-cpp

• Updated Dec 8, 2024
• C++

BentoML Example Projects 🎨

data-science machine-learning gallery aws-lambda serverless machine-learning-library model-management azure-machine-learning model-deployment model-serving machine-learning-workflow gcp-cloud-functions aws-sagemaker bentoml

• Updated Jul 14, 2026

A simple web application that lets you replace any part of an image with an image generated based on your description.

python ai inpainting bentoml stable-diffusion huggingface-diffusers segment-anything

• Updated May 10, 2023
• Python

A simple yet complete guide to MLOps tools and practices - from a conventional way to a modern approach of working with ML projects.

best-practices ml cml dvc mlops bentoml

• Updated Sep 29, 2026
• Dockerfile

This repository contains instructions, template source code and examples on how to serve/deploy machine learning models using various frameworks and applications such as Docker, Flask, FastAPI, BentoML, Streamlit, MLflow and even code on how to deploy your machine learning model as an android app.

css heroku docker flask machine-learning html5 deployment actions webapp heroku-deployment dvc kivymd mlops mlflow fastapi bentoml streamlit

• Updated Feb 15, 2023
• CSS

Analyzes your GitHub Profile and presents you with a report on how likely you are to become the next MLH Fellow!

react python heroku flask firebase bentoml

• Updated Oct 1, 2021
• Jupyter Notebook

A bentoML-powered API to transcribe audio and make sense of it

nlp docker transformers torch speech-recognition openai pytube bentoml t5 bentoml-service openai-whisper

• Updated Dec 21, 2022
• Python

Serve Llama 3.3 70B (with AWQ quantization) using vLLM and deploy it on BentoCloud.

cloud mlops fastapi bentoml vllm llama3-3 bentocloud

• Updated Jan 27, 2025
• Python

My repo for the Machine Learning Engineering bootcamp 2022 by DataTalks.Club

python docker kubernetes machine-learning deep-learning aws-lambda deployment aws-ec2 tensorflow-serving machine-learning-engineering aws-fargate tflite bentoml kserve

• Updated Aug 8, 2023
• Jupyter Notebook

AladdinAI: open-source BYOI (Bring Your Own Infrastructure) AI Agent platform. Connect your own VMs, NVIDIA NIM, OpenAI, Anthropic, Ollama — build and manage AI agents visually.

open-source awesome typescript mongodb nextjs crm self-hosted multi-agent openai awesome-list ai-agents fastapi bentoml llm chatgpt-alternative ollama nvidia-nim cursor-alternative aladdin-ai aladdinai

• Updated Nov 12, 2026
• Python

MLOps Implementing "Brain Computer Interface" on Kubernetes

kubernetes machine-learning deep-learning signal-processing grafana gcp prometheus gke google-cloud-platform brain-computer-interface model-serving google-kubernetes-engine kubeflow mlops mlflow kubeflow-pipelines bentoml wandb weights-and-biases

• Updated Sep 30, 2022
• Python

Miscellaneous codes and writings for MLOps

docker kubernetes aws ai spark ai-as-a-service multimodal spark-nlp rag mlops apache-iceberg bentoml ml-serving vector-database triton-inference-server data-intensive-applications llm vectordb llm-inference llm-ops

• Updated Apr 8, 2026
• Jupyter Notebook

Generate novel text - novel finetuned from skt KoGPT2 base v2 - 한국어

nlp docker web deployment pytorch transformer korean fastai korean-text-processing korean-nlp finetune fine-tuning kubernates gpt2 huggingface bentoml kubernaut generate-text okteto kogpt2

• Updated Sep 16, 2022
• Jupyter Notebook

API serving for your diffusers models

model-deployment model-serving bentoml diffusers

• Updated Jan 19, 2024
• Python

End to End MLOps

neural-networks mlops mlflow tensorflow2 bentoml

• Updated Jan 22, 2021
• Python

🏛 ML Inference Pipeline for Legist

machine-learning huggingface bentoml

• Updated Feb 16, 2021
• Python

Deploying machine learning model using 10+ different deployment tools

kubernetes serverless-framework seldon mlops fastapi bentoml rayserve kserve mlserver

• Updated May 30, 2022
• Python