awesome-production-machine-learning

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

View on GitHub

Awesome X

Awesome Production Machine Learning

This repository contains a curated list of awesome open source libraries that will help you deploy, monitor, version, scale, and secure your production machine learning 🚀

You can keep up to date by watching this github repo to get a summary of the new production ML libraries added every month via releases 🤩

Additionally, we provide a search toolkit that helps you quickly navigate through the toolchain.

     
🤖 Agentic Framework 🔧 AutoML 🗺️ Computation Load Distribution
🧮 Computation Optimisation 🏷️ Data Annotation & Synthesis 🧵 Data Pipeline
📓 Data Science Notebook 💾 Data Storage Optimisation 💸 Data Stream Processing
💪 Deployment & Serving 📈 Evaluation & Monitoring 🔍 Explainability & Fairness
🎁 Feature Store 🔴 Industry-strength Anomaly Detection 👁️ Industry-strength Computer Vision
🔥 Industry-strength Information Retrieval 🔠 Industry-strength Natural Language Processing 🙌 Industry-strength Recommender System
🍕 Industry-strength Reinforcement Learning 📊 Industry-strength Visualisation 📅 Metadata Management
📜 Model, Data & Experiment Management 🔩 Model Storage Optimisation 🔏 Privacy & Safety
🏁 Training Orchestration    

Contributing to the list

Please review our CONTRIBUTING.md requirements when submitting a PR to help us keep the list clean and up-to-date - thank you to the community for supporting its steady growth 🚀

Star History Chart

10 Min Video Overview

This 10 minute video provides an overview of the motivations for machine learning operations as well as a high level overview on some of the tools in this repo. This newer video covers the an updated 2024 version of the state of MLOps.

Want to receive recurrent updates on this repo and other advancements?

You can join the Machine Learning Engineer newsletter. Join over 10,000 ML professionals and enthusiasts who receive weekly curated articles & tutorials on production Machine Learning.
Also check out the Awesome Artificial Intelligence Regulation List, where we aim to map the landscape of "Frameworks", "Codes of Ethics", "Guidelines", "Regulations", etc related to Artificial Intelligence.

Main Content

Agentic Framework

AutoML

Computation Load Distribution

Computation Optimisation

Data Annotation and Synthesis

Data Pipeline

Data Science Notebook

Data Storage Optimisation

Data Stream Processing

Deployment and Serving

Evaluation and Monitoring

Explainability and Fairness

Feature Store

Industry-strength Anomaly Detection

Industry Strength Computer Vision

Industry Strength Information Retrieval

Industry Strength Natural Language Processing

Industry Strength Recommender System

Industry Strength Reinforcement Learning

Industry Strength Visualisation

Metadata Management

Model, Data and Experiment Management

Model Storage Optimisation

Privacy and Safety

Training Orchestration