- AIDE is an open-source ML engineering agent that uses a tree search algorithm to autonomously explore, implement, and evaluate solution strategies for machine learning tasks.
- Automated feature, model, and hyperparameter selection for tabular, image, and text data on top of popular machine learning libraries (Scikit-Learn, LightGBM, CatBoost, PyTorch, MXNet).
- AutoML library for Keras based on 
- Framework to automate algorithm and hyperparameter tuning for sklearn.
- Ax is an accessible, general-purpose platform for understanding, managing, deploying, and automating adaptive experiments.
- BoTorch is a library for Bayesian Optimization built on PyTorch.
- EvalML is an AutoML library which builds, optimizes, and evaluates machine learning pipelines using domain-specific objective functions.
- Feature-engine is a Python library that contains several transformers to engineer features for use in machine learning models.
- An open source framework for automated feature engineering.
- FLAML is a fast library for automated machine learning & tuning.
- Set of open-source hyperparameter optimization frameworks, including the winning submission to the 
- A Kubernetes-based system for Hyperparameter Tuning and Neural Architecture Search.
- Keras Tuner is an easy-to-use, distributable hyperparameter optimisation framework that solves the pain points of performing a hyperparameter search. Keras Tuner makes it easy to define a search space and leverage included algorithms to find the best hyperparameter values.
- Optuna is an automatic hyperparameter optimisation software framework, particularly designed for machine learning.
- OSS Vizier is a Python-based service for black-box optimisation and research, one of the first hyperparameter tuning services designed to work at scale.
- A gradient boosting machine that doesn't need hyperparameter optimization, with a simple budget parameter to control model complexity.
- Automation of sklearn pipeline creation (including feature selection, pre-processor, etc.).
- Automatic extraction of relevant features from time series.
- Accelerate abstracts exactly and only the boilerplate code related to multi-GPU/TPU/mixed-precision and leaves the rest of your code unchanged.
- Adapters is a unified library for parameter-efficient and modular transfer learning.
- Cache-DiT is built on top of Diffusers and supports nearly all DiTs, providing hybrid cache acceleration (DBCache, TaylorSeer, SCM, etc.) and comprehensive parallelism optimizations including Context Parallelism, Tensor Parallelism, and hybrid 2D/3D parallelism, with compatibility for compilation, CPU offloading, and quantization.
- A unified deep learning system for big model era, which helps users to efficiently and quickly deploy large AI model training and inference.
- Composer is a PyTorch library that enables you to train neural networks faster, at lower cost, and to higher accuracy.
- Built based on the Apache Arrow columnar memory format, cuDF is a GPU DataFrame library for loading, joining, aggregating, filtering, and otherwise manipulating data.
- cuML is a suite of libraries that implement machine learning algorithms and mathematical primitives functions that share compatible APIs with other RAPIDS projects.
- An implementation of NumPy-compatible multi-dimensional array on CUDA. CuPy consists of the core multi-dimensional array class, cupy.ndarray, and many functions on it.
- A novel evolutionary computation framework for rapid prototyping and testing of ideas. It seeks to make algorithms explicit and data structures transparent. It works in perfect harmony with parallelisation mechanisms such as multiprocessing and SCOOP.
- DeepEP is a communication library tailored for Mixture-of-Experts (MoE) and expert parallelism (EP). It provides high-throughput and low-latency all-to-all GPU kernels, which are also known as MoE dispatch and combine. The library also supports low-precision operations, including FP8.
- DGL is an easy-to-use, high performance and scalable Python package for deep learning on graphs.
- DLRover makes the distributed training of large AI models easy, stable, fast and green.
- Distributed parallel processing framework for Pandas and NumPy computations.
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
- FlagGems is a high-performance general operator library implemented in OpenAI Triton. It builds on a collection of backend neutral kernels that aims to accelerate LLM training and inference across diverse hardware platforms.
- A fast, flexible machine learning library written entirely in C++ from the Facebook AI Research and the creators of Torch, TensorFlow, Eigen and Deep Speech.
- A neural network library and ecosystem for JAX designed for flexibility.
- GPUStack is an open-source GPU cluster manager for running AI models.
- Decentralized deep learning in PyTorch.
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more.
- Blazing fast, lightweight and mobile phone-enabled Vulkan compute framework optimized for advanced GPU data processing usecases.
- Liger Kernel is a collection of Triton kernels designed specifically for LLM training.
- LightGBM is a gradient boosting framework that uses tree based learning algorithms.
- MLX is an array framework for machine learning on Apple silicon.
- Speed up your Pandas workflows by changing a single line of code.
- TensorRT is a C++ library for high-performance inference on NVIDIA GPUs and deep learning accelerators.
- Nevergrad is a gradient-free optimisation platform.
- Norse aims to exploit the advantages of bio-inspired neural components, which are sparse and event-driven - a fundamental difference from artificial neural networks.
- A compiler for Python array and numerical functions.
- Optimum is an extension of Transformers and Diffusers, providing a set of optimization tools enabling maximum efficiency to train and run models on targeted hardware while keeping things easy to use.
- Parameter-Efficient Fine-Tuning (PEFT) methods enable efficient adaptation of pre-trained language models (PLMs) to various downstream applications without fine-tuning all the model's parameters.
- PaddlePaddle is a framework to perform large-scale deep network training, using data sources distributed across hundreds of nodes. 
- PyG (PyTorch Geometric) is a library built upon PyTorch to easily write and train Graph Neural Networks (GNNs) for a wide range of applications related to structured data.
- PyTorch Lightning pretrains, finetunes and deploys AI models on multiple GPUs, TPUs with zero code changes.
- PyTorch is a library to develop and train neural network based deep learning models.
- Ray is a flexible, high-performance distributed execution framework for machine learning.
- SetFit is an efficient and prompt-free framework for few-shot fine-tuning of Sentence Transformers.
- Sonnet is a library built on top of TensorFlow 2 designed to provide simple, composable abstractions for machine learning research.
- A Data Streaming Library for Efficient Neural Network Training.Что это такое?
Тщательно отобранный, поддерживаемый сообществом каталог open source-библиотек для production-машинного обучения: инструменты для развёртывания, мониторинга, версионирования, масштабирования и защиты ML-систем, разбитые более чем на 25 разделов с комментариями.
Тщательно отобранный, поддерживаемый сообществом каталог open source-библиотек для production-машинного обучения: инструменты для развёртывания, мониторинга, версионирования, масштабирования и защиты ML-систем, разбитые более чем на 25 разделов с комментариями.Так это инструмент, который можно установить, или список для чтения?Это список для чтения, а не программа: README, где каждая запись ссылается на проект с кратким описанием в одну строку. Устанавливать ничего не нужно — каталог просматривают, чтобы подобрать библиотеки для своего ML-стека.
Это список для чтения, а не программа: README, где каждая запись ссылается на проект с кратким описанием в одну строку. Устанавливать ничего не нужно — каталог просматривают, чтобы подобрать библиотеки для своего ML-стека.Какие инструменты AutoML там перечислены?Около двадцати — AIDE (ML-агент для инженерных задач, который ищет стратегии решения с помощью tree search), AutoGluon, auto-sklearn, Autokeras, EvalML, FLAML, Optuna, TPOT, а также Katib для подбора гиперпараметров в Kubernetes, и не только они.
Около двадцати — AIDE (ML-агент для инженерных задач, который ищет стратегии решения с помощью tree search), AutoGluon, auto-sklearn, Autokeras, EvalML, FLAML, Optuna, TPOT, а также Katib для подбора гиперпараметров в Kubernetes, и не только они.Что там есть для ускорения обучения и инференса в больших масштабах?Раздел Computation and Communication Optimisation: DeepSpeed и Ray для распределённого обучения, Colossal-AI для больших моделей, NVIDIA TensorRT для инференса на GPU, плюс варианты под конкретное железо вроде cuDF и Apple-silicon MLX.
Раздел Computation and Communication Optimisation: DeepSpeed и Ray для распределённого обучения, Colossal-AI для больших моделей, NVIDIA TensorRT для инференса на GPU, плюс варианты под конкретное железо вроде cuDF и Apple-silicon MLX.Проекту важны приватность и ответственный ИИ или только масштаб?И то, и другое: рядом с разделом Explainability & Fairness есть отдельный раздел Privacy & Safety, а в темах репозитория значатся privacy-preserving ML и responsible AI.
И то, и другое: рядом с разделом Explainability & Fairness есть отдельный раздел Privacy & Safety, а в темах репозитория значатся privacy-preserving ML и responsible AI.What are similar projects?best-of-ml-python, shap, nni, Ai-Learn, awesome-tensorflow, DeepLearning, pytorch-lightning, autogluon
best-of-ml-python, shap, nni, Ai-Learn, awesome-tensorflow, DeepLearning, pytorch-lightning, autogluonWhich topics is it in?automl, interpretability, data-mining, mlops, tensorflow, nlp, data-science, awesome, distributed-systems, computer-vision, monitoring, pytorch
automl, interpretability, data-mining, mlops, tensorflow, nlp, data-science, awesome, distributed-systems, computer-vision, monitoring, pytorch