- AIDE is an open-source ML engineering agent that uses a tree search algorithm to autonomously explore, implement, and evaluate solution strategies for machine learning tasks.
- Automated feature, model, and hyperparameter selection for tabular, image, and text data on top of popular machine learning libraries (Scikit-Learn, LightGBM, CatBoost, PyTorch, MXNet).
- AutoML library for Keras based on 
- Framework to automate algorithm and hyperparameter tuning for sklearn.
- Ax is an accessible, general-purpose platform for understanding, managing, deploying, and automating adaptive experiments.
- BoTorch is a library for Bayesian Optimization built on PyTorch.
- EvalML is an AutoML library which builds, optimizes, and evaluates machine learning pipelines using domain-specific objective functions.
- Feature-engine is a Python library that contains several transformers to engineer features for use in machine learning models.
- An open source framework for automated feature engineering.
- FLAML is a fast library for automated machine learning & tuning.
- Set of open-source hyperparameter optimization frameworks, including the winning submission to the 
- A Kubernetes-based system for Hyperparameter Tuning and Neural Architecture Search.
- Keras Tuner is an easy-to-use, distributable hyperparameter optimisation framework that solves the pain points of performing a hyperparameter search. Keras Tuner makes it easy to define a search space and leverage included algorithms to find the best hyperparameter values.
- Optuna is an automatic hyperparameter optimisation software framework, particularly designed for machine learning.
- OSS Vizier is a Python-based service for black-box optimisation and research, one of the first hyperparameter tuning services designed to work at scale.
- A gradient boosting machine that doesn't need hyperparameter optimization, with a simple budget parameter to control model complexity.
- Automation of sklearn pipeline creation (including feature selection, pre-processor, etc.).
- Automatic extraction of relevant features from time series.
- Accelerate abstracts exactly and only the boilerplate code related to multi-GPU/TPU/mixed-precision and leaves the rest of your code unchanged.
- Adapters is a unified library for parameter-efficient and modular transfer learning.
- Cache-DiT is built on top of Diffusers and supports nearly all DiTs, providing hybrid cache acceleration (DBCache, TaylorSeer, SCM, etc.) and comprehensive parallelism optimizations including Context Parallelism, Tensor Parallelism, and hybrid 2D/3D parallelism, with compatibility for compilation, CPU offloading, and quantization.
- A unified deep learning system for big model era, which helps users to efficiently and quickly deploy large AI model training and inference.
- Composer is a PyTorch library that enables you to train neural networks faster, at lower cost, and to higher accuracy.
- Built based on the Apache Arrow columnar memory format, cuDF is a GPU DataFrame library for loading, joining, aggregating, filtering, and otherwise manipulating data.
- cuML is a suite of libraries that implement machine learning algorithms and mathematical primitives functions that share compatible APIs with other RAPIDS projects.
- An implementation of NumPy-compatible multi-dimensional array on CUDA. CuPy consists of the core multi-dimensional array class, cupy.ndarray, and many functions on it.
- A novel evolutionary computation framework for rapid prototyping and testing of ideas. It seeks to make algorithms explicit and data structures transparent. It works in perfect harmony with parallelisation mechanisms such as multiprocessing and SCOOP.
- DeepEP is a communication library tailored for Mixture-of-Experts (MoE) and expert parallelism (EP). It provides high-throughput and low-latency all-to-all GPU kernels, which are also known as MoE dispatch and combine. The library also supports low-precision operations, including FP8.
- DGL is an easy-to-use, high performance and scalable Python package for deep learning on graphs.
- DLRover makes the distributed training of large AI models easy, stable, fast and green.
- Distributed parallel processing framework for Pandas and NumPy computations.
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
- FlagGems is a high-performance general operator library implemented in OpenAI Triton. It builds on a collection of backend neutral kernels that aims to accelerate LLM training and inference across diverse hardware platforms.
- A fast, flexible machine learning library written entirely in C++ from the Facebook AI Research and the creators of Torch, TensorFlow, Eigen and Deep Speech.
- A neural network library and ecosystem for JAX designed for flexibility.
- GPUStack is an open-source GPU cluster manager for running AI models.
- Decentralized deep learning in PyTorch.
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more.
- Blazing fast, lightweight and mobile phone-enabled Vulkan compute framework optimized for advanced GPU data processing usecases.
- Liger Kernel is a collection of Triton kernels designed specifically for LLM training.
- LightGBM is a gradient boosting framework that uses tree based learning algorithms.
- MLX is an array framework for machine learning on Apple silicon.
- Speed up your Pandas workflows by changing a single line of code.
- TensorRT is a C++ library for high-performance inference on NVIDIA GPUs and deep learning accelerators.
- Nevergrad is a gradient-free optimisation platform.
- Norse aims to exploit the advantages of bio-inspired neural components, which are sparse and event-driven - a fundamental difference from artificial neural networks.
- A compiler for Python array and numerical functions.
- Optimum is an extension of Transformers and Diffusers, providing a set of optimization tools enabling maximum efficiency to train and run models on targeted hardware while keeping things easy to use.
- Parameter-Efficient Fine-Tuning (PEFT) methods enable efficient adaptation of pre-trained language models (PLMs) to various downstream applications without fine-tuning all the model's parameters.
- PaddlePaddle is a framework to perform large-scale deep network training, using data sources distributed across hundreds of nodes. 
- PyG (PyTorch Geometric) is a library built upon PyTorch to easily write and train Graph Neural Networks (GNNs) for a wide range of applications related to structured data.
- PyTorch Lightning pretrains, finetunes and deploys AI models on multiple GPUs, TPUs with zero code changes.
- PyTorch is a library to develop and train neural network based deep learning models.
- Ray is a flexible, high-performance distributed execution framework for machine learning.
- SetFit is an efficient and prompt-free framework for few-shot fine-tuning of Sentence Transformers.
- Sonnet is a library built on top of TensorFlow 2 designed to provide simple, composable abstractions for machine learning research.
- A Data Streaming Library for Efficient Neural Network Training.这是什么东西?
一个由社区维护、精心整理的生产级机器学习开源库目录:涵盖部署、监控、版本管理、扩展和保护机器学习系统的各类工具,按 25 个以上带注释的章节分类。
一个由社区维护、精心整理的生产级机器学习开源库目录:涵盖部署、监控、版本管理、扩展和保护机器学习系统的各类工具,按 25 个以上带注释的章节分类。那它是能安装的工具,还是一份阅读清单?它是阅读清单,不是软件:一个 README 文件,每一条目都链接到一个项目,并附有一句话简介。没什么可安装的——你浏览它,为自己的机器学习技术栈挑选合适的库。
它是阅读清单,不是软件:一个 README 文件,每一条目都链接到一个项目,并附有一句话简介。没什么可安装的——你浏览它,为自己的机器学习技术栈挑选合适的库。它列出了哪些 AutoML 工具?大约二十个,包括 AIDE(一个通过树搜索探索解题策略的机器学习工程智能体)、AutoGluon、auto-sklearn、Autokeras、EvalML、FLAML、Optuna、TPOT,以及用于 Kubernetes 超参数调优的 Katib 等。
大约二十个,包括 AIDE(一个通过树搜索探索解题策略的机器学习工程智能体)、AutoGluon、auto-sklearn、Autokeras、EvalML、FLAML、Optuna、TPOT,以及用于 Kubernetes 超参数调优的 Katib 等。在加速大规模训练和推理方面有什么?在 Computation and Communication Optimisation(计算与通信优化)章节:DeepSpeed 和 Ray 用于分布式训练,Colossal-AI 用于大模型,NVIDIA TensorRT 用于 GPU 推理,还有 cuDF、苹果芯片的 MLX 等针对特定硬件的方案。
在 Computation and Communication Optimisation(计算与通信优化)章节:DeepSpeed 和 Ray 用于分布式训练,Colossal-AI 用于大模型,NVIDIA TensorRT 用于 GPU 推理,还有 cuDF、苹果芯片的 MLX 等针对特定硬件的方案。它关注隐私和负责任的 AI 吗,还是只关心规模?两者都关注:在 Explainability & Fairness(可解释性与公平性)旁边设有专门的 Privacy & Safety(隐私与安全)章节,而且这个仓库的 topics 里也包含 privacy-preserving ML 和 responsible AI。
两者都关注:在 Explainability & Fairness(可解释性与公平性)旁边设有专门的 Privacy & Safety(隐私与安全)章节,而且这个仓库的 topics 里也包含 privacy-preserving ML 和 responsible AI。What are similar projects?best-of-ml-python, shap, nni, Ai-Learn, awesome-tensorflow, DeepLearning, pytorch-lightning, autogluon
best-of-ml-python, shap, nni, Ai-Learn, awesome-tensorflow, DeepLearning, pytorch-lightning, autogluonWhich topics is it in?automl, interpretability, data-mining, mlops, tensorflow, nlp, data-science, awesome, distributed-systems, computer-vision, monitoring, pytorch
automl, interpretability, data-mining, mlops, tensorflow, nlp, data-science, awesome, distributed-systems, computer-vision, monitoring, pytorch