Topics / #distributed

Distributed projects on GitHub

Distributed computing and storage systems running across many nodes.

As of , the most-starred Distributed projects on GitHub are tensorflow (201.1K stars), git (63.8K stars) and ClickHouse (50.5K stars). GitHub.Locker tracks 36 Distributed repositories with 1.1M stars combined. The fastest-growing on October 16 was git, with +34 stars in a day.

36Projects
1.1MStars in total
+253Stars in a day
Browse in the catalog →github.com/topics/distributed ↗

Hot right now

Most stars gained in a day · Oct 16

+34

git

git/git · ★ 63.8K

This is Git, the fast, scalable, distributed revision control system with a rich command set that gives both high-level operations and full access to internals.

+32

tensorflow

tensorflow/tensorflow · ★ 201.1K

TensorFlow is an open source machine learning platform for building and deploying ML-powered applications.

+24

LocalAI

mudler/LocalAI · ★ 49.6K

LocalAI is an open-source, self-hosted AI engine that lets you run LLMs, vision, voice, image and video models on your own hardware, including CPU-only setups, through an OpenAI/Anthropic/ElevenLabs-compatible API.

+21

server

nextcloud/server · ★ 37.1K

Nextcloud server is a self-hosted platform for storing, syncing, and sharing your files, contacts, calendars, and more, with hundreds of apps (Mail, Video Chat, etc.) to extend it.

The all-time top

36 projects · by stars

  1. #1 · tensorflow/tensorflow

    tensorflow

    TensorFlow is an open source machine learning platform for building and deploying ML-powered applications.

    201.1K
  2. #2 · git/git

    git

    This is Git, the fast, scalable, distributed revision control system with a rich command set that gives both high-level operations and full access to internals.

    63.8K
  3. #3 · ClickHouse/ClickHouse

    ClickHouse

    ClickHouse is an open-source column-oriented database management system for generating analytical data reports in real time.

    50.5K
  1. 4

    LocalAI

    49.6Kmudler/LocalAI · Go

    LocalAI is an open-source, self-hosted AI engine that lets you run LLMs, vision, voice, image and video models on your own hardware, including CPU-only setups, through an OpenAI/Anthropic/ElevenLabs-compatible API.

  2. 5

    exo

    47.9Kexo-explore/exo · Python

    exo turns a group of your own devices (Macs, Linux boxes) into a single AI cluster so you can run large AI models that would never fit on one machine, pooling their memory and compute together.

  3. 6

    milvus

    46.4Kmilvus-io/milvus · Go

    Milvus is a high-performance, cloud-native vector database built to store and search embedding vectors at scale for AI applications like semantic search, RAG, and recommendation systems.

  4. 7

    ray

    44.1Kray-project/ray · Python

    Ray is an open-source framework for scaling AI and Python applications: a core distributed runtime plus a set of AI libraries that simplify ML compute.

  5. 8

    tidb

    40.6Kpingcap/tidb · Go

    TiDB is an open-source, cloud-native distributed SQL database written in Go — MySQL-compatible and built for high availability, horizontal scalability, strong consistency, and mixing transactions with analytics.

  6. 9

    spacedrive

    39.2Kspacedriveapp/spacedrive · Rust

    Spacedrive is a cross-platform file explorer and a cross-device data platform. It indexes files, emails, notes, and other sources, lets you search everything in one place, and syncs data across devices via peer-to-peer connections.

  7. 10

    server

    37.1Knextcloud/server · PHP

    Nextcloud server is a self-hosted platform for storing, syncing, and sharing your files, contacts, calendars, and more, with hundreds of apps (Mail, Video Chat, etc.) to extend it.

  8. 11

    surrealdb

    33.2Ksurrealdb/surrealdb · Rust

    A multi-model database written in Rust: one engine for document, graph, relational, time-series, geospatial and key-value data, with full-text, vector and hybrid search and realtime capabilities.

  9. 12

    xxl-job

    30.6Kxuxueli/xxl-job · Java

    XXL-JOB is a distributed task scheduling framework: a central scheduler triggers jobs across a cluster of executors, all managed from a web UI. It aims to be quick to develop with, simple to learn, lightweight and easy to extend, and many companies run it in production.

  10. 13

    celery

    29Kcelery/celery · Python

    Celery is a distributed task queue for Python: clients put units of work (tasks) on a queue and dedicated worker processes monitor the queue and run them — across threads, machines, even datacenters.

  11. 14

    valkey

    27.4Kvalkey-io/valkey · C

    Valkey is an open-source, high-performance data structure server for key/value workloads like caching and other realtime use cases. It ships a wide range of native structures plus a plugin system for adding new ones.

  12. 15

    handson-ml

    25.6Kageron/handson-ml · Jupyter Notebook

    Jupyter notebooks that teach Machine Learning fundamentals in Python: the example code and exercise solutions for the first edition of the O'Reilly book 'Hands-on Machine Learning with Scikit-Learn and TensorFlow'.

  13. 16

    colly

    25.6Kgocolly/colly · Go

    Colly is a scraping and crawling framework for Go: a clean interface for writing any kind of crawler, scraper or spider that extracts structured data from websites, for things like data mining, processing or archiving.

  14. 17

    TDengine

    25.2Ktaosdata/TDengine · C

    TDengine is an open-source, high-performance, cloud-native, AI-powered time-series database built for IoT, Connected Cars, and Industrial IoT workloads, handling TB-to-PB scale data from billions of sensors.

  15. 18

    redisson

    24.4Kredisson/redisson · Java

    A Java client and real-time data platform for Redis and Valkey: 50+ distributed Java objects, collections and services — maps, queues, locks, rate limiters, bloom filters, schedulers — beyond what Redis offers natively.

  16. 19

    phoenix

    23.2Kphoenixframework/phoenix · Elixir

    Phoenix is a web framework for Elixir that lets you build productive, reliable, fast applications, from prototype through to production.

  17. 20

    ipfs

    23.1Kipfs/ipfs

    IPFS (InterPlanetary File System) is an open, peer-to-peer system for storing and sharing data without relying on a central server.

  18. 21

    learn_python3_spider

    22.2Kwistbean/learn_python3_spider · Python

    A free Chinese-language tutorial series that teaches Python web scraping from zero — 30+ numbered lessons and mitmproxy guides, from first packet capture to distributed crawling, with source code for the practice projects.

  19. 22

    serve

    21.9Kjina-ai/serve · Python

    Jina is an open-source Python framework for building multimodal AI applications on a cloud-native stack — you wrap models into gRPC microservices, chain them into flows, and scale from local to cloud.

  20. 23

    dgraph

    21.8Kdgraph-io/dgraph · Go

    Dgraph is an open-source, horizontally scalable distributed graph database with a GraphQL interface, built for real-time queries over terabytes of data. It provides ACID transactions, consistent replication, and linearizable reads.

  21. 24

    cat

    18.9Kdianping/cat · Java

    CAT is an open-source real-time application monitoring platform (APM) written in Java at Meituan-Dianping. It collects performance metrics, health status and alerts from your services and turns them into live reports.

  22. 25

    LightGBM

    18.9Klightgbm-org/LightGBM · C++

    LightGBM is a gradient boosting framework that uses tree-based learning algorithms, used for ranking, classification and many other machine learning tasks.

  23. 26

    bit

    18.5Kteambit/bit · TypeScript

    Bit is an open-source build system for the AI era: it organizes source code into composable, reusable components and apps. Developers and AI agents create and reuse these components via MCP, preventing code duplication.

  24. 27

    CNTK

    17.6Kmicrosoft/CNTK · C++

    The Microsoft Cognitive Toolkit (CNTK) is an open-source deep-learning toolkit that describes neural networks as a series of computational steps in a directed graph.

  25. 28

    optuna

    14.9Koptuna/optuna · Python

    Optuna is an open-source framework for automatic hyperparameter optimization, built primarily for machine learning: you wrap your training code in an objective function and it searches for the best settings automatically.

  26. 29

    nni

    14.4Kmicrosoft/nni · Python

    NNI (Neural Network Intelligence) is Microsoft's open-source AutoML toolkit that automates the machine learning lifecycle: feature engineering, neural architecture search, model compression, and hyperparameter tuning.

  27. 30

    diaspora

    13.7Kdiaspora/diaspora · Ruby

    diaspora* is a privacy-aware, distributed, open source social network: instead of one company-owned platform, it is a network of many independent servers (pods) run by different people.

  28. 31

    nebula

    12.4Kvesoft-inc/nebula · C++

    NebulaGraph is an open-source distributed graph database built to handle large volumes of highly connected data with millisecond latency and quick horizontal scaling.

  29. 32

    dtm

    10.9Kdtm-labs/dtm · Go

    DTM is a distributed transaction framework that provides cross-service eventual data consistency. It implements the saga, TCC, XA, 2-phase message, outbox and workflow patterns for different application scenarios.

  30. 33

    modin

    10.4Kmodin-project/modin · Python

    Modin is a drop-in replacement for pandas: you keep the same API and syntax, but your workflows run on all of your CPU cores instead of a single thread. Change one import line and your existing pandas code just runs faster.

  31. 34

    higgsfield

    6.1Khiggsfield-ai/higgsfield · Jupyter Notebook

    Higgsfield is an open-source, fault-tolerant GPU orchestration system and machine learning framework for training huge models, from billions to trillions of parameters, such as LLMs.

  32. 35

    tork

    820runabol/tork · Go

    Tork is a lightweight, distributed workflow engine written in Go. You define jobs made of multiple tasks, and each task runs as a simple script inside its own Docker container — on one machine or across many workers.

  33. 36

    LoongForge

    687baidu-baige/LoongForge · Python

    An open-source training framework from Baidu's Baige team for LLMs, VLMs, diffusion and embodied models, built for faster training and lower cost on NVIDIA GPUs and Kunlun XPUs.

Often tagged together