Topics / #high-availability

High-availability projects on GitHub

Designing systems that stay available through replication, failover, and redundancy.

As of , the most-starred High-availability projects on GitHub are advanced-java (79.2K stars), etcd (52.4K stars) and cockroach (32.6K stars). GitHub.Locker tracks 36 High-availability repositories with 692.2K stars combined. The fastest-growing on October 16 was kestra, with +29 stars in a day.

36Projects
692.2KStars in total
+97Stars in a day
Browse in the catalog →github.com/topics/high-availability ↗

Hot right now

Most stars gained in a day · Oct 16

+29

kestra

kestra-io/kestra · ★ 29.7K

Kestra is an open-source, event-driven orchestration platform for building data, AI, and infrastructure workflows. You describe them in declarative YAML and manage everything from a built-in web UI.

+6

etcd

etcd-io/etcd · ★ 52.4K

A distributed, reliable key-value store for the most critical data of a distributed system, written in Go and kept consistent across machines with the Raft consensus algorithm.

+6

ceph

ceph/ceph · ★ 17.1K

Ceph is an open-source distributed storage platform: it pools a cluster of servers into one scalable storage system that serves object, block, and file storage at the same time.

+5

rqlite

rqlite/rqlite · ★ 17.8K

rqlite is a lightweight, fault-tolerant distributed relational database built on SQLite — think etcd, but with relational modeling — built to keep your data highly available with minimal effort.

The all-time top

36 projects · by stars

  1. #1 · doocs/advanced-java

    advanced-java

    A free, community-curated collection of in-depth Java backend interview questions and answers, covering message queues, search engines, caching, sharding, distributed systems, high availability, microservices, and big-data processing.

    79.2K
  2. #2 · etcd-io/etcd

    etcd

    A distributed, reliable key-value store for the most critical data of a distributed system, written in Go and kept consistent across machines with the Raft consensus algorithm.

    52.4K
  3. #3 · cockroachdb/cockroach

    cockroach

    CockroachDB is a distributed SQL database built on a transactional, strongly-consistent key-value store, designed for high availability, horizontal scale, and surviving hardware failures without manual intervention.

    32.6K
  1. 4

    xxl-job

    30.6Kxuxueli/xxl-job · Java

    XXL-JOB is a distributed task scheduling framework: a central scheduler triggers jobs across a cluster of executors, all managed from a web UI. It aims to be quick to develop with, simple to learn, lightweight and easy to extend, and many companies run it in production.

  2. 5

    consul

    30.1Khashicorp/consul · Go

    Consul is a distributed, highly available, data center aware solution for connecting and configuring applications across dynamic, distributed infrastructure. It is built to be datacenter aware and can support any number of regions without complex configuration.

  3. 6

    kestra

    29.7Kkestra-io/kestra · Java

    Kestra is an open-source, event-driven orchestration platform for building data, AI, and infrastructure workflows. You describe them in declarative YAML and manage everything from a built-in web UI.

  4. 7

    rethinkdb

    27Krethinkdb/rethinkdb · C++

    RethinkDB is an open-source, distributed NoSQL database built for realtime web applications; instead of making your app poll for changes, it pushes updated query results straight to you.

  5. 8

    nsq

    25.8Knsqio/nsq · Go

    NSQ is a realtime distributed messaging platform — a message queue built to operate at scale, handling billions of messages per day.

  6. 9

    Hystrix

    24.5KNetflix/Hystrix · Java

    Hystrix is a Java library that isolates calls to remote services and third-party libraries, stopping cascading failures and enabling resilience in complex distributed systems.

  7. 10

    neon

    23.2Kneondatabase/neon · Rust

    Neon is an open source serverless Postgres platform. It splits storage from compute and replaces the PostgreSQL storage layer with a distributed engine that spreads data across a cluster of nodes — which is what enables autoscaling, database branching, and scale to zero.

  8. 11

    architecture.of.internet-product

    20.8Kdavideuler/architecture.of.internet-product · HTML

    This is a curated Chinese-language collection of real-world technical architecture documents from major internet companies — WeChat/Tencent, Taobao/Alibaba, Meituan-Dianping, Baidu, Qihoo 360, and global players like OpenAI, Google, Facebook, Amazon and eBay.

  9. 12

    cat

    18.9Kdianping/cat · Java

    CAT is an open-source real-time application monitoring platform (APM) written in Java at Meituan-Dianping. It collects performance metrics, health status and alerts from your services and turns them into live reports.

  10. 13

    kubespray

    18.8Kkubernetes-sigs/kubespray · Jinja

    Kubespray is a set of Ansible playbooks that deploys a production-ready, highly available Kubernetes cluster on cloud VMs or your own bare-metal servers.

  11. 14

    system-design-resources

    18.5KInterviewReady/system-design-resources

    A curated collection of the best System Design resources on the Internet — one README that organizes engineering writeups, papers and talks into a topic-by-topic reading list.

  12. 15

    rqlite

    17.8Krqlite/rqlite · Go

    rqlite is a lightweight, fault-tolerant distributed relational database built on SQLite — think etcd, but with relational modeling — built to keep your data highly available with minimal effort.

  13. 16

    ceph

    17.1Kceph/ceph · C++

    Ceph is an open-source distributed storage platform: it pools a cluster of servers into one scalable storage system that serves object, block, and file storage at the same time.

  14. 17

    nomad

    17Khashicorp/nomad · Go

    Nomad is a workload orchestrator from HashiCorp that deploys and manages containers, non-containerized apps, and virtual machines across on-prem and cloud infrastructure at scale.

  15. 18

    emqx

    16.8Kemqx/emqx · Erlang

    EMQX is an MQTT broker and messaging platform for IoT: it connects millions of devices, routes messages in real time, and bridges them into backend data systems. Aimed at AI, IoT, IIoT, connected vehicles and smart cities.

  16. 19

    hadoop

    15.7Kapache/hadoop · Java

    Apache Hadoop is the open-source big data platform for reliable, distributed storage and processing of very large data sets across clusters of machines.

  17. 20

    onedev

    15.3Ktheonedev/onedev · Java

    OneDev is a self-hosted, all-in-one DevOps platform that bundles Git hosting, CI/CD pipelines, issue tracking with Kanban boards, package registries, a wiki, and built-in AI assistance into a single server application.

  18. 21

    thanos

    14.2Kthanos-io/thanos · Go

    Thanos is a set of components that turn existing Prometheus deployments into a highly available metric system with unlimited storage capacity. It is a CNCF Incubating project written in Go.

  19. 22

    zuul

    14.1KNetflix/zuul · Java

    Zuul is Netflix's L7 (application-layer) gateway service that handles dynamic routing, monitoring, resiliency, and security for traffic flowing into a set of backend services.

  20. 23

    asynq

    13.8Khibiken/asynq · Go

    Asynq is a Go library for queueing tasks and processing them asynchronously with workers, backed by Redis. It distributes work across multiple machines and is designed to be scalable yet easy to get started.

  21. 24

    citus

    12.8Kcitusdata/citus · C

    Citus is a PostgreSQL extension that turns Postgres into a distributed database, letting you shard tables across a cluster to scale CPU, memory, storage and I/O for large or high-traffic workloads.

  22. 25

    eureka

    12.7KNetflix/eureka · Java

    Eureka is a RESTful service used mainly in AWS cloud environments for service discovery, load balancing, and failover of mid-tier servers, originally built for Netflix's own infrastructure.

  23. 26

    mysql-server

    12.5Kmysql/mysql-server · C++

    This is the MySQL Server source distribution: the world's most popular open-source relational database, along with MySQL Cluster, a real-time, open-source transactional database for clustered, highly available deployments.

  24. 27

    nebula

    12.4Kvesoft-inc/nebula · C++

    NebulaGraph is an open-source distributed graph database built to handle large volumes of highly connected data with millisecond latency and quick horizontal scaling.

  25. 28

    vcluster

    11.4Kloft-sh/vcluster · Go

    vCluster creates Tenant Clusters: fully isolated virtual Kubernetes clusters, each with its own API server, CRDs, and RBAC, running on top of an existing Kubernetes cluster or standalone on bare metal.

  26. 29

    dtm

    10.9Kdtm-labs/dtm · Go

    DTM is a distributed transaction framework that provides cross-service eventual data consistency. It implements the saga, TCC, XA, 2-phase message, outbox and workflow patterns for different application scenarios.

  27. 30

    automq

    10.9KAutoMQ/automq · Java

    AutoMQ is a diskless, stateless fork of Apache Kafka that stores all log data on S3 or S3-compatible object storage instead of local disks, cutting cloud costs by up to 10x and removing cross-AZ traffic fees.

  28. 31

    oceanbase

    10.3Koceanbase/oceanbase · C++

    OceanBase Database is a distributed relational database developed entirely by Ant Group. It runs on a cluster of commodity servers and uses Paxos to provide high availability and linear scalability.

  29. 32

    phpredis

    10.2Kphpredis/phpredis · C

    A PHP extension that gives PHP a fast API for talking to the Redis key-value store. It also works with Valkey, Dragonfly, and KeyDB, and is released under the PHP License 3.01.

  30. 33

    Tars

    10.1KTarsCloud/Tars · C++

    A high-performance RPC framework built on a name service and the Tars protocol, with an integrated admin platform and flexible scheduling for hosting services. It began as Tencent's in-house TAF and is now a Linux Foundation project.

  31. 34

    The-Accidental-CTO

    3.9Ksubhashchy/The-Accidental-CTO · TypeScript

    This is 'The Accidental CTO', a story-driven system design handbook by Subhash Choudhary about scaling the Dukaan e-commerce platform from zero to over a million stores without a formal CS degree.

  32. 35

    NodePilot

    110Sev7eNup/NodePilot · C#

    NodePilot is an open-source, self-hosted platform for building and running Windows/PowerShell automation workflows, designed as a modern agentless replacement for Microsoft System Center Orchestrator.

  33. 36

    ZenJolt

    83cahcacah/ZenJolt · JavaScript

    ZenJolt is an open-source backend project pitched as a cloud-native architecture with a high-availability cluster, built for everyday use and aimed at developers who want a straightforward, dependable solution.

Often tagged together