Topics / #hdfs

Hdfs projects on GitHub

Distributed file systems for storing massive datasets across clusters.

As of , the most-starred Hdfs projects on GitHub are spark (44.2K stars), seaweedfs (35.5K stars) and ceph (17.1K stars). GitHub.Locker tracks 6 Hdfs repositories with 139K stars combined. The fastest-growing on October 16 was seaweedfs, with +24 stars in a day.

6Projects
139KStars in total
+49Stars in a day
Browse in the catalog →github.com/topics/hdfs ↗

Hot right now

Most stars gained in a day · Oct 16

+24

seaweedfs

seaweedfs/seaweedfs · ★ 35.5K

SeaweedFS is a distributed storage system that serves billions of small and large files with O(1) disk access, exposing the same data as an S3 object store, a POSIX file system, and an Iceberg/Lance data lakehouse through one binary.

+10

spark

apache/spark · ★ 44.2K

Apache Spark is a unified analytics engine for large-scale data processing, offering high-level APIs in Scala, Java, Python, and R on top of an optimized execution engine.

+6

ceph

ceph/ceph · ★ 17.1K

Ceph is an open-source distributed storage platform: it pools a cluster of servers into one scalable storage system that serves object, block, and file storage at the same time.

+6

juicefs

juicedata/juicefs · ★ 14.5K

JuiceFS is a distributed POSIX file system that stores data in object storage (like S3) and metadata in a database engine (like Redis), letting you use massive cloud storage as if it were a local disk.

The all-time top

6 projects · by stars

  1. #1 · apache/spark

    spark

    Apache Spark is a unified analytics engine for large-scale data processing, offering high-level APIs in Scala, Java, Python, and R on top of an optimized execution engine.

    44.2K
  2. #2 · seaweedfs/seaweedfs

    seaweedfs

    SeaweedFS is a distributed storage system that serves billions of small and large files with O(1) disk access, exposing the same data as an S3 object store, a POSIX file system, and an Iceberg/Lance data lakehouse through one binary.

    35.5K
  3. #3 · ceph/ceph

    ceph

    Ceph is an open-source distributed storage platform: it pools a cluster of servers into one scalable storage system that serves object, block, and file storage at the same time.

    17.1K
  1. 4

    BigData-Notes

    17Kheibaiying/BigData-Notes · Java

    This is a comprehensive Chinese-language study guide covering the big data ecosystem: Hadoop, Hive, Spark, Storm, Flink, HBase, Kafka, Zookeeper, Flume, Sqoop, Azkaban, and Scala.

  2. 5

    juicefs

    14.5Kjuicedata/juicefs · Go

    JuiceFS is a distributed POSIX file system that stores data in object storage (like S3) and metadata in a database engine (like Redis), letting you use massive cloud storage as if it were a local disk.

  3. 6

    God-Of-BigData

    10.6Kwangzhiwubigdata/God-Of-BigData

    A curated Chinese-language knowledge base for learning big data engineering and passing big data interviews, covering Java fundamentals, distributed systems theory, and deep dives into Hadoop, Hive, Spark, Flink, HBase, Kafka, and Zookeeper.

Often tagged together