Global

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

> Contributions are greatly welcome! You may want to take a look at the contribution guidelines. If you see a link here that is no longer maintained or is not a good fit, please submit a pull request!

Software design pattern - A general, reusable solution to a commonly occurring problem within a given context in software design. It is a description or template for how to solve a problem that can be used in many different situations.

ClickHouse® is a real-time analytics database management system

Elasticsearch is a distributed search and analytics engine, scalable data store and vector database optimized for speed and relevance on production-scale workloads. Elasticsearch is the foundation of Elastic's open Stack platform.

Apache Spark - A unified analytics engine for large-scale data processing

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.

This is a repo with links to everything you'd ever want to learn about data engineering

TimescaleDB is a PostgreSQL extension for high-performance real-time analytics on time-series and event data

All-in-one IoT Platform - Device management, data collection, processing and visualization.

VictoriaMetrics is a fast, cost-effective, and scalable solution for monitoring and managing time series data. It delivers high performance and reliability, making it an ideal choice for businesses of all sizes.

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

What is this Book? How to Contribute YouTube Twitter Amazon Shop

gl is a powerful open source geospatial analysis tool for large-scale data sets.

Open source transactional distributed database. Linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructure without compromising performance.

Autumn-Recruit Algo Notes(秋招算法学习仓库)，面向大模型时代的算法、工程与AI学习共建仓库。从数学基础、数据结构，到机器学习、深度学习、LLM、Agent、AI-Infra、语音与数据科学，通过「理解→推导→手写 → 运行 → 验证 → 复盘构建可持续迭代的知识体系。

程序员技能图谱

📊 Cube Core is open-source semantic layer for AI, BI and embedded analytics

OpenSearch is an open-source, enterprise-grade search and observability suite that brings order to unstructured data at scale.

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster.

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries.

😮 Core Interview Questions & Answers For Experienced Java(Backend) Developers | 互联网 Java 工程师进阶知识完全扫盲：涵盖高并发、分布式、高可用、微服务、海量数据处理等领域知识

An open source cybersecurity protocol for syncing decentralized graph data.

DataX是阿里云DataWorks数据集成的开源版本。

大数据入门指南 :star:

Apache Doris is a real-time analytics and hybrid search database for AI agents.

Apache Hadoop

Pulsar is a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API.

UI for Apache Kafka is a simple tool that makes your data flows observable, helps find and troubleshoot issues faster and deliver optimal performance.