Global

Cross-platform, customizable ML solutions for live and streaming media.

Apache Spark - A unified analytics engine for large-scale data processing

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.

Quickstart • Docs • Guides • Integrations • Chat • Download • Container Images • Rust Crate Docs

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Apache Flink is an open source stream processing framework with powerful stream- and batch-processing capabilities.

Whether you're preparing for an interview or you want to design a distributed/microservice oriented application, this list will definitely help you achieve that.

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

QuestDB is a high performance, open-source, time-series database

flink learning blog. 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

A curated list of awesome big data frameworks, ressources and other awesomeness.