Global

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

Your company's data, connected into one ontology, on your own computer. A local-first data workspace built on HelixDB and DuckDB.

Quickstart • Docs • Guides • Integrations • Chat • Download • Container Images • Rust Crate Docs

Debezium is an open source project that provides a low latency data streaming platform for change data capture (CDC). You set up and configure Debezium to monitor your databases, and then your applications consume events for each row-level change made to the database.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

🔥 人人可用的开源 BI 工具，数据可视化神器。An open-source BI tool alternative to Tableau.

An orchestration platform for the development, production, and observation of data assets.

Incremental engine for long horizon agents 🌟 Star if you like it!

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models.

DuckLake is an open Lakehouse format that is built on SQL and Parquet. DuckLake stores metadata in a catalog database, and stores data in Parquet files. The DuckLake extension allows DuckDB to directly read and write data from DuckLake.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

0 , client 端可采用不同语言实现不同的消费逻辑，欢迎大家提交 pull request

DataX是阿里云DataWorks数据集成的开源版本。

Query, search, and join your data from one place — external databases, APIs, cloud storage, Iceberg catalogs, and files you upload — with plain SQL and a few commands.

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

Progetto civico open source per capire, con dati ufficiali, come vengono usati i soldi pubblici italiani.

O projeto inteiro — do CSV cru ao app que escreve de volta na gold — sai de doze prompts colados em sequência no Claude Code. Cada um termina com um deploy.

WARNING] > Experimental > > Project status: Development Preview > > walshadow is under active development and being hardened through real-world > testing and feedback. We recommend validating it thoroughly with your > workloads. Interfaces and behavior may evolve

End-to-end streaming data platform on AWS: Kafka → Iceberg lake → Kimball model → Athena, orchestrated with Airflow 3. Terraform, Glue PySpark, dbt.