Global

pipeline
24 projects tagged “pipeline” that gained the most stars yesterday
#418 · +89 · 1d ·GitHub

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

Creator
kestra-io
Size
141.9 MB
Stars
29.8K
Age
7y
Commits · 90 Days
#1925 · +13 · 1d ·GitHub

Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability.

Size
409 MB
Stars
22.4K
Age
3y
Commits · 90 Days
#2555 · +8 · 1d ·GitHub

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Creator
PrefectHQ
Size
240.7 MB
Stars
24K
Age
8y
Commits · 90 Days
#2560 · +8 · 1d ·GitHub

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

Size
252.5 MB
Stars
23.2K
Age
3y
Commits · 90 Days
#2772 · +7 · 1d ·GitHub

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

Creator
airbytehq
Size
922.9 MB
Stars
22.2K
Age
6y
Commits · 90 Days
#2828 · +7 · 1d ·GitHub

Meshroom is an open-source, node-based visual programming framework—a flexible toolbox for creating, managing, and executing complex data processing pipelines.

Size
13.3 MB
Stars
13K
Age
11y
Commits · 90 Days
#3602 · +4 · 1d ·GitHub

Argo CD is a declarative GitOps continuous delivery tool for Kubernetes.

Creator
argoproj
Size
222 MB
Stars
24.4K
Age
8y
Commits · 90 Days
#3758 · +4 · 1d ·GitHub

Its powerful technical tools start with Expectations: expressive and extensible unit tests for your data. Expectations foster collaboration by giving teams a common language to express data quality tests in an intuitive way.

Creator
fivetran
Size
247.4 MB
Stars
11.9K
Age
9y
Commits · 90 Days
#3790 · +4 · 1d ·GitHub

httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.

Size
5.5 MB
Stars
10.5K
Age
6y
Commits · 90 Days
#3802 · +4 · 1d ·GitHub

Are you looking forward to learn Jenkins right from Zero(installation) to Hero(Build end to end pipelines)? then you are at the right place.

Size
0.2 MB
Stars
10.1K
Updated
CommitMar 12
Age
3y
Commits · 90 Days
#4408 · +3 · 1d ·GitHub

It's built for one person: you write the briefs, you review every stage, and the studio runs on your machine. The work is done by Claude through your own Claude Code login or your own Anthropic API key.

Creator
GTKottman
Size
11.2 MB
Stars
642
Updated
CommitOct 08
Age
14d
Commits · 90 Days
#4680 · +2 · 1d ·GitHub

Click a box to zoom the Flame Graph to this stack frame only. To search and highlight all stack frames matching a regular expression, click the search button in the upper right corner or press Ctrl-F.

Size
1.9 MB
Stars
19.8K
Age
14y
Commits · 90 Days
#4986 · +2 · 1d ·GitHub

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

Creator
kedro-org
Size
245.7 MB
Stars
11K
Age
7y
Commits · 90 Days
#4992 · +2 · 1d ·GitHub

PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

Creator
PRQL
Size
25.6 MB
Stars
10.9K
Age
4y
Commits · 90 Days
#5272 · +2 · 1d ·GitHub

A distributed pipeline inference engine on multiple ESP32S3 running 1.58-bit (BitNet) Language model.

Size
8.6 MB
Stars
243
Updated
CommitOct 08
Age
2mo
Commits · 90 Days
#5561 · +1 · 1d ·GitHub

Taipy is designed for data scientists and machine learning engineers to create data & AI driven web applications.

Creator
Avaiga
Size
152.8 MB
Stars
19.4K
Age
4y
Commits · 90 Days
#5709 · +1 · 1d ·GitHub

Kubeflow is the foundation of tools for AI Platforms on Kubernetes.

Creator
kubeflow
Size
316.8 MB
Stars
15.9K
Age
8y
Commits · 90 Days
#6096 · +1 · 1d ·GitHub

Spug is a lightweight agent-free automatic operation and maintenance platform designed for small and medium-sized enterprises.

Creator
openspug
Size
7.1 MB
Stars
11.1K
Age
8y
Commits · 90 Days
#6204 · +1 · 1d ·GitHub

Metaflow is a human-centric framework designed to help scientists and engineers build and manage real-life AI and ML systems.

Creator
Netflix
Size
48.2 MB
Stars
10.3K
Age
7y
Commits · 90 Days
#6228 · +1 · 1d ·GitHub

A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.

Size
89.8 MB
Stars
10.1K
Age
10y
Commits · 90 Days

自然言語で頼むと漫画の原稿が出てくる Claude Code スキル — OMNY(ネームYAML)設計→作画→回収→検品→納品のパイプライン

Creator
sa-san10
Size
8.5 MB
Stars
127
Updated
CommitOct 18
Age
2mo
Commits · 90 Days
#6780 · +0 · 1d ·GitHub

Jina-serve is a framework for building and deploying AI services that communicate via gRPC, HTTP and WebSockets. Scale your services from local development to production while focusing on your core logic.

Creator
jina-ai
Size
1.6 GB
Stars
21.9K
Age
6y
Commits · 90 Days
#7057 · +0 · 1d ·GitHub

Logstash is part of the Elastic Stack along with Beats, Elasticsearch and Kibana. ). Logstash has over 200 plugins, and you can write your own very easily as well.

Creator
elastic
Size
132.3 MB
Stars
15K
Age
15y
Commits · 90 Days
#7615 · +0 · 1d ·GitHub

StreamDiffusion is an innovative diffusion pipeline designed for real-time interactive generation. It introduces significant performance enhancements to current diffusion-based image generation techniques.

Size
121.7 MB
Stars
10.8K
Age
2y
Commits · 90 Days