Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Global
#2446 · +9 · 1d ·GitHub
MLOps (machine learning operations) is a must-know skill for many data professionals. This free 9-week course teaches the fundamentals of MLOps, from training and experimentation to deployment and monitoring, through structured modules, hands-on workshops, and a final project.
#2870 · +7 · 1d ·GitHub
Pocket Flow: 100-line LLM framework. Let Agents build Agents!
#5825 · +1 · 1d ·GitHub
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
2 skills, composable into workflows, which can then be built into more complex workflows