17K ·GitHub
What is this?
An open source, container-native workflow engine for Kubernetes: it orchestrates parallel jobs where every step of your workflow runs as a container. It is a CNCF graduated project.
An open source, container-native workflow engine for Kubernetes: it orchestrates parallel jobs where every step of your workflow runs as a container. It is a CNCF graduated project.So where does it actually run — on my machine or in a cluster?In your cluster: Argo is implemented as a Kubernetes CRD, and you get a web UI, a REST API server (HTTP and gRPC) and a CLI to drive it.
In your cluster: Argo is implemented as a Kubernetes CRD, and you get a web UI, a REST API server (HTTP and gRPC) and a CLI to drive it.What's the quickest way to see it working?Follow the Quickstart in the docs, or try it without installing anything via the interactive training material or the demo environment.
Follow the Quickstart in the docs, or try it without installing anything via the interactive training material or the demo environment.What do I need to have in place before I can use it?A Kubernetes cluster — Argo deploys into it and runs your steps as containers, so there is nothing to install on your own machine beyond the CLI.
A Kubernetes cluster — Argo deploys into it and runs your steps as containers, so there is nothing to install on your own machine beyond the CLI.What do teams use it for?Machine learning pipelines, data and batch processing, infrastructure automation and CI/CD. Around 200+ organizations use it officially, and projects like Kubeflow Pipelines and Netflix Metaflow are built on it.
Machine learning pipelines, data and batch processing, infrastructure automation and CI/CD. Around 200+ organizations use it officially, and projects like Kubeflow Pipelines and Netflix Metaflow are built on it.Am I locked into a specific cloud or operating system?No — it is cloud agnostic and runs on any Kubernetes cluster, and your workflow steps can even be Windows containers.
No — it is cloud agnostic and runs on any Kubernetes cluster, and your workflow steps can even be Windows containers.How do I describe a workflow?As a sequence of steps or as a DAG that captures dependencies between tasks — every step is a container. The engine also supports loops, parameterization, conditionals, retries and timeouts at both step and workflow level.
As a sequence of steps or as a DAG that captures dependencies between tasks — every step is a container. The engine also supports loops, parameterization, conditionals, retries and timeouts at both step and workflow level.Is there an SDK, or do I wire everything through the API?There are official clients and SDKs for Java, Golang, Python and TypeScript — Python users get the Hera SDK, and the TypeScript client is called Juno.
There are official clients and SDKs for Java, Golang, Python and TypeScript — Python users get the Hera SDK, and the TypeScript client is called Juno.How do steps hand data to each other?Through step-level inputs and outputs — artifacts and parameters. Artifacts can be stored in S3, GCS, Azure Blob Storage, Artifactory, Alibaba Cloud OSS, Git, HTTP, raw, or custom plugins.
Through step-level inputs and outputs — artifacts and parameters. Artifacts can be stored in S3, GCS, Azure Blob Storage, Artifactory, Alibaba Cloud OSS, Git, HTTP, raw, or custom plugins.Can workflows run on a schedule or be triggered automatically?Yes: workflows can be scheduled with cron or triggered by webhooks, and exit hooks handle notifications and cleanup when a run finishes.
Yes: workflows can be scheduled with cron or triggered by webhooks, and exit hooks handle notifications and cleanup when a run finishes.What are similar projects?airflow, argo-cd, kubesphere, meshery, evenfire, taipy, helm, containerd
airflow, argo-cd, kubesphere, meshery, evenfire, taipy, helm, containerdWhich topics is it in?argo, pipelines, dag, gitops, batch-processing, workflow-engine, k8s, cncf, mlops, data-engineering, ci-cd, cloud-native
argo, pipelines, dag, gitops, batch-processing, workflow-engine, k8s, cncf, mlops, data-engineering, ci-cd, cloud-native