airbyte README

The project's README from github.com/airbytehq/airbyte. As one markdown file: README.md.

Airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications

Test Release Slack YouTube Channel Views Build License License

We believe that only an open-source solution to data movement can cover the long tail of data sources while empowering data engineers to customize existing connectors. Our ultimate vision is to help you move data from any source to any destination — whether that destination is a data warehouse, a data lake, or an AI agent. Airbyte provides a catalog of 600+ connectors for APIs, databases, data warehouses, data lakes, and AI applications.

Airbyte Connections UI Screenshot taken from Airbyte Cloud.

Pick the right Airbyte Platform for the job

Getting Started — Data Movement (ELT)

For moving data into warehouses, lakes, and databases:

Try it out yourself with our demo app, visit our full documentation, and learn more about recent announcements. See our registry for a full list of connectors already available in Airbyte or Airbyte Cloud.

Getting Started — AI Agents

For building AI agents that need real-time business data:

Join the Airbyte Community

The Airbyte community can be found in the Airbyte Community Slack, where you can ask questions and voice ideas. You can also ask for help in our Airbyte Forum. Airbyte's roadmap is publicly viewable on GitHub.

For videos and blogs on data engineering and building your data stack, check out Airbyte's Content Hub, YouTube, and sign up for our newsletter.

Contributing

If you've found a problem with Airbyte, please open a GitHub issue. To contribute to Airbyte and see our Code of Conduct, please see the contributing guide. We have a list of good first issues that contain bugs that have a relatively limited scope. This is a great place to get started, gain experience, and get familiar with our contribution process.

PR Permission Requirements

When submitting a pull request, please ensure that Airbyte maintainers have write access to your branch. This allows us to apply formatting fixes and dependency updates directly, significantly speeding up the review and approval process.

To enable write access on your PR from Airbyte maintainers, please check the "Allow edits from maintainers" box when submitting from your PR. You must also create your PR from a fork in your personal GitHub account rather than an organization account, or else you will not see this option. The requirement to create from your personal fork is based on GitHub's additional security restrictions for PRs created from organization forks. For more information about the GitHub security model, please see the GitHub documentation page regarding PRs from forks.

For more details on contribution requirements, please see our contribution workflow documentation.

Security

Airbyte takes security issues very seriously. Please do not file GitHub issues or post on our public forum for security vulnerabilities. Email [email protected] if you believe you have uncovered a vulnerability. In the message, try to provide a description of the issue and ideally a way of reproducing it. The security team will get back to you as soon as possible.

Airbyte Enterprise also offers additional security features (among others) on top of Airbyte open-source.

License

See the LICENSE file for licensing information, and our FAQ for any questions you may have on that topic.

Thank You

Airbyte would not be possible without the support and assistance of other open-source tools and companies! Visit our thank you page to learn more about how we build Airbyte.

airbyte (airbytehq/airbyte)

Searching Database…

22.2K ·GitHub
What is this?Airbyte is an open-source data movement platform for ELT pipelines and AI agents: it moves data from APIs, databases, and files into warehouses, data lakes, and AI applications, backed by a catalog of 600+ connectors. You can run it self-hosted or as Airbyte Cloud.
Is this something I deploy myself, or a hosted service?Both. This repo is Airbyte Open Source, which you deploy and run yourself; Airbyte Cloud is the hosted alternative, and there is also a managed Airbyte Agents product plus an open-source Agent SDK.
How do I get started moving data?Deploy Airbyte Open Source or set up Airbyte Cloud, then centralize your data with connectors from the catalog. A demo app lets you try it out, and syncs can be orchestrated from Airflow, Dagster, Kestra, or the Airbyte API.
Do I need to write code to add a source that is not in the catalog?Usually not: a no-code Connector Builder and a low-code CDK let you create custom connectors in minutes. For using connectors inside agent code, you install the separate Agent SDK with uv pip install airbyte-agent-sdk.
Does the open-source version include everything the company offers?No: Airbyte Enterprise adds extra security features, among others, on top of the open-source platform. Where the project is heading is visible in a public roadmap on GitHub.
How many connectors are available out of the box?More than 600 connectors for APIs, databases, data warehouses, data lakes, and AI applications; the project's registry lists everything available in Airbyte and Airbyte Cloud.
What does Airbyte offer specifically for AI agents?Airbyte Agents is a managed data and context layer that gives agents, LLMs, and MCP clients real-time access to business data. Alternatively, the open-source Agent SDK turns connectors into type-safe LLM tools that work with pydantic-ai, LangChain, OpenAI Agents, and FastMCP, with built-in retry, exception translation, and output-size guardrails.
Why is it open source?The team's stated position is that only an open-source approach to data movement can cover the long tail of data sources while letting data engineers customize existing connectors.
What are similar projects?kestra, redash, walshadow, debezium, airflow, WrenAI, doris, anythingmcp
Creator
airbytehq
Size
923 MB
Stars
22.2K
Age
6y
Commits · 90 Days