Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Efficient data transformation and modeling framework that is backwards compatible with dbt.

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

A system for agentic LLM-powered data processing and ETL

dbt + Metabase integration

One framework to develop, deploy and operate data workflows with Python and SQL.

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

CLI tool for dbt users to simplify creation of staging models (yml and sql) files

PyAirbyte brings the power of Airbyte to every Python developer.

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

Airbyte made simple (no UI, no database, no cluster)

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

A SQLite adapter plugin for dbt (data build tool)

Low-code Python library enabling access to APIs, tools, data sources in seconds.

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.