Apache Airflow
Apache Airflow is an open-source platform for programmatically authoring, scheduling, and monitoring data and workflow pipelines, defined in Python as Directed Acyclic Graphs (DAGs) of tasks.
13 resources across 1 library
Glossary Terms(13)
Windmill
Windmill is an open-source developer platform for building internal tools, workflows, and scripts, turning Python, TypeScript, Go, or Bash scripts into schedul…
Airbyte
Airbyte is an open-source data integration platform that moves data from source systems — databases, SaaS apps, and files — into destinations like data warehou…
Alteryx
Alteryx is a self-service analytics platform that lets analysts prepare, blend, and analyze data through a visual, drag-and-drop workflow designer, without req…
Argo Workflows
Argo Workflows is a container-native workflow engine for Kubernetes that lets teams define and orchestrate multi-step, parallel jobs — such as CI pipelines or…
Dagster
Dagster is an open-source, Python-based data orchestration platform that lets teams define, schedule, test, and monitor data pipelines as software assets with…
dbt
dbt (data build tool) is an open-source, SQL-based transformation framework that lets analytics engineers build, test, and document data transformation pipelin…
Snowflake
Snowflake is a cloud-native data warehouse platform that separates storage and compute so organizations can scale each independently, running SQL analytics on…
Prefect
Prefect is a modern workflow orchestration platform for building, scheduling, and observing data pipelines in Python, designed as a more Python-native alternat…
Apache NiFi
Apache NiFi is an open-source data integration tool that lets teams design, automate, and monitor data flows between systems using a visual, drag-and-drop inte…
Apache
The Apache Software Foundation (ASF) is a US-based non-profit organization, founded in 1999, that provides legal, financial, and organizational support for hun…
Apache Airflow
Apache Airflow is an open-source platform for programmatically authoring, scheduling, and monitoring data and workflow pipelines, defined in Python as Directed…
Apache Flink
Apache Flink is an open-source distributed stream-processing framework for stateful computations over both unbounded (streaming) and bounded (batch) data at sc…
Apache Hive
Apache Hive is a data warehouse system built on top of Hadoop that lets users query and manage large distributed datasets using HiveQL, a SQL-like query langua…