The open source Apache Airflow data orchestration technology is adding new features to help enterprises build better data pipelines and understand where data is coming from.

In this article, author Lena Hall discusses how to use Apache Airflow to define and execute distributed data pipelines with an example of the workflow framework running on Azure cloud platform.

Batch data processing is too slow for real-time AI: How open-source Apache Airflow 3.0 solves the challenge with event-driven data orchestration ...

“Amazon Managed Workflows for Apache Airflow solves one of the biggest operational overheads with orchestration,” said Jeremy Zogg, Senior Director of Engineering at GoDaddy.

Chicago-headquartered financial services giant Northern Trust has successfully replaced its internal financial data warehouse with Apache Airflow, an open-source alternative that has revolutionized ...