Preflight Checks for Airflow
Do you use Atlan's Airflow and OpenLineage integrations?
All distributions of Airflow rely on a push-based mechanism to move Airflow metadata into Atlan. Validating the setup while creating an Airflow connection may not be straightforward given Airflow and OpenLineage setup happens outside of Atlan.
We've streamlined the process for setting up and validating the Airflow connection with Atlan. Recognising the complexity of validating connections due to external setups of Airflow and OpenLineage, we're introducing in-context documentation and a test Airflow DAG to verify the connection. This improvement ensures the Airflow and OpenLineage integration is configured correctly for Atlan to catalog lineage metadata.