🎉 What's new

Connectors? Yes, you read that right! Announcing Atlan’s native integration with multiple Airflow distributions to enhance your data management and workflow capabilities! With this release, you can now connect Atlan to the following Airflow distributions:

• Amazon Managed Workflow for Apache Airflow (MWAA)
• Astronomer
• Google Cloud Composer
• Open source

This release marks Atlan's first-ever push-based integration leveraging the OpenLineage project. With near-real-time updates to your data estate in Atlan, your metadata will always be up-to-date and reflect the latest changes in the Airflow workflows.

✨ Let's dig deeper

Here's how these connectors can help you:

• Discover and catalog Airflow assets in Atlan, such as directed acyclic graphs (DAGs) and tasks. This enables you to get a comprehensive overview of your Airflow workflows within Atlan.
• Capture operational metadata like task run details and statuses in Atlan to help you track and monitor the execution of your Airflow workflows.
• Track data lineage between Airflow tasks as well as cross-system lineage across your data estate. This allows data engineers to better debug and understand impact and dependencies.

👏 Give it a shot

Ready to jump in and integrate Atlan with your preferred Airflow distribution? Learn more here:

• Airflow/OpenLineage:
  • How to integrate Airflow/OpenLineage
  • What does Atlan crawl from Airflow/OpenLineage?
  • Troubleshooting Airflow/OpenLineage connectivity
• Amazon MWAA/OpenLineage:
  • How to integrate Amazon MWAA/OpenLineage
  • What does Atlan crawl from Amazon MWAA/OpenLineage?
• Astronomer/OpenLineage:
  • How to integrate Astronomer/OpenLineage
  • What does Atlan crawl from Astronomer/OpenLineage?
• Google Cloud Composer/OpenLineage:
  • How to integrate Google Cloud Composer/OpenLineage
  • What does Atlan crawl from Google Cloud Composer/OpenLineage?

Get started today and let us know what you think!