🎉 What's new

Introducing a brand-new Monitor tab that makes monitoring and managing your playbooks a breeze!

 ✨ Let's dig deeper

Here's what's new for you:

• Central monitoring hub: get a bird’s-eye view of all your playbook runs —Successful, Running, Scheduled, Stopped and Waiting to start — all in one place!
• Stop playbooks: we’ve brought the stop playbook button front and center, no more digging around.
• Handy activity widgets: these widgets aggregate helpful stats for your playbooks.  
  • Assets updated: quickly view the assets impacted by your playbooks, with easy-to-use date filters.
  • Playbook run history: track the frequency of your playbook runs over time.

👏 Give it a shot

Check out these upgrades to monitoring your playbooks and let us know what you think!

As a bonus, here's what's coming soon:

• A new status to differentiate playbooks that are actively executing actions from those still queued, replacing the generic In Progress label for clearer insights.
• Visibility into tag propagation tasks, so you’re never left guessing what's happening behind the scenes.

🎉 What's new

Atlan now supports column-level lineage between your dbt sources and models! In addition, you'll be able to view dbt column-level processes between assets for more context on lineage. This release builds on the previously released support for column-level lineage for your dbt models.

🎉 What's new

Atlan now supports Looker refinements for views and explores! This release helps you discover refined fields and track lineage across your Looker projects.

✨ Let's dig deeper

Refined fields for views and explores will be displayed with a Refinement label in Atlan, helping you distinguish them from the original assets. You can find this label on each refined field in the sidebar and preview columns.

On the lineage graph, you'll notice an "R" label attached to all refined fields, making it easier to track lineage from dashboards to refined fields in views and explores.

👏 Give it a shot

If you have an existing Looker integration in Atlan, you will need to rerun the crawler to crawl and discover refinements. For any new integrations, these will be available from the start.

Learn more: What does Atlan crawl from Looker?

🎉 What's new

Atlan now supports nested columns for the Azure Cosmos DB for MongoDB connector! This release empowers data teams to discover and enrich their nested columns in Atlan.

✨ Let's dig deeper

To extract columns from Microsoft Azure Cosmos DB collections, Atlan analyzes document schemas, which must be enabled and configured to crawl columns.

Here's what's in store for you with this update:

• Atlan supports nested columns up to level 35 for parent columns.
• Tag propagation is supported from: collections to columns, and parent to nested columns.
• You can search for, view, and enrich your Cosmos DB columns in Atlan. This includes adding descriptions, tags, terms, and more.
• Identify the data type and structure of parent and nested columns.
• Column-level lineage is currently not supported.

👏 Give it a shot

If you have an existing Cosmos DB integration in Atlan, you will need to rerun the crawler to crawl parent and nested columns. For any new integrations, these will be available from the start.

Learn more:

• What does Atlan crawl from Microsoft Azure Cosmos DB?
• How to crawl Microsoft Azure Cosmos DB

🎉 What's new

Atlan now supports crawling hidden datasets from Google BigQuery! This update brings new capabilities to streamline your metadata management and discovery processes in Atlan.

• Catalog hidden datasets — easily crawl hidden datasets by configuring the Google BigQuery crawler in Atlan.
• Discover hidden datasets and lineage — gain insights into hidden datasets and their lineage, enhancing data visibility and traceability across your projects.

Learn more: How to crawl Google BigQuery

🎉 What's new

Atlan now supports the Fivetran Platform Connector with its Fivetran enrichment package! Fivetran has deprecated its Metadata API and released a more comprehensive Platform Connector. Atlan recommends transitioning to the Fivetran Platform Connector in Fivetran for seamless metadata enrichment in Atlan. For any existing Fivetran workflows, you can modify the crawler configuration to update the extraction method.

✨ Let's dig deeper

This release brings to you two exciting upgrades to the Fivetran connector in Atlan:

• View end-to-end lineage regardless of the configured source or destination. For any Fivetran sources or destinations that are not natively supported or are supported but have not been crawled yet, Atlan will create partial assets to provide you with a complete view of lineage.
• Introducing a new asset type, connectors! This asset type will contain usage metrics like free and paid MAR, usage percentage, as well metadata about the Fivetran Platform Connector such as last run status, next scheduled run, and more.

👏 Give it a shot

To get all of these exciting updates, Atlan recommends transitioning to the Fivetran Platform Connector in Fivetran and Atlan. Moving forward, the only way to extract Fivetran metadata will be through the Fivetran Platform Connector.

Learn more:

• How to set up Fivetran
• How to crawl Fivetran
• What does Atlan crawl from Fivetran?
• Troubleshooting Fivetran connectivity
• Preflight checks for Fivetran
• What are partial assets?

🎉 What's new

Atlan now supports native integration with Amazon Managed Streaming for Apache Kafka (Amazon MSK)! This release allows you to catalog, discover, and manage your streaming data assets, providing you with seamless access to real-time data flows.

✨ Let's dig deeper

You can set up the Amazon MSK connector to:

• Seamlessly discover and document your Amazon MSK assets — topics and consumer groups.
• Use IAM role authentication to fetch metadata from Amazon MSK. SASL/SCRAM and TLS authentication methods are currently not supported.
• Use connector-specific filters to filter your Amazon MSK assets. 
• Explore asset-level lineage between topics and consumer groups. Upstream, downstream, and column-level lineage are currently not supported.
• Atlan currently only supports Apache Kafka version 2.7.1 or higher for Amazon MSK and provisioned deployment type.

👏 Give it a shot

Ready to integrate Amazon MSK with Atlan? Get started today:

• How to set up Amazon MSK
• How to set up a private network link to Amazon MSK
• How to crawl Amazon MSK
• What does Atlan crawl from Amazon MSK?
• Troubleshooting Amazon MSK connectivity
• Preflight checks for Amazon MSK

As you explore the new connector, please feel free to share your feedback!

🎉 What's new

Atlan now supports native integration with Azure Data Factory! This release empowers data teams to catalog and discover their Azure Data Factory assets in Atlan.

✨ Let's dig deeper

You can set up the Azure Data Factory connector to:

• Seamlessly discover and document your Azure Data Factory assets — pipelines, activities, datasets, data flows, and linked services.
• Use service principal authentication for fetching metadata from Azure Data Factory.
• Get excited about future upgrades like graphical view of pipelines.

👏 Give it a shot

Integrate Azure Data Factory to catalog and discover your ADF assets in Atlan!

Learn more:

• How to set up Microsoft Azure Data Factory
• How to crawl Microsoft Azure Data Factory
• What does Atlan crawl from Microsoft Azure Data Factory?
• What lineage does Atlan extract from Microsoft Azure Data Factory?
• Troubleshooting Microsoft Azure Data Factory connectivity
• Preflight checks for Microsoft Azure Data Factory

🎉 What's new

Announcing the ability to create data products directly from the lineage graph! Leverage this new ability to package all the value from your favorite lineage graphs into a data product.

✨ Let's dig deeper

Head over to any lineage graph on Atlan. You will notice a new icon on the search canvas bar. If you are familiar with data products on Atlan, the icon represents data products! Clicking on the icon brings up a popup modal. This will show all the assets that you had chosen from the lineage graph (any asset that’s not chosen inside the lineage flow will not show up in the modal).

The right-most asset in the graph will be automatically set as an “output port”. You can uncheck or check any assets from the list or even change the default output port selection.

Once done, build your product profile, enter metadata about the product such as the product name, domain it belongs to, owners, sensitivity classification, and more.

You can review the assets in the final step and click on complete. Et voilà! Your favorite lineage graph has now generated a data product!

👏 Give it a shot

Enjoy lineage-led data product creation to create more powerful data products easily! And while you try it, let us know what you think.

🎉 What's new

Atlan now supports native integration with Anomalo — a data quality platform! Get data quality metadata in near real time from Anomalo, empowering you to build trust in your assets. You can now catalog your Anomalo checks and their relationships to supported SQL assets in Atlan for maximum visibility!

✨ Let's dig deeper

The Anomalo integration heralds a rich experience for your Anomalo checks in Atlan:

• Asset discovery — view and filter assets with data quality metadata from Anomalo. You can find all the assets that have Anomalo checks associated with them, or narrow them down to those with failed checks or filter by data freshness.
• Lineage — sample the deep integration on the lineage graph, allowing you to view checks on lineage nodes and failures highlighted in red.
• Asset profile and sidebar — view data quality status on the asset preview card for a quick overview. Dig deeper into the Anomalo tab in the asset sidebar to view details on a test level. Hover over the Anomalo icon on the asset card to preview checks that failed, along with an informative popover.

👏 Give it a shot

Ready to integrate Anomalo with Atlan? Get started!

Learn more:

• How to set up Anomalo
• How to integrate Anomalo
• What does Atlan crawl from Anomalo?
• Troubleshooting Anomalo connectivity
• Preflight checks for Anomalo
• How to view event logs

For more exciting updates on the Anomalo integration, stay tuned!