🎉 What's new

We've enhanced how Atlan handles tag sync for modified workflow configurations. Previously, disabling tag import would remove any imported tags from your assets. Now, when you modify a workflow to disable tag import, Atlan will automatically preserve all previously imported tags while preventing future tag import. This improvement maintains data continuity and protects your existing tag attachments.

Atlan currently supports importing tags from the following data sources:

• Databricks
• dbt
• Snowflake

🎉 What's new

Introducing a brand-new Monitor tab that makes monitoring and managing your playbooks a breeze!

 ✨ Let's dig deeper

Here's what's new for you:

• Central monitoring hub: get a bird’s-eye view of all your playbook runs —Successful, Running, Scheduled, Stopped and Waiting to start — all in one place!
• Stop playbooks: we’ve brought the stop playbook button front and center, no more digging around.
• Handy activity widgets: these widgets aggregate helpful stats for your playbooks.  
  • Assets updated: quickly view the assets impacted by your playbooks, with easy-to-use date filters.
  • Playbook run history: track the frequency of your playbook runs over time.

👏 Give it a shot

Check out these upgrades to monitoring your playbooks and let us know what you think!

As a bonus, here's what's coming soon:

• A new status to differentiate playbooks that are actively executing actions from those still queued, replacing the generic In Progress label for clearer insights.
• Visibility into tag propagation tasks, so you’re never left guessing what's happening behind the scenes.

🎉 What's new

Atlan now supports column-level lineage between your dbt sources and models! In addition, you'll be able to view dbt column-level processes between assets for more context on lineage. This release builds on the previously released support for column-level lineage for your dbt models.

🎉 What's new

Atlan now supports Looker refinements for views and explores! This release helps you discover refined fields and track lineage across your Looker projects.

✨ Let's dig deeper

Refined fields for views and explores will be displayed with a Refinement label in Atlan, helping you distinguish them from the original assets. You can find this label on each refined field in the sidebar and preview columns.

On the lineage graph, you'll notice an "R" label attached to all refined fields, making it easier to track lineage from dashboards to refined fields in views and explores.

👏 Give it a shot

If you have an existing Looker integration in Atlan, you will need to rerun the crawler to crawl and discover refinements. For any new integrations, these will be available from the start.

Learn more: What does Atlan crawl from Looker?

🎉 What's new

Atlan now supports using the Domains filter in playbooks to help you quickly select and bulk update all assets included in the selected data domains or subdomains. Previously, the domains filter only allowed you to filter for the domains themselves, not the underlying assets.

With this enhancement, you can filter for assets mapped to a specific domain and enrich metadata in bulk! You can bulk update certification status, attach tags, or even map the assets to a different domain using the domains filter. Curate assets quickly with the enhanced domains filter on playbooks!

Learn more: How to set up playbooks

🎉 What's new

Atlan now supports nested columns for the Azure Cosmos DB for MongoDB connector! This release empowers data teams to discover and enrich their nested columns in Atlan.

✨ Let's dig deeper

To extract columns from Microsoft Azure Cosmos DB collections, Atlan analyzes document schemas, which must be enabled and configured to crawl columns.

Here's what's in store for you with this update:

• Atlan supports nested columns up to level 35 for parent columns.
• Tag propagation is supported from: collections to columns, and parent to nested columns.
• You can search for, view, and enrich your Cosmos DB columns in Atlan. This includes adding descriptions, tags, terms, and more.
• Identify the data type and structure of parent and nested columns.
• Column-level lineage is currently not supported.

👏 Give it a shot

If you have an existing Cosmos DB integration in Atlan, you will need to rerun the crawler to crawl parent and nested columns. For any new integrations, these will be available from the start.

Learn more:

• What does Atlan crawl from Microsoft Azure Cosmos DB?
• How to crawl Microsoft Azure Cosmos DB

🎉 What's new

Atlan now supports crawling hidden datasets from Google BigQuery! This update brings new capabilities to streamline your metadata management and discovery processes in Atlan.

• Catalog hidden datasets — easily crawl hidden datasets by configuring the Google BigQuery crawler in Atlan.
• Discover hidden datasets and lineage — gain insights into hidden datasets and their lineage, enhancing data visibility and traceability across your projects.

Learn more: How to crawl Google BigQuery

🎉 What's new

We've enhanced the speed and performance of impact analysis reporting in Atlan! 60x speed improvement? Try it yourself to feel the difference!

You'll also notice two new columns, Immediate Upstream and Immediate Downstream, in the impact analysis report. These can help you better understand the flow of data, making it easier to distribute and manage data update dependencies across your teams. You can also use this information to create a lineage summary report, opening up endless possibilities.

We’d love to hear how you’re using these new features — please feel free to share your use cases with us!

Learn more:

• How to download and export lineage
• How to download impacted assets in Google Sheets
• How to download impacted assets in Microsoft Excel

🎉 What's new

Atlan now supports the Fivetran Platform Connector with its Fivetran enrichment package! Fivetran has deprecated its Metadata API and released a more comprehensive Platform Connector. Atlan recommends transitioning to the Fivetran Platform Connector in Fivetran for seamless metadata enrichment in Atlan. For any existing Fivetran workflows, you can modify the crawler configuration to update the extraction method.

✨ Let's dig deeper

This release brings to you two exciting upgrades to the Fivetran connector in Atlan:

• View end-to-end lineage regardless of the configured source or destination. For any Fivetran sources or destinations that are not natively supported or are supported but have not been crawled yet, Atlan will create partial assets to provide you with a complete view of lineage.
• Introducing a new asset type, connectors! This asset type will contain usage metrics like free and paid MAR, usage percentage, as well metadata about the Fivetran Platform Connector such as last run status, next scheduled run, and more.

👏 Give it a shot

To get all of these exciting updates, Atlan recommends transitioning to the Fivetran Platform Connector in Fivetran and Atlan. Moving forward, the only way to extract Fivetran metadata will be through the Fivetran Platform Connector.

Learn more:

• How to set up Fivetran
• How to crawl Fivetran
• What does Atlan crawl from Fivetran?
• Troubleshooting Fivetran connectivity
• Preflight checks for Fivetran
• What are partial assets?

🎉 What's new

Atlan now supports native integration with Amazon Managed Streaming for Apache Kafka (Amazon MSK)! This release allows you to catalog, discover, and manage your streaming data assets, providing you with seamless access to real-time data flows.

✨ Let's dig deeper

You can set up the Amazon MSK connector to:

• Seamlessly discover and document your Amazon MSK assets — topics and consumer groups.
• Use IAM role authentication to fetch metadata from Amazon MSK. SASL/SCRAM and TLS authentication methods are currently not supported.
• Use connector-specific filters to filter your Amazon MSK assets. 
• Explore asset-level lineage between topics and consumer groups. Upstream, downstream, and column-level lineage are currently not supported.
• Atlan currently only supports Apache Kafka version 2.7.1 or higher for Amazon MSK and provisioned deployment type.

👏 Give it a shot

Ready to integrate Amazon MSK with Atlan? Get started today:

• How to set up Amazon MSK
• How to set up a private network link to Amazon MSK
• How to crawl Amazon MSK
• What does Atlan crawl from Amazon MSK?
• Troubleshooting Amazon MSK connectivity
• Preflight checks for Amazon MSK

As you explore the new connector, please feel free to share your feedback!