🎉 What's new

Atlan now supports nested columns for the Azure Cosmos DB for MongoDB connector! This release empowers data teams to discover and enrich their nested columns in Atlan.

✨ Let's dig deeper

To extract columns from Microsoft Azure Cosmos DB collections, Atlan analyzes document schemas, which must be enabled and configured to crawl columns.

Here's what's in store for you with this update:

• Atlan supports nested columns up to level 35 for parent columns.
• Tag propagation is supported from: collections to columns, and parent to nested columns.
• You can search for, view, and enrich your Cosmos DB columns in Atlan. This includes adding descriptions, tags, terms, and more.
• Identify the data type and structure of parent and nested columns.
• Column-level lineage is currently not supported.

👏 Give it a shot

If you have an existing Cosmos DB integration in Atlan, you will need to rerun the crawler to crawl parent and nested columns. For any new integrations, these will be available from the start.

Learn more:

• What does Atlan crawl from Microsoft Azure Cosmos DB?
• How to crawl Microsoft Azure Cosmos DB

🎉 What's new

Atlan now supports crawling hidden datasets from Google BigQuery! This update brings new capabilities to streamline your metadata management and discovery processes in Atlan.

• Catalog hidden datasets — easily crawl hidden datasets by configuring the Google BigQuery crawler in Atlan.
• Discover hidden datasets and lineage — gain insights into hidden datasets and their lineage, enhancing data visibility and traceability across your projects.

Learn more: How to crawl Google BigQuery

🎉 What's new

We've enhanced the speed and performance of impact analysis reporting in Atlan! 60x speed improvement? Try it yourself to feel the difference!

You'll also notice two new columns, Immediate Upstream and Immediate Downstream, in the impact analysis report. These can help you better understand the flow of data, making it easier to distribute and manage data update dependencies across your teams. You can also use this information to create a lineage summary report, opening up endless possibilities.

We’d love to hear how you’re using these new features — please feel free to share your use cases with us!

Learn more:

• How to download and export lineage
• How to download impacted assets in Google Sheets
• How to download impacted assets in Microsoft Excel

🎉 What's new

Atlan now supports the Fivetran Platform Connector with its Fivetran enrichment package! Fivetran has deprecated its Metadata API and released a more comprehensive Platform Connector. Atlan recommends transitioning to the Fivetran Platform Connector in Fivetran for seamless metadata enrichment in Atlan. For any existing Fivetran workflows, you can modify the crawler configuration to update the extraction method.

✨ Let's dig deeper

This release brings to you two exciting upgrades to the Fivetran connector in Atlan:

• View end-to-end lineage regardless of the configured source or destination. For any Fivetran sources or destinations that are not natively supported or are supported but have not been crawled yet, Atlan will create partial assets to provide you with a complete view of lineage.
• Introducing a new asset type, connectors! This asset type will contain usage metrics like free and paid MAR, usage percentage, as well metadata about the Fivetran Platform Connector such as last run status, next scheduled run, and more.

👏 Give it a shot

To get all of these exciting updates, Atlan recommends transitioning to the Fivetran Platform Connector in Fivetran and Atlan. Moving forward, the only way to extract Fivetran metadata will be through the Fivetran Platform Connector.

Learn more:

• How to set up Fivetran
• How to crawl Fivetran
• What does Atlan crawl from Fivetran?
• Troubleshooting Fivetran connectivity
• Preflight checks for Fivetran
• What are partial assets?

🎉 What's new

Atlan now supports native integration with Amazon Managed Streaming for Apache Kafka (Amazon MSK)! This release allows you to catalog, discover, and manage your streaming data assets, providing you with seamless access to real-time data flows.

✨ Let's dig deeper

You can set up the Amazon MSK connector to:

• Seamlessly discover and document your Amazon MSK assets — topics and consumer groups.
• Use IAM role authentication to fetch metadata from Amazon MSK. SASL/SCRAM and TLS authentication methods are currently not supported.
• Use connector-specific filters to filter your Amazon MSK assets. 
• Explore asset-level lineage between topics and consumer groups. Upstream, downstream, and column-level lineage are currently not supported.
• Atlan currently only supports Apache Kafka version 2.7.1 or higher for Amazon MSK and provisioned deployment type.

👏 Give it a shot

Ready to integrate Amazon MSK with Atlan? Get started today:

• How to set up Amazon MSK
• How to set up a private network link to Amazon MSK
• How to crawl Amazon MSK
• What does Atlan crawl from Amazon MSK?
• Troubleshooting Amazon MSK connectivity
• Preflight checks for Amazon MSK

As you explore the new connector, please feel free to share your feedback!

🎉 What's new

Atlan now supports native integration with Azure Data Factory! This release empowers data teams to catalog and discover their Azure Data Factory assets in Atlan.

✨ Let's dig deeper

You can set up the Azure Data Factory connector to:

• Seamlessly discover and document your Azure Data Factory assets — pipelines, activities, datasets, data flows, and linked services.
• Use service principal authentication for fetching metadata from Azure Data Factory.
• Get excited about future upgrades like graphical view of pipelines.

👏 Give it a shot

Integrate Azure Data Factory to catalog and discover your ADF assets in Atlan!

Learn more:

• How to set up Microsoft Azure Data Factory
• How to crawl Microsoft Azure Data Factory
• What does Atlan crawl from Microsoft Azure Data Factory?
• What lineage does Atlan extract from Microsoft Azure Data Factory?
• Troubleshooting Microsoft Azure Data Factory connectivity
• Preflight checks for Microsoft Azure Data Factory

🎉 What's new

Announcing the ability to create data products directly from the lineage graph! Leverage this new ability to package all the value from your favorite lineage graphs into a data product.

✨ Let's dig deeper

Head over to any lineage graph on Atlan. You will notice a new icon on the search canvas bar. If you are familiar with data products on Atlan, the icon represents data products! Clicking on the icon brings up a popup modal. This will show all the assets that you had chosen from the lineage graph (any asset that’s not chosen inside the lineage flow will not show up in the modal).

The right-most asset in the graph will be automatically set as an “output port”. You can uncheck or check any assets from the list or even change the default output port selection.

Once done, build your product profile, enter metadata about the product such as the product name, domain it belongs to, owners, sensitivity classification, and more.

You can review the assets in the final step and click on complete. Et voilà! Your favorite lineage graph has now generated a data product!

👏 Give it a shot

Enjoy lineage-led data product creation to create more powerful data products easily! And while you try it, let us know what you think.

🎉 What's new

Atlan now supports native integration with Anomalo — a data quality platform! Get data quality metadata in near real time from Anomalo, empowering you to build trust in your assets. You can now catalog your Anomalo checks and their relationships to supported SQL assets in Atlan for maximum visibility!

✨ Let's dig deeper

The Anomalo integration heralds a rich experience for your Anomalo checks in Atlan:

• Asset discovery — view and filter assets with data quality metadata from Anomalo. You can find all the assets that have Anomalo checks associated with them, or narrow them down to those with failed checks or filter by data freshness.
• Lineage — sample the deep integration on the lineage graph, allowing you to view checks on lineage nodes and failures highlighted in red.
• Asset profile and sidebar — view data quality status on the asset preview card for a quick overview. Dig deeper into the Anomalo tab in the asset sidebar to view details on a test level. Hover over the Anomalo icon on the asset card to preview checks that failed, along with an informative popover.

👏 Give it a shot

Ready to integrate Anomalo with Atlan? Get started!

Learn more:

• How to set up Anomalo
• How to integrate Anomalo
• What does Atlan crawl from Anomalo?
• Troubleshooting Anomalo connectivity
• Preflight checks for Anomalo
• How to view event logs

For more exciting updates on the Anomalo integration, stay tuned!

🎉 What's new

Atlan now empowers you to organize your assets into domains and subdomains! You can now create and manage domains, add assets to those domains, and use domain-specific filters. This unlocks a new milestone in supercharging your asset discovery experience, and sets a robust foundation for advanced data governance!

✨ Let's dig deeper

You can create and manage domains and link assets to domains irrespective of whether or not you use data products.

Domains in the governance center:

• As admin users in Atlan, head over to the governance center and explore the new Domains section! From here, you can create and manage your domains and subdomains.
• Leverage flexibility with your domain structure by using the move domains and convert subdomains functionalities, accessible on the 3-dot menu.
• Once your domains are set up, you can add assets to your domains from the asset sidebar! This helps you organize your assets by a specific domain or subdomain in your organization.
• You can also bulk add assets to domains using playbooks.
• Enrich your domains from the domain profile and sidebar.

Domains in asset discovery:

• Any non-guest user with edit access to an asset's metadata can add assets to domains. This only includes admin and member users.
• Use domains as multi-select filters on the filter panel to find your domain-owned assets swiftly. You can also use the handy No domains filter to find all the assets that are yet to be added to any domain.
• Atlan currently does not support adding glossaries, categories, and terms to domains.
• Atlan currently does not support raising a request to add assets to domains.

👏 Give it a shot

Enjoy a supercharged, domain-led governance and discovery experience! And let us know what you think!

Learn more:

• How to manage domains
• How to organize assets
• How to set up playbooks
• Troubleshooting playbooks
• How to use the filters menu

🎉 What's new

Behold a revamped search experience with key UI enhancements to make your asset search in Atlan faster and more intuitive! Now you can open the search page from anywhere in Atlan, enjoy a more focused asset discovery experience, and explore context-driven filters.

✨ Let's dig deeper

Here are all the cool new things you can do:

• Quick access — use the search bar in the header or the Ctrl/Cmd + K shortcut to start a search from anywhere within Atlan, cutting down the time spent in navigating to the search page.
• Improved asset type selection — easily select one or multiple asset types to focus on the most relevant search results. This enhancement streamlines your workflow, boosting both accuracy and efficiency.
• Efficient filtering — explore the refreshed filter section and check out the new domain-specific filters. These allow you to refine your search results, helping you find exactly what you need with minimal clutter.

👏 Give it a shot

Enjoy the new and enhanced search experience in Atlan! And as you try it out, let us know what you think.

Learn more:

• How to search and discover assets
• How to use the filters menu