We're thrilled to announce the release of the Azure Data Factory connector. This update empowers data-teams in importing artifacts from Azure Data Factory into Atlan as assets.

What’s in store

The following artifacts from Azure Data Factory are crawled and stored as assets in Atlan

• Pipelines
• Activities
• Datasets
• Dataflows
• Linked Services

Supported Auth Type:

• Service Principal

Future upgrades

• Graphical view for Pipelines

👏 Give it a shot

Set up the Azure Data Factory connector to catalog, and discover, your asset in Atlan!

• How to set up Microsoft Azure Data Factory
• How to crawl Microsoft Azure Data Factory
• What does Atlan crawl from Microsoft Azure Data Factory?
• What lineage does Atlan extract from Microsoft Azure Data Factory?
• Troubleshooting Microsoft Azure Data Factory connectivity

Announcing the ability to create data products directly from the lineage graph! Leverage this new ability to package all the value from your favorite lineage graphs into a data product.

✨ Let's dig deeper

Head over to any lineage graph on Atlan. You will notice a new icon on the search canvas bar. If you are familiar with data products on Atlan, the icon represents data products! Clicking on the icon brings up a popup modal. This will show all the assets that you had chosen from the lineage graph (any asset that’s not chosen inside the lineage flow will not show up in the modal).

The right-most asset in the graph will be automatically set as an “output port”. You can uncheck or check any assets from the list or even change the default output port selection.

Once done, build your product profile, enter metadata about the product such as the product name, domain it belongs to, owners, sensitivity classification, and more.

You can review the assets in the final step and click on complete. Et voilà! Your favorite lineage graph has now generated a data product!

👏 Give it a shot

Enjoy lineage-led data product creation to create more powerful data products easily! And while you try it, let us know what you think.

🎉 What's new

Atlan now supports native integration with Anomalo — a data quality platform! Get data quality metadata in near real time from Anomalo, empowering you to build trust in your assets. You can now catalog your Anomalo checks and their relationships to supported SQL assets in Atlan for maximum visibility!

✨ Let's dig deeper

The Anomalo integration heralds a rich experience for your Anomalo checks in Atlan:

• Asset discovery — view and filter assets with data quality metadata from Anomalo. You can find all the assets that have Anomalo checks associated with them, or narrow them down to those with failed checks or filter by data freshness.
• Lineage — sample the deep integration on the lineage graph, allowing you to view checks on lineage nodes and failures highlighted in red.
• Asset profile and sidebar — view data quality status on the asset preview card for a quick overview. Dig deeper into the Anomalo tab in the asset sidebar to view details on a test level. Hover over the Anomalo icon on the asset card to preview checks that failed, along with an informative popover.

👏 Give it a shot

Ready to integrate Anomalo with Atlan? Get started!

Learn more:

• How to set up Anomalo
• How to integrate Anomalo
• What does Atlan crawl from Anomalo?
• Troubleshooting Anomalo connectivity
• Preflight checks for Anomalo
• How to view event logs

For more exciting updates on the Anomalo integration, stay tuned!

🎉 What's new

Atlan now empowers you to organize your assets into domains and subdomains! You can now create and manage domains, add assets to those domains, and use domain-specific filters. This unlocks a new milestone in supercharging your asset discovery experience, and sets a robust foundation for advanced data governance!

✨ Let's dig deeper

You can create and manage domains and link assets to domains irrespective of whether or not you use data products.

Domains in the governance center:

• As admin users in Atlan, head over to the governance center and explore the new Domains section! From here, you can create and manage your domains and subdomains.
• Leverage flexibility with your domain structure by using the move domains and convert subdomains functionalities, accessible on the 3-dot menu.
• Once your domains are set up, you can add assets to your domains from the asset sidebar! This helps you organize your assets by a specific domain or subdomain in your organization.
• You can also bulk add assets to domains using playbooks.
• Enrich your domains from the domain profile and sidebar.

Domains in asset discovery:

• Any non-guest user with edit access to an asset's metadata can add assets to domains. This only includes admin and member users.
• Use domains as multi-select filters on the filter panel to find your domain-owned assets swiftly. You can also use the handy No domains filter to find all the assets that are yet to be added to any domain.
• Atlan currently does not support adding glossaries, categories, and terms to domains.
• Atlan currently does not support raising a request to add assets to domains.

👏 Give it a shot

Enjoy a supercharged, domain-led governance and discovery experience! And let us know what you think!

Learn more:

• How to manage domains
• How to organize assets
• How to set up playbooks
• Troubleshooting playbooks
• How to use the filters menu

🎉 What's new

Behold a revamped search experience with key UI enhancements to make your asset search in Atlan faster and more intuitive! Now you can open the search page from anywhere in Atlan, enjoy a more focused asset discovery experience, and explore context-driven filters.

✨ Let's dig deeper

Here are all the cool new things you can do:

• Quick access — use the search bar in the header or the Ctrl/Cmd + K shortcut to start a search from anywhere within Atlan, cutting down the time spent in navigating to the search page.
• Improved asset type selection — easily select one or multiple asset types to focus on the most relevant search results. This enhancement streamlines your workflow, boosting both accuracy and efficiency.
• Efficient filtering — explore the refreshed filter section and check out the new domain-specific filters. These allow you to refine your search results, helping you find exactly what you need with minimal clutter.

👏 Give it a shot

Enjoy the new and enhanced search experience in Atlan! And as you try it out, let us know what you think.

Learn more:

• How to search and discover assets
• How to use the filters menu

🎉 What's new

Coming to you with a couple of usability improvements to your lineage experience:

• Atlan will now display the bucket in which your objects are stored in the lineage sidebar. This is applicable for your S3 and GCS assets.
• You can now easily navigate to the pipeline graphs for your Apache Airflow DAGs and Apache Spark jobs from asset discovery! Simply click the lineage icon on the asset preview card or navigate to the sidebar to view the pipeline graph.

🎉 What's new

Introducing a new visualization widget for exploring term relationships in an interactive graph! Associated terms will now be displayed as an interconnected network, with the central term serving as an anchor and related terms branching out to illustrate semantic connections. You can click on terms to expand associations and explore your term relationships visually. Additionally, the term sidebar has been reorganized to help you better understand the semantic relationships between your terms.

🎉 What’s new

A new homepage for your products experience has arrived! Discover your most important domains and products swiftly. In addition, output ports are now marked as “out of sync” if the underlying asset is removed. This can help you update and manage your data products as you see fit.

✨ Let's dig deeper

The new data products home page organizes your domains and products for efficient consumption. Inspired by modern e-commerce experiences, the homepage helps you find what you need quickly.

The new output ports experience ensures that output ports are always stable and removed only with your consent. Therefore, if the underlying asset is removed from the product — whether due to a dynamic rule change or an asset being manually removed — the output port will be marked as “out of sync”.

👏 Give it a shot

Enjoy a more seamless data products experience with the new homepage and enhanced output ports. And as you try it, let us know what you think!

🎉 What's new

You like your things organized, so do we! With this release, there are two new enhancements to improve your dbt experience:

• The status of your dbt models, tests, and sources will be mapped to the relevant dbt environment. For job metadata for your dbt assets, such as name, status, and timestamp, Atlan will also display the dbt environment in which the jobs were executed.
• For new dbt connections, Atlan now supports filtering metadata at an environment level. For connection admins, if you have a dbt connection that includes or excludes some metadata, Atlan will only support filtering at an environment level and not at a job level as used to be the case previously. You must update any existing connections with the new configuration. Otherwise, Atlan will automatically read from the environment to which the job belongs.

🎉 What's new

You can now easily spot and open the sidebar for processes on the lineage graph. When you click on an asset or process, the sidebar will be automatically updated with relevant details, such as connector type and more.

If there are more than one processes linking two assets, each process will be represented with an icon for the specific connector. Hover over a process asset on the lineage graph to open the sidebar and view more details.