🎉 What's new

The Databricks connector in Atlan now supports extracting lineage using system tables! You can leverage system tables to extract Databricks lineage, making the process significantly faster, more robust, and reducing the number of API calls required.

✨ Let's dig deeper

You can use Databricks system tables in Atlan for:

• Faster lineage extraction — instead of multiple API calls, Atlan will query system tables to extract lineage and speed up the extraction process.
• Marker-based implementation — this approach ensures a more efficient and incremental extraction of lineage.
• Reduced workflow times — faster extraction and processing lead to streamlined workflows, reducing overall workflow times.
• Incremental lineage preservation — this method of extraction supports incremental extraction and publication. This means that even if the Databricks retention period for lineage data ends, Atlan will still display lineage unless the assets are deleted within a given data flow.

👏 Give it a shot

Ready to use system tables for extracting Databricks lineage in Atlan? Get started today:

• How to set up Databricks
• How to extract lineage and usage from Databricks

🎉 What's new

Atlan now displays cyclic dependencies with a different edge color! Plus, self-cyclic dependencies sport a new icon, so that you can easily expand and collapse dependencies on the lineage graph.

Finally, it can be confusing when a node is both upstream and downstream for another node, right? How to interpret the dependencies in both directions? We’ve got you covered, simply click the new eye icon to view the dependencies in both directions.

🎉 What's new

Announcing many more filters to help you find the right assets for your data products! While adding assets via browse, you now can choose from a diverse set of filters like connections, owners, terms, and more to power through asset selection.

✨ Let's dig deeper

To create data products in Atlan, you could already use the Add via browse method to selectively pick and choose your assets. To help you get to those assets quicker, you can now use a suite of filters:

• Hierarchy — connector, connection, database, and schema filters
• Certificate
• Owners
• Tags
• Terms
• Properties

You can also close the filters pane anytime by clicking on X in the top right. The data product creation page will display a count of the filters you have applied.

👏 Give it a shot

Enjoy greater flexibility in your data product creation experience! Try out the new filters and let us know what you think. Learn more: How to create data products.

🎉 What's new

Announcing two new enhancements to supercharge your asset discovery experience in Atlan — collapsible sidebar on the Assets discovery page and check other matches in command menu search!

Hide sidebar for asset discovery

You can now collapse the sidebar on the Assets page! With the ability to hide the sidebar during search, your asset discovery experience takes center stage. While the sidebar displays critical metadata for your assets, Atlan believes in the power of choice. You can either collapse the sidebar to focus on your assets and asset filters or keep it on view.

Enjoy a clutter-free search experience with the new collapsible sidebar!

Explore other matches in command menu search

Atlan now enables you to check your “other” matched search results in command menu search! This was already enabled for searching on the Assets page, now you can do the same with command menu search.

If you're filtering and searching for a particular asset type using Cmd/Ctrl + K and nothing comes up, you'll be able to view other asset types that match your search keywords. You can simply click the Check other matches button and check all other search matches.

👏 Give it a shot

Power your discoveries in Atlan with these two new enhancements! And as you try it out, let us know what you think.

🎉 What's new

Introducing simple, effective, and user-friendly error messages for Snowflake workflows to help you troubleshoot better. With this release, Atlan will generate simplified error messages for test authentication and preflight check failures for your Snowflake workflows.

These English-language error messages are currently only supported for Snowflake:

• Error messages now provide concise and descriptive information about the issue encountered, helping you quickly identify and address the problem.
• These will include references to relevant documentation, empowering you to resolve issues independently.
• In case of any workflow failures due to authentication or preflight checks, you will also receive a Slack or Teams notification (if configured) with the link to troubleshoot.

Learn more: Troubleshooting Snowflake connectivity

🎉 What’s new

Find your schemas quicker by typing in the database and schema name separated by dots — for example, database.schema. This way, you can continue to find your SQL assets faster by typing in the database and schema before the asset title like database.schema.table or schema.table. You can also match on the qualified name of the asset by typing in the qualified name enclosed within double quotes!

Power your discovery experience with a more powerful dot notation search! And as you try it out, let us know what you think.

🎉 What's new

Atlan’s browser extension opens up a sidebar within your IBM Cognos Analytics workspace and provides you with all the context you need, without having to switch tools.

Previously, users had to switch to Atlan for more information about their IBM Cognos Analytics assets — for example, who owns them or to analyze downstream impact. Now, you can use Atlan's browser extension to learn more about your folders, dashboards, packages, explorations, reports, files, data sources, and modules right from your IBM Cognos Analytics workspace.

🎉 What's new

Atlan now supports one-way tag sync for your Databricks tags! You can import your Databricks tags from Unity Catalog to Atlan and update your Databricks assets with the imported tags. You can also attach tag values and filter your Databricks assets by imported tags.

Tag sync is currently one way — Databricks ➡️ Atlan. Keep an eye out for reverse tag sync coming soon!

✨ Let's dig deeper

Here's how to import your Databricks tags in Atlan:

1. Ensure that you have a Unity Catalog-enabled workspace and a SQL warehouse configured.
2. Create tags or have existing tags in Databricks.
3. Grant the required permissions on Unity Catalog, depending on the authentication method you want to use.
4. Modify an existing Databricks workflow or create a new one to turn on the Import Tags toggle.
5. Select the SQL warehouse on which you want to execute the queries.
6. Run the workflow!

After the workflow has run successfully, you will see your Databricks tags in Atlan. Atlan also supports tag propagation for your Databricks tags.

👏 Give it a shot

Learn more about Databricks tag management here:

• How to manage Databricks tags
• How to set up Databricks
• How to crawl Databricks
• How to attach a tag
• What are tags?
• How to use the filters menu

Supercharge your data governance efforts with Databricks tag management in Atlan! Please note that this feature will be a paid addition. Reach out to your customer success manager for more information.

🎉 What's new

Introducing domain lineage for your data domains in Atlan! For a comprehensive overview of business lineage, you can now view and better understand relationships between your domains and subdomains through data products on a lineage graph.

Learn more:

• What is business lineage?
• How to create data domains

🎉 What's new

Introducing a new and improved pipeline graph! With this release, you will be able to show or hide assets linked to Airflow tasks, giving you complete visibility over what each task reads from and writes to.

And that's not all, you'll also notice improvements in the usability and performance of the lineage graph. Crisscrossing edges, browser hanging, or lineage too slow or needs too many clicks? We've worked extensively to provide you with better performance and usability:

• Eliminated crisscrossing edges on the graph.
• Reduced the time required to render and browse lineage graph — from minutes to seconds!

Check out both and let us know what you think!