Product lineage just got a 10x upgrade! Product lineage will now be generated even if the data products belong to different domains or have been modified after they are created or even archived. This release includes other improvements as well, making the depiction of dependencies between your data products automated and powerful.

✨ Let’s dig deeper

First, let's briefly revisit how product lineage works. If asset A is an output port in a data product A and a regular asset (not marked as an output port) is in data product B, then product lineage will be generated between data products A and B.

Data product lineage is now updated in the following conditions:

• Data products belong to the same or different domains.
• The asset selection in a data product is modified forming new links via output ports.
• Assets are marked as output ports OR previous output ports are unmarked.
• Data products are archived, thus removing them from product lineage.
• A data products asset list is updated when new assets satisfy the filter conditions (this is for data products created using filter rules).

Product lineage is now generated in an async manner. This means there is a time gap from the last action that can update lineage (like marking an asset as an output port) to the changes being reflected in the lineage. This time gap is around 30 minutes to an hour. Most importantly, product lineage will not be generated when any participating product has more than 30,000 assets.

Any past product lineage links that were not present due to products being in different domains will now fully reflect the updated lineage, and without requiring any action from you.

👏 Give it a shot

Visit your favorite data product today and explore a more powerful product lineage experience! Create new data products to build out and experience the new product lineage. If you do not have data products enabled, you can head over to Labs (as an admin user) and turn on the products module!

Learn more: What is business lineage?

And while you try it out, let us know what you think!