🎉 What's new

We are excited to announce native support for Kafka events in Atlan! Kafka is an event-streaming platform that enables real-time data transfer between business applications. With this integration, data teams can now discover and document operational metadata from their Kafka systems in Atlan.

✨ Let's dig deeper

Atlan currently only supports fetching metadata from Apache Kafka and Confluent Cloud. The following asset types are supported:

• Topics
• Consumer groups

The current package does not support schema registry and schema type definitions.

The native support for Kafka assets enables you to discover and enrich your operational metadata in Atlan, visualize the data flow with end-to-end lineage, and foster collaboration across your data teams through Slack and Jira integrations.

For example, while data engineers will be able to get insights into the operational context of upstream assets, business users will be able to examine the downstream consumption of assets and review the potential impact of upstream changes.

👏 What's next

We are actively working to enhance our Kafka integration by supporting more native asset types and other flavors of Kafka. Stay tuned for more updates!