dataMinds.be

Detailed information and registration can be found here :
https://dataminds.be/unity-catalog-microsoft-purview-and-from-files-to-apis-databricks/

### Unity Catalog & Microsoft Purview: Hand in Hand for Enterprise Data Governance

Speaker: Kristien Smans

Unity Catalog and Microsoft Purview work seamlessly together to provide end-to-end data visibility and governance. While Unity Catalog enables fine-grained metadata management and lineage tracking within Databricks, Microsoft Purview extends this governance across the entire enterprise. By integrating the two, organizations can centralize data discovery, automate classification, and improve metadata management across multiple platforms, including Azure Data Lake, Synapse, SQL, and Power BI.

The true synergy comes from their ability to connect Databricks assets with the broader enterprise ecosystem. Purview’s automated scanning brings Unity Catalog’s metadata into its data map, making Databricks data searchable alongside other business-critical sources. This unified view of data lineage helps organizations trace data movement from ingestion to consumption, improving compliance, impact analysis, and troubleshooting.

By leveraging Unity Catalog and Purview together, businesses can create a powerful, metadata-driven governance strategy that enhances data discovery, ensures consistency, and improves overall data understanding across the organization. Together, they provide a holistic approach to data governance—helping organizations unlock the full potential of their data while staying in control.

### From Files to APIs: Databricks’ Evolution Toward Low-Latency Operational Data

Speakers: Fabrice Deseyn

Databricks is evolving into a powerful platform for low-latency, operational data retrieval, enabling real-time decision-making and streamlined workflows. In this session, we’ll explore how Databricks transitioned from a file-based retrieval system for operational excellence to high-performance SQL execution, to the development of data retrieval APIs and PostgREST for online tables. This evolution is reshaping how we approach operational data, moving away from the traditional method of copying data to dedicated use cases, to a fully managed, low-latency data sync model.

Join us as we share the story of how Databricks enables new possibilities for operational workloads that put the Databricks data intelligence platform at the center of your operational workflows with near real-time data access.

This is an In-Person Evening Session

Detailed information and registration can be found here :
https://dataminds.be/data-generator-and-data-visualisation-art-cloubis/

### Data generator for your developer environment

Speaker: Sam Rutten

This is a Python-based data generator built to run on Databricks. It’s designed to produce synthetic data for local development and testing workflows—especially in cases where production data isn’t accessible or appropriate to use.

The generator supports customizable schemas and configurable data sizes. It’s intended to be simple to use and flexible enough to plug into different environments—from local notebooks to Databricks jobs.

The goal is to make it easy for developers to generate consistent, structured datasets that match the shape and constraints of real data, without relying on production pipelines. This helps speed up debugging, prototyping, and integration work.

### Data visualisation as an art form

Speakers: Vicky Cornelis

A data visualisation that is correct is good, one that is appealing is even better. An appealing visualisation has to be well-designed. They guide the attention of the viewer to the most relevant points, minimizing the viewer’s efforts. On top of that, they deliver a pleasant viewer experience.

What can we learn from art regarding the guiding of attention and pleasing the eye? What principles do artist use to do exactly this? This will be discussed during this session and practical applications of these principles onto data visualisation will be shown.