Danish Government Agency — Lakehouse Platform

Architect & Tech Lead · 2024–2025

The Challenge

The agency's property valuation programme needed a replacement for an unstable, on-premise BI solution based on Informatica — difficult to scale and unreliable. The new data platform was to be built in the AWS cloud following a lakehouse design.

What I Delivered

  • Uptime from 60 % → 99.8 % — a stable platform the team could finally rely on
  • 10× faster analytical queries through partitioning, Delta Lake, and Athena
  • 40 % lower operating costs by replacing expensive legacy tooling with serverless services
  • Full data governance with encryption, RBAC, audit trails, and Danish data-protection compliance

Architecture

Data Layer

  • Multi-zone S3 storage (lakehouse design)
  • AWS Glue (ETL & catalog)
  • Athena for interactive analytics
  • Automated data cataloging

Development

  • Python & PySpark
  • Bash scripting
  • HCL / Terraform (IaC)
  • Lambdas & Step Functions

Security & Compliance

Encryption

End-to-end encryption via AWS KMS with customer-managed keys — data protected at rest and in transit per government standards.

Access Control

Role-based access with fine-grained permissions, full audit trails, and integration with the agency's identity provider.

Compliance Monitoring

Automated dashboards that continuously verify adherence to Danish data-protection regulations.