Major Transportation Company — BI Migration

Architect & Consultant · Jan–Apr 2024

The Challenge

The company needed to migrate its data platform from a previous supplier to new cloud technology. The engagement covered concept development, consulting, and training — enabling the customer's team to operate the new platform independently.

Legacy vs. Target

Before

  • Complex custom-coded pipelines
  • High maintenance overhead
  • Knowledge concentrated in a few people
  • Slow time-to-market for new data flows

After (PoC)

  • Visual, no-code pipeline builder
  • Reusable templates for common patterns
  • Business users self-serve within weeks
  • 60 % lower operating costs

Solution Details

No-Code Pipeline Framework

Built on AWS Glue Studio and Step Functions — business users drag-and-drop transformations and schedule jobs without writing code.

Template Library

Pre-built templates for schedule optimisation, passenger analytics, and route performance — covering 80 % of typical use cases out of the box.

Monitoring & Alerting

CloudWatch dashboards with SNS alerts ensure the operations team is notified within minutes of any pipeline anomaly.

Results

  • 95 % reduction in pipeline development time
  • 60 % lower operational costs
  • Zero coding required for standard transformations
  • Business-user adoption within two weeks of training

Tech Stack

No-Code Layer

  • Glue Studio
  • Step Functions
  • EventBridge
  • Lambda (pre-built functions)

Data Platform

  • S3 data lake
  • Athena for analytics
  • QuickSight for dashboards
  • CloudFormation for deployment