← Back to catalog

Data Pipeline

data-pipeline service team-data experimental analytics data tier 3
valid #data#backend#aws#example

Documentation

Data Pipeline

Ingests event streams from internal services and loads them into the analytics warehouse.

Responsibilities

  • Consumes Kafka topics from internal services
  • Transforms and normalises event schemas
  • Loads data into the analytics warehouse

Notes

  • Deployed on AWS as a managed Glue job with Step Functions orchestration
  • Early-stage service — schema contracts are not yet stable