Data Engineer – Streaming to Batch Migration (Azure)

Lead Data Engineer – Streaming to Batch Migration (Azure)

We are looking for a Lead Data Engineer to drive a key transformation initiative: migrating Telelog streaming pipelines into a modern batch / mini-batch architecture in Azure.

This role combines technical leadership, architecture ownership, and hands‑on engineering in a complex, high-impact environment.

You will lead the migration of Telelog streaming pipelines into a target EventHub → Databricks architecture. You will own technical decisions, ensure end‑to‑end consistency, coordinate a small team of engineers, and deliver a robust, cost‑efficient, and observable solution.

• Design the migration strategy for Telelog pipelines (AMAP, ECE, NTG7, gen20x)
• Define sequencing and parallelization across regions and platforms
• Ensure data validation between streaming outputs and mini-batch pipelines
• Lead architecture decisions, code reviews, and engi...