Data Architect (Kubernetes + Spark)

Roles & Responsibilities

We are seeking a highly skilled Data Architect with deep expertise in Kubernetes (on-premises & Azure AKS) and Apache Spark to lead the design, deployment, and optimization of a scalable hybrid big data platform. The successful candidate will play a key role in setting up the GDP (Global Data Platform), enabling secure and efficient data management, observability, and integration with enterprise systems. This role requires close collaboration with DevOps, Security, and Data Engineering teams.

Key Responsibilities

• Architect and deploy Apache Spark, Apache Kafka, and Apache Ranger on Kubernetes clusters (on-prem and Azure AKS).
• Lead the setup of the GDP Platform on hybrid infrastructure.
• Automate deployments using Azure DevOps (ADO) pipelines or recommended CI/CD tooling.
• Configure and optimize Azure Kubernetes Services (AKS) for scalable and resilient operations.
• Integrate Azure Data...