Found Description
Mandatory Skill: Azure Databrick Structured Streamin Delta Lake Delta Live Tables (DLTSpark Declarative Pipelines (SDP DatabricksAsset Bundle Unity Catalo Auto Loade Cloud File Apache SparK Preferred Experience eMigration of traditional ETL pipelines to Spark Declarative Pipeline Enterprise-scale Lakehouse implementation Data Quality frameworks and governance solution Large-scale streaming architectures processing millions of events per da Experience implementing Medallion Architecture Streaming & Real-Time Data Processing Design and develop real-time streaming pipelines using Databricks Structured Streaming. Build and maintain Kafka-based ingestion frameworks. Handle late-arriving events using watermarks, event-time processing, and stateful streaming concepts .Implement exactly-once processing and checkpointing mechanisms. Monitor and optimize streaming workloads for performance and reliability. Spark Declarative Pipelines (SDP) & Delta Live Tables (DLT) Design and implement Spark Dec...