Databricks Expert Data Engineer Role

Join BeachHead as a Senior Data Engineer, focusing on Databricks and advanced Data Platform Migration initiatives. Contribute to the strategic modernization of trading and market data frameworks.
This position entails developing robust data ingestion pipelines for a leading financial client. You will utilize your deep knowledge of the Databricks platform and Apache Spark to create and optimize data workflows. Ensuring data quality and collaborating with tech teams are crucial parts of your role.
Key Responsibilities:
• Develop real-time ingestion solutions with Kafka
• Create batch ingestion pipelines on Databricks
• Build medallion architecture models for data quality
• Maintain materialized views for efficient data access
• Collaborate on scalable solutions for technical requirements
Requirements:
• Expertise in Databricks and data architecture
• Proficiency in Apache Spark and Scala
• Experience with streaming data pipeline development
• Strong da...