Lead Cloud Data Engineer with Databricks

Step into a pivotal role as a Lead Cloud Data Engineer specializing in Snowflake and Databricks. This position emphasizes data pipeline optimization, programming in Python, and management in a cloud environment.
We are seeking a Cloud Data Engineer with extensive experience in Python, PySpark, SQL, and data warehousing. Ideal candidates will have at least five years in this field, especially within banking and capital markets. Your expertise will drive the development and optimization of scalable data pipelines while handling complex datasets.
Key Responsibilities:
• Build and optimize data pipelines for ingestion and transformation
• Design Spark programs within Databricks for data processing
• Develop ETL pipelines using Databricks and PySpark
• Monitor, troubleshoot, and optimize Databricks jobs
• Implement data management best practices
Requirements:
• 5+ years in Python coding and SQL development
• Experience with Databricks and cloud data warehouses<...