Found Description
Databricks Data Engineer | PySpark, Spark SQL & Azure DevOps
Join a high-impact data migration project supporting the transition of complex analytics, workflows and reporting processes into a modern Databricks-based platform. This contract is ideal for an experienced Data Engineer with strong SAS migration, PySpark, Spark SQL, SQL, Azure DevOps and Git experience.
Location: ACT
Contract Duration: 6 months, with a 6-month extension
Security Clearance Requirement: Current Baseline clearance required
Essential Tasks:
- Migrate SAS code, workflows and reporting processes to Databricks.
- Develop and maintain PySpark, Spark SQL and SQL data solutions.
- Build data transformation, validation and reporting pipelines.
- Conduct data quality testing, reconciliation, documentation and knowledge transfer.
Key Criteria: