Found Description
Take the next step in your career at VLink as a Senior Data Bricks/Spark/Scala Engineering Specialist in Montreal, QC. Lead the migration of regulatory reporting pipelines to cutting-edge cloud platforms.
This hands-on role requires you to work closely with a team migrating complex data pipelines from legacy systems to Databricks and Snowflake on Azure. Your expertise in Scala, Spark, and SQL is essential for designing and testing production-grade pipelines that ensure compliance with regulatory standards.
Key Responsibilities:
• Design and implement cloud-based reporting pipelines
• Migrate existing ETL processes to modern solutions
• Conduct performance tuning and optimization in Spark applications
• Author complex SQL queries for data retrieval and processing
• Oversee continuous integration and delivery utilizing GitHub Actions
Requirements:
• Proven track record in Scala and Spark application development
This hands-on role requires you to work closely with a team migrating complex data pipelines from legacy systems to Databricks and Snowflake on Azure. Your expertise in Scala, Spark, and SQL is essential for designing and testing production-grade pipelines that ensure compliance with regulatory standards.
Key Responsibilities:
• Design and implement cloud-based reporting pipelines
• Migrate existing ETL processes to modern solutions
• Conduct performance tuning and optimization in Spark applications
• Author complex SQL queries for data retrieval and processing
• Oversee continuous integration and delivery utilizing GitHub Actions
Requirements:
• Proven track record in Scala and Spark application development