Found Description
Enhance your engineering career with VLink as a Senior Data Bricks/Scala/Spark Engineering Specialist in Montreal, QC. This onsite role involves migrating legacy pipelines to modern cloud platforms.In this hands-on position at VLink, you’ll transition complex on-prem regulatory reporting systems to a state-of-the-art Databricks and Snowflake platform on Azure. Your expertise in Scala, Spark, Databricks, and SQL will be crucial in designing, implementing, and testing production pipelines that meet strict regulatory requirements.Key Responsibilities:
• Migrate ETL pipelines from legacy systems to Databricks
• Design and implement production data pipelines for compliance
• Optimize performance tuning using Scala and Spark
• Write and analyze complex SQL scripts for data extraction
• Collaborate on CI/CD processes using GitHub ActionsRequirements:
• Extensive Scala and Spark production experience
• Proficient in SQL and Databricks capabilities
• Understanding of Azu...
• Migrate ETL pipelines from legacy systems to Databricks
• Design and implement production data pipelines for compliance
• Optimize performance tuning using Scala and Spark
• Write and analyze complex SQL scripts for data extraction
• Collaborate on CI/CD processes using GitHub ActionsRequirements:
• Extensive Scala and Spark production experience
• Proficient in SQL and Databricks capabilities
• Understanding of Azu...