ETL Automation QE – ETL Testing, Python, SQL, Unix/Linux, AWS S3, Hadoop, Parquet

ETL Automation QE – ETL Testing, Python, SQL, Unix/Linux, AWS S3, Hadoop, Parquet

Toronto ON – Hybrid 4days onsite

12Months Contract

Key Responsibilities

• Design| develop| and maintain automated test frameworks for ETL workflows| ensuring data accuracy| consistency| and compliance with business requirements.
• Write complex SQL queries to validate data transformations| integrity| and quality across databases and data lakes (e.g.| Hadoop| Parquet).
• Implement Python scripts to automate testing| monitor pipeline performance| and generate reports on data quality metrics.
• Collaborate with engineering teams to integrate automated tests into CI/CD pipelines using GitHub and GitHub Actions.
• Manage data storage and retrieval processes in AWS S3| ensuring scalability and security.
• Apply QE methodologies (e.g.| test planning| risk analysis| defect tracking) to identify and resolve issues in ETL pipeline...