Found Description
Join our data team in Toronto as a Hybrid Data Engineer. Leverage your expertise in cloud storage and real-time data streaming to enhance our data solutions.
This hybrid role combines 2-3 days onsite in Toronto with remote work flexibility. You will be pivotal in utilizing Amazon S3, AWS Glue, and Apache Kafka while maintaining data ingestion pipelines. Your experience with Amazon Redshift and AWS Step Functions will directly impact our data architecture.
Key Responsibilities:
• Design and maintain data ingestion pipelines for efficient processing
• Utilize AWS Glue and Apache Spark for data processing tasks
• Implement real-time data streaming with Apache Kafka
• Ensure data quality through performance tuning and validation
• Monitor and troubleshoot operational data workflows and pipelines
Requirements:
• Proven experience with Amazon S3 and cloud storage solutions
• Solid expertise in AWS Glue and Apache Spark
• Hands-on with Apache Kafka and real-ti...
This hybrid role combines 2-3 days onsite in Toronto with remote work flexibility. You will be pivotal in utilizing Amazon S3, AWS Glue, and Apache Kafka while maintaining data ingestion pipelines. Your experience with Amazon Redshift and AWS Step Functions will directly impact our data architecture.
Key Responsibilities:
• Design and maintain data ingestion pipelines for efficient processing
• Utilize AWS Glue and Apache Spark for data processing tasks
• Implement real-time data streaming with Apache Kafka
• Ensure data quality through performance tuning and validation
• Monitor and troubleshoot operational data workflows and pipelines
Requirements:
• Proven experience with Amazon S3 and cloud storage solutions
• Solid expertise in AWS Glue and Apache Spark
• Hands-on with Apache Kafka and real-ti...