Found Description
Responsibilities
- Develop and maintain ETL/ELT pipelines using Python, PySpark, and SQL.
- Build and support batch and real-time data processing solutions.
- Integrate data from multiple sources and ensure data quality and reliability.
- Monitor, troubleshoot, and optimize data pipelines and workflows.
- Collaborate with business, analytics, and technology teams to deliver data-driven solutions.
- Support cloud-based data platforms and data warehousing initiatives.
- Develop automation and monitoring solutions to improve operational efficiency.
- Any other ad-hoc duties as assigned by supervisor.
Requirements
- Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science, or a related discipline.
- 3+ years of Data Engineering or ETL development experience.
- Strong proficiency in Python, PySpark, and SQL.
- Experience with Hadoo...