Found Description
Responsibilities
- Design, develop, and maintain scalable data processing pipelines using Scala to ingest, cleanse, and transform large volumes of market data.
- Collaborate with product owners, data scientists, and stakeholders to translate business requirements into technical solutions.
- Implement data quality checks and monitoring mechanisms to ensure the accuracy of risk analytics.
- Optimize existing data processing workflows for performance, latency, and resource utilization.
- Work with cloud-based platforms (AWS, Azure) to deploy and manage big data solutions.
- Partner with DevOps teams to automate deployment processes and ensure system reliability.
- Conduct code reviews, write unit tests, and contribute to agile development best practices.
- Provide technical guidance and support to junior team members within the squad.
Requirements
- 3-5 years of experience in big data...