Found Description
**Job Summary****Responsibilities**- Develop and optimize data workflows using Spark in Scala to ensure efficient data processing and analysis.
- Implement and manage Databricks Unity Catalog Admin to maintain data governance and security.
- Utilize Databricks CLI for seamless integration and automation of data tasks.
- Design and schedule workflows with Apache Airflow to ensure timely data pipeline execution.
- Manage data storage and retrieval using Amazon S3 and Amazon Redshift for robust data solutions.
- Write and maintain Python scripts to support data processing and analysis tasks.
- Leverage Databricks SQL for querying and analyzing large datasets effectively.
- Implement Databricks Delta Lake to ensure data reliability and consistency.
- Create and manage Databricks Workflows to automate and streamline data processes.
- Collaborate with cross-functional teams to deliver high-quality data solutions that meet business needs.
- Ensure da...