Found Description
Data Engineer III is responsible for developing complex data pipelines and ensuring data quality, which involves transforming raw data into a form that can be easily analyzed.
- Develop complex data pipelines to extract, transform, and load (ETL) data
- Design and maintain efficient data models and databases
- Implement and ensure data quality and validation processes
- Collaborate with data analysts and scientists to meet data needs
- Optimize database performance by analyzing queries and debugging
- Establish and maintain data security protocols
- Document data processes and pipeline architectures for future reference
- Perform other duties as assigned
- Conform with all company policies and procedures
- Develop complex data pipelines to extract, transform, and load (ETL) data Databricks, Python, Api, Spark, Kafka, or similar distributed systems
- Experience with ingesting various source data formats such as XML, JSON, Parquet, SequenceFile, Cloud Dat...
- Develop complex data pipelines to extract, transform, and load (ETL) data
- Design and maintain efficient data models and databases
- Implement and ensure data quality and validation processes
- Collaborate with data analysts and scientists to meet data needs
- Optimize database performance by analyzing queries and debugging
- Establish and maintain data security protocols
- Document data processes and pipeline architectures for future reference
- Perform other duties as assigned
- Conform with all company policies and procedures
- Develop complex data pipelines to extract, transform, and load (ETL) data Databricks, Python, Api, Spark, Kafka, or similar distributed systems
- Experience with ingesting various source data formats such as XML, JSON, Parquet, SequenceFile, Cloud Dat...