Found Description
Key Responsibilities Technical Leadership & Ownership Own the end-to-end data engineering architecture for large-scale AWS data platforms Define and enforce data engineering standards, best practices, and governance frameworks Lead design reviews, code reviews, and technical decision-making across teams Act as the primary technical escalation point for complex data pipeline issues ETL/ELT Design & Development Design, build, and optimize scalable ETL/ELT pipelines using: AWS Glue (Jobs, Workflows, Crawlers) PySpark / Spark SQL, Snowflake, SnowsQL Python- based data processing frameworks Implement incremental processing, CDC, and data partitioning strategies Develop reusable and modular data pipeline frameworks for enterprise use Data Lake & Storage Management Design and manage data lake architecture on AWS (S3 Apache Iceberg ) Implement ACID-compliant data layers using Iceberg O ptimize storage formats (Parquet, ORC) and data layouts for performance Define and enforce data lifecycle, r...