Found Description
Data EngineerEngineer will be part of the datastore-migration Factory team that will be responsible to perform for the end-toend datastore migration from on-prem DataLake to AWS hosted LakeHouse.
Responsibilities of the Engineer include:1.
Pipeline Migrationa.Logic & Scheduling: Refactoring and migrating extraction logic and job scheduling from legacyframeworks to the new Lakehouse environment.Data Transfer: Executing the physical migration of underlying datasets while ensuring data integrity.Stakeholder Engagement: Acting as a technical liaison to internal clients, facilitating hand-off andsign-off conversations with data owners to ensure migrated assets meet business requirements.2.
Consumption Pattern MigrationCode Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (rawand modeled) for compatibility with Snowflake and Iceberg.Usage analysis: Understand usage patterns to deliver the required data products.Stakeholder Engagement: Acti...