Found Description
- Design, build, and maintain ELT pipelines on GCP (ingestion through curated layers) using BigQuery, Dataform/Dataflow, and Cloud Composer.
- Ingest data from diverse sources streaming (Pub/Sub), batch and file-based (Cloud Storage), and healthcare interoperability formats (FHIR/HL7 via the Healthcare API).
- Implement data-quality controls (schema validation, completeness, deduplication, referential integrity) and end-to-end data lineage.
- Apply data protection and governance de-identification/tokenization (Cloud DLP with KMS/CMEK) and row- and column-level access controls.
- Model curated datasets (medallion / lakehouse and dimensional) for analytics, reporting, and downstream AI/ML.
- Build incremental and change-data-capture (CDC) loads and optimize for cost and performance (partitioning, clustering, query efficiency).
- Establish observability (monitoring, alerting) and CI/CD for data pipelines, and maintain m...
Ready to Apply?
Submit your application for Data Engineer - Google Cloud Platform (GCP) at Infiligence
Apply Now