Lead ETL GCP Data Engineer
Ashika NamdeoUnited StatesLEADPosted 13d ago
PythonETLGCPDataflowGoogle Cloud StorageCloud ComposerApache AirflowBigQueryPostgreSQL
About the Role
We are looking for a Lead ETL GCP Data Engineer to join our team. This role focuses on developing and maintaining ETL pipelines on Google Cloud Platform.
Key Responsibilities
• Design and implement ETL pipelines using GCP services
• Develop and maintain data workflows with Python and Apache Airflow
• Optimize data processing in BigQuery and PostgreSQL
• Ensure data quality and reliability across the pipeline
Requirements
• 6+ years of experience in Data Engineering and ETL pipeline development
• Strong Python programming skills, including code quality, security, resiliency, and reliability
• 5+ years of experience with GCP-based ETL and Dataflow/Python
• 3+ years of experience with Google Cloud Storage (GCS)
• 3+ years of experience with Cloud Composer / Apache Airflow
• 3+ years of experience with BigQuery and PostgreSQL
• Strong ETL concepts and expertise in writing complex SQL queries
• Excellent analytical and problem-solving skills
Good to Have
• Knowledge of Generative AI (GenAI)
• Experience with CI/CD pipelines, version control, and automated deployments