Google Cloud Platform (GCP) Data Engineer
Khushboo ShrivastavaUnited StatesMIDPosted 25m ago
Google Cloud Platform (GCP)BigQueryCloud DataflowDataprocData FusionSQLPythonPySparkPub/SubCloud ComposerCloud Storage (GCS)ETL/ELTTerraformKafka
About the Role
We are looking for an experienced GCP Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data solutions using Google Cloud Platform.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines on GCP
• Build and optimize ETL/ELT workflows using Cloud Dataflow, Dataproc, and Data Fusion
• Work extensively with BigQuery for data warehousing, transformation, and performance optimization
• Develop data processing solutions using Python, PySpark, and SQL
• Implement data integration using Pub/Sub and Cloud Composer (Airflow)
• Work with Cloud Storage (GCS) for data ingestion and management
• Ensure data quality, security, governance, and reliability
• Collaborate with business analysts, architects, and cross-functional teams
• Monitor and troubleshoot data pipelines and optimize performance
Requirements
• Strong hands-on experience with Google Cloud Platform (GCP)
• Expertise in BigQuery, Dataflow, Dataproc, and Cloud Storage
• Strong programming skills in Python and SQL
• Experience with PySpark and distributed data processing
• Hands-on experience building ETL/ELT pipelines
• Knowledge of Cloud Composer / Apache Airflow
• Experience with real-time and batch data processing
• Understanding of data warehousing and data modeling concepts
• Familiarity with Git, CI/CD, and DevOps practices
Preferred Qualifications
• Google Professional Data Engineer Certification
• Experience with Terraform and Infrastructure as Code
• Knowledge of Kafka, Pub/Sub, and streaming technologies
• Experience working in Agile environments