GCP Data Engineer
Prashanth MRemoteSENIORPosted 11d ago
GCPApache SparkScalaPythonGKEBigQueryDataflowDataprocCloud StoragePub/SubDockerKubernetesCI/CDETL/ELTSQLAirflowCloud ComposerGitAgileAngularReact
About the Role
We are looking for an experienced GCP Data Engineer with 10+ years of overall experience in data engineering or software engineering to design, develop, and optimize scalable data platforms and pipelines.
Key Responsibilities
• Design and develop scalable data platforms and pipelines
• Optimize data solutions for performance and efficiency
• Implement and maintain data engineering solutions on Google Cloud Platform
• Collaborate with cross-functional teams to ensure data quality and governance
Requirements
• 10+ years of overall data engineering or software engineering experience
• Strong hands-on experience with Google Cloud Platform (GCP)
• Expertise in Apache Spark, Scala, and Python
• Experience with BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub
• Experience with GKE, Docker, Kubernetes, and CI/CD pipelines
• Strong understanding of ETL/ELT, data pipelines, SQL, and data modeling
• Experience with REST APIs and microservices architecture
• Exposure to frontend technologies such as Angular or React
• Knowledge of data orchestration tools such as Airflow or Cloud Composer
• Experience with Git, Agile methodologies, data quality, and governance
• Healthcare domain experience is mandatory
• Multi-cloud experience is mandatory