GCP Data Engineer
Gopinadh ThathaUnited StatesSENIORPosted 24m ago
GCPBigQueryGoogle Cloud StorageDataflowDataprocPub/SubSQLPythonPySparkShell ScriptingApache SparkApache BeamHadoopGoogle Cloud ComposerCloud FunctionsCloud RunCloud SchedulerCloud LoggingGitJenkinsTerraformCloud BuildETLELTData WarehouseData LakeCloud ComputingVertexAIBigQueryML
About the Role
We are seeking a GCP Data Engineer with 12+ years of experience to join our team. This role involves designing, developing, and maintaining scalable ETL/ELT data pipelines using Google Cloud Platform services.
Key Responsibilities
• Design and implement RESTful APIs
• Lead code reviews and mentor junior developers
• Collaborate with product team on technical requirements
• Design and develop scalable ETL/ELT data pipelines
• Optimize BigQuery performance through partitioning, clustering, and query tuning
• Implement data modeling, dimensional modeling, and data warehousing concepts
• Utilize GCP services like Cloud Functions, Cloud Run, and Cloud Scheduler
• Ensure data security and governance through IAM, service accounts, and encryption
• Implement CI/CD pipelines and Infrastructure as Code (IaC) solutions
Requirements
• 12+ years of experience in IT, Data Engineering, Data Warehousing, Big Data, and Cloud Technologies
• Strong expertise in Google Cloud Platform (GCP) and enterprise cloud data engineering solutions
• Hands-on experience with BigQuery, Google Cloud Storage (GCS), Dataflow, Dataproc, and Pub/Sub
• Strong experience designing, developing, and maintaining scalable ETL/ELT data pipelines
• Expertise in SQL, Advanced SQL, Python, PySpark, and Shell Scripting
• Hands-on experience with Apache Spark, Apache Beam, Hadoop, and distributed data processing frameworks
• Strong knowledge of Google Cloud Composer (Apache Airflow) for workflow orchestration and scheduling
• Experience building real-time and batch data processing pipelines using GCP services
• Expertise in BigQuery optimization, partitioning, clustering, query performance tuning, and cost optimization
• Strong experience with data modeling, dimensional modeling, Star Schema, Snowflake Schema, and Data Warehousing concepts
• Hands-on experience with Cloud Functions, Cloud Run, Cloud Scheduler, and Cloud Logging
• Strong knowledge of data integration, data migration, enterprise data lakes, and data warehouse architecture
• Experience with GCP IAM, service accounts, encryption, security policies, and data governance
• Hands-on experience with CI/CD pipelines, Git, Jenkins, Terraform, Cloud Build, and Infrastructure as Code (IaC)
• Experience with GCP deployments, monitoring, logging, release management, and production support
• Knowledge of Google Cloud Dataplex, Data Catalog, and data quality frameworks
• Experience with modern data architectures, Lakehouse, Data Lakes, and Enterprise Data Platforms
• Strong understanding of Agile methodologies, Scrum, code reviews, and enterprise development standards
• Ability to lead technical teams, mentor data engineers, define technical architecture, and collaborate with business stakeholders
• Excellent communication, leadership, analytical, and problem-solving skills