Senior Data Engineer
Harsha KhandelwalRemoteSENIORPosted 14h ago
Google Cloud Platform (GCP)DatabricksPythonSQLApache SparkBigQueryDataprocData EngineeringData Pipeline DevelopmentData LakeLakehouse ArchitectureGoogle Cloud BigLakeCloud RunCloud IAMData Quality FrameworksCI/CD PipelinesTerraformGitHub Copilot
About the Role
We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Google Cloud Platform (GCP) and Databricks to join our growing data engineering team.
Key Responsibilities
• Design and implement data pipelines using GCP and Databricks
• Develop and maintain data lake and lakehouse architectures
• Optimize complex SQL queries and database performance
• Utilize Apache Spark for large-scale data processing
• Implement data quality frameworks and CI/CD pipelines
Requirements
• 5+ years of relevant hands-on experience in GCP and Databricks
• Strong proficiency in Python (PySpark, Pandas)
• Expertise in SQL with complex query optimization
• Experience with BigQuery, Dataproc, and Data Engineering practices
• Familiarity with Terraform and Infrastructure as Code
• Comfortable working with AI-assisted development tools
Benefits
• Opportunity to work with cutting-edge data technologies
• Remote work flexibility
• Immediate or ASAP hiring availability