Senior Data Engineer
Rahul S.United StatesSENIORPosted 7d ago
CDPGCPCloud SpannerBigQueryPub/SubDataflowApache BeamPythonJavaSQLPySparkDatabricksSparkDelta LakeSnowflakeAzure Data FactoryEvent HubsCosmos DBKafkaCloud RunDataprocComposerAirflowTerraformCI/CD
About the Role
We are looking for a Senior Data Engineer with strong expertise in Customer Data Platforms (CDP), Google Cloud Platform, Cloud Spanner, and real-time data engineering to build scalable pipelines supporting 100M+ customer profiles, low-latency APIs, and AI-powered customer experiences.
Key Responsibilities
• Build scalable data pipelines supporting 100M+ customer profiles
• Develop low-latency APIs for customer data
• Implement AI-powered customer experiences
• Design and implement data models, ETL/ELT processes
• Manage real-time / near-real-time streaming pipelines
Requirements
• 15+ years of Data Engineering experience
• FAANG background mandatory
• 3+ years of production experience with GCP data platforms
• 3+ years of real-time / near-real-time streaming pipelines
• 3+ years of BigQuery
• 1+ year of Cloud Spanner
• 4+ years of data modeling, ETL/ELT, SQL, and Python
• 3+ years of Databricks, Spark, and Delta Lake
• 2+ years of Azure and Snowflake
• Hands-on experience with Pub/Sub, Dataflow, Apache Beam, and Kafka
• Strong PySpark, CDC, SCD Type 2, and clickstream ingestion
• Experience with Terraform, CI/CD, orchestration, and data quality