Senior Data Engineer – Oracle, Spark
Shiva VanacharlaUnited StatesSENIORPosted 2h ago
Apache SparkPySparkScalaPythonOracle databasesOLAPData warehousingSQLETL/ELTOracle GoldenGateCDCKafkaGCPBigQueryDataprocCloud StoragePub/SubDataflowHadoopAzureOCI
About the Role
We are seeking a Senior Data Engineer with expertise in Oracle and Spark to join our team. This role involves designing, developing, and optimizing large-scale data processing solutions.
Key Responsibilities
• Design, develop, and optimize large-scale data processing solutions using Spark, Python, PySpark, and Scala
• Build and maintain scalable ETL/ELT pipelines
• Optimize SQL queries, Spark jobs, and end-to-end data processing workflows
• Implement data integration, replication, and ingestion using Oracle GoldenGate, Kafka, and CDC frameworks
• Drive performance tuning across Oracle, Spark, and distributed data environments
• Manage end-to-end data ingestion, transformation, quality, and distribution
• Support high-volume and low-latency data processing requirements
• Implement observability, monitoring, automation, governance, data quality, and lineage
• Collaborate with application, data, and analytics teams
• Provide technical leadership, mentorship, and code reviews
Requirements
• 10+ years of overall experience in Data Engineering or related roles
• Strong hands-on experience with Apache Spark (PySpark and/or Scala)
• Strong Python programming skills
• Deep understanding of Oracle databases, OLAP, and data warehousing
• Experience optimizing Spark applications, execution plans, and distributed workloads
• Strong SQL query optimization and data modeling skills
• Experience developing large-scale ETL/ELT pipelines
• Experience with Oracle GoldenGate, CDC, or enterprise data integration