Senior Data Engineer
Sruthi GubbalaUnited StatesSENIORPosted 2h ago
OracleApache SparkPySparkScalaPythonOracle DatabasesOLAPData WarehousingETLELTOracle GoldenGateCDCKafkaGCPBigQueryDataprocCloud StoragePub/SubDataflowData LakesHadoopAzureOCI
About the Role
We are looking for an experienced Senior Data Engineer with strong expertise in Oracle analytical platforms, Apache Spark, and large-scale data engineering for our client, Persistent Systems.
Key Responsibilities
• Design, develop, and optimize large-scale data processing solutions using Spark and Python
• Build and maintain scalable ETL/ELT pipelines
• Optimize SQL queries, Spark jobs, and data processing workflows
• Implement data integration and replication using Oracle GoldenGate, Kafka, and CDC frameworks
• Drive performance tuning across Oracle and Spark environments
• Manage end-to-end data ingestion, transformation, quality, and distribution
• Ensure monitoring, automation, governance, and data lineage
• Provide technical leadership, mentorship, and code reviews
Requirements
• 10+ Years of Overall Experience in Data Engineering
• Strong hands-on experience with Apache Spark (PySpark / Scala)
• Strong Python Programming Skills
• Deep understanding of Oracle Databases, OLAP, and Data Warehousing
• Experience optimizing Spark Applications and Execution Plans
• Strong SQL Query Optimization and Data Modeling Skills
• Experience developing large-scale ETL/ELT Pipelines
• Hands-on experience with Oracle GoldenGate, CDC, or Enterprise Data Integration
• Experience with large-scale data processing and performance tuning
• H1B / H4 EAD Candidates Only
• Candidates must be based in the USA
• Hybrid Work Mode – 3 Days a Week in Irving, TX