Data Engineer
Anitha R.RemoteSENIORPosted 10d ago
PySparkApache KafkaPythonSQLSpark StreamingData PipelinesETL/ELTReal-Time Data ProcessingCloud Data PlatformsPerformance Tuning
About the Role
We are looking for a Data Engineer to join our team. This role focuses on building and maintaining data pipelines using PySpark and Apache Kafka.
Key Responsibilities
• Develop and maintain data pipelines using PySpark and Apache Kafka
• Implement ETL/ELT processes for data transformation
• Work with real-time data processing systems
• Optimize performance of cloud data platforms
Requirements
• 9–10+ years of experience in data engineering
• Strong skills in PySpark, Apache Kafka, Python, and SQL
• Experience with Spark Streaming and real-time data processing
• Knowledge of cloud data platforms and performance tuning
Benefits