Data Engineer
Mindy KaurRemoteSENIORPosted 7d ago
PySparkApache KafkaPythonSQLSpark StreamingData PipelinesETL/ELTReal-Time Data ProcessingCloud Data PlatformsPerformance Tuning
About the Role
We are looking for a Data Engineer to join our team. This role focuses on building and maintaining data pipelines using PySpark and Kafka.
Key Responsibilities
• Develop and maintain data pipelines using PySpark and Apache Kafka
• Work with Python, SQL, and Spark Streaming technologies
• Design and implement ETL/ELT processes
• Handle real-time data processing requirements
• Utilize cloud data platforms and performance tuning techniques
Requirements
• 9–10+ years of experience in data engineering
• Strong skills in PySpark and Apache Kafka
• Proficiency in Python, SQL, and Spark Streaming
• Experience with data pipelines and ETL/ELT processes
• Knowledge of real-time data processing
• Familiarity with cloud data platforms and performance tuning