Data Engineer
Hemanth DeepalaUnited StatesSENIORPosted 6d ago
PythonSQLPySparkScalaApache SparkETLBig Data
About the Role
We are looking for an experienced Data Engineer to join our team in Cary, NC. The ideal candidate will have strong hands-on expertise in Python, SQL, PySpark, and Scala, along with proven experience building scalable data pipelines and data engineering solutions.
Key Responsibilities
• Design, develop, and optimize scalable data pipelines and ETL/ELT workflows.
• Build and maintain robust data processing solutions using Python, PySpark, SQL, and Scala.
• Follow data engineering best practices and develop efficient data solutions.
• Optimize data processing performance, reliability, and data quality.
• Collaborate with cross-functional teams to deliver high-quality data solutions.
• Troubleshoot and resolve data pipeline and processing issues.
Requirements
• 10+ years of experience in Data Engineering or related fields.
• Strong proficiency in Python, SQL, PySpark, and Scala.
• Extensive experience with Apache Spark, ETL/ELT pipelines, and big data processing.
• Strong understanding of data modeling, data architecture, and performance optimization.
• Excellent problem-solving and communication skills.