Jobs → Data & Analytics → Lead Data Engineer

About the Role We are looking for an experienced Lead Data Engineer to design, build and maintain high-performance data pipelines and processing solutions on Databricks. Key Responsibilities • Designing and building scalable pipelines • Develop data processing solutions using PySpark and Python • Cleansing, validating and transforming data so everyone can rely on it • Optimizing Spark jobs and improve pipeline performance • Solving problems alongside fellow engineers, analysts and tech teams Requirements • 7-10 years in Data Engineering, with strong hands on Databricks experience • Solid command of PySpark, Python, Apache Spark, and SQL • Experience with Delta Lake, and ETL/ELT pipelines • Working knowledge of Azure, AWS or GCP • Git and CI/CD know-how