Jobs → Data & Analytics → Lead Data Engineer

About the Role We are looking for a Lead Data Engineer to join our team in the USA. This is a 12-month contract position focusing on Azure Databricks and related data engineering technologies. Key Responsibilities • Design and implement data solutions using Azure Databricks • Manage and optimize data pipelines with Azure Data Factory • Develop and maintain PySpark applications • Work with ADLS Gen2, Delta Lake, and Azure Synapse • Implement CI/CD practices and unit testing • Perform Spark performance tuning and data partitioning Requirements • 12+ years of experience in data engineering or related technologies • Strong hands-on experience with Azure Databricks, Azure Data Factory, PySpark, and SQL • Experience with ADLS Gen2, Delta Lake, Azure Synapse, and Azure SQL • Knowledge of Git, CI/CD, unit testing, and Terraform • Familiarity with Spark performance tuning, data partitioning, and incremental data loads • Scala, Python, Airflow, and Databricks SQL experience is an added advantage