Jobs → Data & Analytics → Lead Data Engineer

About the Role We are looking for an experienced Lead Data Engineer to lead the design, development, and implementation of scalable, reliable, and high-performance data solutions. The ideal candidate will have strong expertise in data engineering, cloud technologies, ETL/ELT pipelines, data warehousing, and distributed data processing. Key Responsibilities • Build and maintain robust ETL/ELT pipelines for batch and real-time data processing • Optimize data pipeline performance, reliability, scalability, and cost • Establish data quality checks, monitoring, logging, and error-handling mechanisms • Implement data security, governance, lineage, and access-control standards Requirements • 8+ years of experience in data engineering, with proven technical leadership experience • Strong hands-on expertise in SQL, Python, Spark, and data pipeline development • Experience designing and implementing enterprise-scale cloud data solutions • Advanced SQL and Python skills • ETL/ELT pipeline development experience • Knowledge of Microsoft Azure: Azure Data Factory, Azure Databricks, ADLS Gen2, Synapse Analytics • Data warehouse and data lake design skills • Lakehouse architecture understanding • Dimensional modeling, Star and Snowflake schemas knowledge • Delta Lake and incremental data processing experience • Git and version control skills • Azure DevOps, Jenkins, or GitHub Actions experience • CI/CD pipeline implementation experience • Data validation and reconciliation skills • Data lineage and metadata management experience