Jobs → Data & Analytics → Lead Data Engineer

About the Role We are looking for a Lead Data Engineer to join our team. This role focuses on designing and implementing scalable data solutions using Databricks and other data engineering technologies. Key Responsibilities • Design and implement Databricks architecture, notebooks, jobs, and workflows • Develop modular data transformations and reusable components using Python and SQL • Create scalable data pipelines with ETL/ELT processes and API integrations • Implement data architecture including source-to-target mapping and data modeling • Manage data governance and security using Unity Catalog and access controls • Develop and maintain REST APIs for data platform integration • Ensure data quality through completeness checks and source-to-target validation • Monitor pipeline reliability with logging, alerting, and exception handling • Optimize performance through SQL tuning and efficient pipeline execution • Enable BI and reporting capabilities with governed datasets and views • Configure environments and manage deployment processes • Document solution architecture and technical designs Requirements • Strong hands-on experience with Databricks, Python, and SQL • Proven expertise in ETL/ELT processes and data architecture • Experience with data governance frameworks and Unity Catalog • Strong understanding of REST APIs, monitoring, and production deployment • Ability to lead solution design for reliable, secure, and performance-optimized data platforms