Jobs → Data & Analytics → Lead Data Engineer

About the Role We are looking for an experienced lead data engineer to build and enhance scalable enterprise data platform services. The ideal candidate will have strong expertise in Python, Azure, Databricks, PySpark, API development, and production software engineering. Key Responsibilities • Lead technical design, product development, and delivery of enterprise data platform services. • Build scalable services using Python, FastAPI, Azure Kubernetes Service (AKS), and Databricks. • Design and integrate secure, reliable RESTful APIs. • Develop reusable platform components and self-service engineering tools. • Optimize performance, troubleshoot production issues, and improve system reliability. • Mentor engineers and drive coding standards, testing practices, and engineering excellence. • Support AI-ready data platforms, intelligent observability, and agentic automation. Requirements • 10+ years of software development experience. • Strong Python, FastAPI, REST API, and SQL expertise. • Hands-on experience with Microsoft Azure, Azure Functions, Service Bus, and AKS. • Databricks and PySpark experience. • Domain-Driven Design (DDD) and event-driven architecture. • Pytest, Unittest, unit testing, and integration testing. • Git/SVN, CI/CD pipelines, OOP, and SOLID principles. • Agile methodologies, including Scrum and XP. • Strong technical leadership, communication, and problem-solving skills.