Lead Data Engineer
DIVYANSHI TIWARIUnited StatesLEADPosted 10d ago
PythonFastAPIRESTful API DevelopmentMicrosoft Azure Cloud ServicesAzure Function AppsService BusAKSDatabricksPySparkSQLDomain-Driven Design (DDD)Event-Driven ArchitecturePytestUnittestAutomated TestingGitSVNCI/CD PipelinesObject-Oriented ProgrammingSOLID PrinciplesProduction SupportPerformance TuningDebuggingAngularReactTypeScriptPlatform EngineeringDeveloper Self-Service ToolsAI-Ready Data ArchitecturesAgentic Automation
About the Role
We are seeking an experienced Lead Data Engineer to join an Enterprise Data Platform Services team. The ideal candidate will have strong expertise in Python, Azure, Databricks, PySpark, SQL, and API development, along with proven experience building scalable, production-ready data platform services.
Key Responsibilities
• Design, develop, and maintain scalable enterprise data platform services
• Build secure APIs and reusable platform components
• Lead technical design discussions and engineering initiatives
• Mentor junior and mid-level engineers
• Improve data quality, observability, system reliability, and performance
• Collaborate with product managers, data scientists, and cross-functional teams
• Support AI-ready data platforms and intelligent automation capabilities
Requirements
• 10+ years of experience in data engineering
• Strong expertise in Python, Azure, Databricks, PySpark, and SQL
• Experience with RESTful API development and integration
• Knowledge of Domain-Driven Design (DDD) and Event-Driven Architecture
• Familiarity with Pytest, Unittest, and Automated Testing
• Experience with Git, SVN, and CI/CD Pipelines
• Understanding of Object-Oriented Programming and SOLID Principles
• Experience with Production Support, Performance Tuning, and Debugging