Jobs → Data & Analytics → Lead Data Engineer

Lead Data Engineer

DIVYANSHI TIWARIUnited StatesLEADPosted 10d ago
PythonFastAPIRESTful API DevelopmentMicrosoft Azure Cloud ServicesAzure Function AppsService BusAKSDatabricksPySparkSQLDomain-Driven Design (DDD)Event-Driven ArchitecturePytestUnittestAutomated TestingGitSVNCI/CD PipelinesObject-Oriented ProgrammingSOLID PrinciplesProduction SupportPerformance TuningDebuggingAngularReactTypeScriptPlatform EngineeringDeveloper Self-Service ToolsAI-Ready Data ArchitecturesAgentic Automation
About the Role We are seeking an experienced Lead Data Engineer to join an Enterprise Data Platform Services team. The ideal candidate will have strong expertise in Python, Azure, Databricks, PySpark, SQL, and API development, along with proven experience building scalable, production-ready data platform services. Key Responsibilities • Design, develop, and maintain scalable enterprise data platform services • Build secure APIs and reusable platform components • Lead technical design discussions and engineering initiatives • Mentor junior and mid-level engineers • Improve data quality, observability, system reliability, and performance • Collaborate with product managers, data scientists, and cross-functional teams • Support AI-ready data platforms and intelligent automation capabilities Requirements • 10+ years of experience in data engineering • Strong expertise in Python, Azure, Databricks, PySpark, and SQL • Experience with RESTful API development and integration • Knowledge of Domain-Driven Design (DDD) and Event-Driven Architecture • Familiarity with Pytest, Unittest, and Automated Testing • Experience with Git, SVN, and CI/CD Pipelines • Understanding of Object-Oriented Programming and SOLID Principles • Experience with Production Support, Performance Tuning, and Debugging

Similar projects

AI/ML Business Data Analyst
Sai Vamshi (Thomas) · AI/ML, Business Data Analysis, SQL
Data Modeler
Palak Baheti · Enterprise Data Modeling, Snowflake, Source-to-Target (S2T) Mapping
Solution Architect / Tech Lead Databricks AWS
Marcio Pina Branquinho · AWS, Databricks, Power BI
Early · 0 applied1 of 8,040 projects

Apply with AI cover letter

AI writes a personalized application in 19 seconds. Just upload your resume.

No credit card · First application free
© 2026 Freelanly · Terms · Privacy