Jobs → Data & Analytics → Lead Data Engineer

Lead Data Engineer

Sourav D.(SD)United StatesLEADPosted 2h ago
DatabricksDelta LakeUnity CatalogPySparkPythonSQLAWS S3Data Pipeline OptimizationCI/CDAuto LoaderStructured StreamingCDCAirflow
About the Role We are looking for a hands-on Lead Data Engineer with strong expertise in Databricks, PySpark, Python, and SQL to build and optimize scalable data pipelines. Key Responsibilities • Build and optimize scalable data pipelines • Implement Medallion Architecture (Bronze/Silver/Gold) • Work with AWS S3 and optimize data pipelines • Implement CI/CD processes Requirements • 9-15 years of experience in data engineering • Strong expertise in Databricks, PySpark, Python, and SQL • Experience with Delta Lake and Unity Catalog • Knowledge of Medallion Architecture • Experience with AWS S3 and data pipeline optimization • Experience with CI/CD • Technical leadership and code reviews Experience with Auto Loader, Structured Streaming, CDC, or Airflow is a plus.

Similar projects

Test Analyst
Erica Mae Aguilar · Quality Assurance, Software Testing, SQL
Business Analyst – Next Gen MES & Data Analytics
Sana Parikshith · MES, Manufacturing Execution Systems, Data Analytics
Business Systems Analyst
Maulik Patel · SQL, HL7, FHIR
Early · 0 applied1 of 8,118 projects

Apply with AI cover letter

AI writes a personalized application in 19 seconds. Just upload your resume.

No credit card · First application free
© 2026 Freelanly · Terms · Privacy