Databricks Engineer
Deepanshu BaberwalUnited StatesSENIORPosted 11d ago
DatabricksAWSDelta LakePySparkApache SparkScalaETLELTStructured StreamingDelta Live TablesMLOpsData Mesh
About the Role
We are looking for a Databricks Engineer to join our team in Wilmington, DE. This role focuses on building and maintaining high-volume, production-grade ETL/ELT pipelines using Databricks and AWS ecosystems.
Key Responsibilities
• Design and implement Delta Lake and Lakehouse architecture
• Develop PySpark, Apache Spark, and Scala applications
• Engineer high-volume, production-grade ETL/ELT pipelines
• Utilize Structured Streaming and Delta Live Tables for data processing
• Implement MLOps on Databricks
• Apply Data Mesh architecture principles
Requirements
• Strong expertise in Databricks and AWS ecosystems
• Experience with Delta Lake and Lakehouse architecture
• Proficiency in PySpark, Apache Spark, and Scala
• Experience with high-volume, production-grade ETL/ELT pipeline engineering
• Mandatory: 13+ years of overall experience and willingness to work onsite 5 days a week