Data Engineer/Databricks Engineer
Gaurav SinghUnited StatesSENIORPosted 4d ago
DatabricksAWSPySparkScalaSparkDeltaLakeLakehouseArchitectureAWSEMRDataEngineeringMLOpsDataMeshPerformanceOptimization
About the Role
We are looking for an experienced Data Engineer with strong expertise in Databricks and AWS ecosystems to join our team.
Key Responsibilities
• Build high-volume, production-grade ETL/ELT pipelines using PySpark or Scala Spark
• Implement streaming and Delta Live Tables (DLT)
• Develop MLOps solutions on Databricks and AWS EMR
• Apply Data Mesh architecture principles
• Perform advanced cost optimization and performance tuning
Requirements
• Deep knowledge of Databricks and AWS ecosystems
• Hands-on experience with Delta Lake and Lakehouse architecture
• Expertise in building production-grade ETL/ELT pipelines
• Experience with streaming and Delta Live Tables
• Familiarity with MLOps on Databricks and AWS EMR
• Understanding of Data Mesh architecture
• Skills in cost optimization and performance tuning