Databricks Data Engineer
Akanksha AwasthiUnited StatesSENIORPosted 1h ago
Data EngineeringETLELTData WarehousingDatabricksPySparkApache SparkDelta LakeLakehouse ArchitectureSQLPL/SQLBatch data pipelinesReal-time data pipelinesSpark SQLDataFramesHiveDistributed computingAWSS3IAMGlueLambdaRedshiftCI/CDGitDevOps
About the Role
We are looking for a Databricks Data Engineer to join our team. This role focuses on building scalable data pipelines and implementing data warehousing solutions.
Key Responsibilities
• Design and implement ETL/ELT processes and data warehousing solutions
• Develop scalable batch and real-time data pipelines
• Implement and maintain Delta Lake and Lakehouse Architecture
• Develop advanced SQL and PL/SQL solutions
• Integrate Databricks with AWS services
• Lead technical projects and mentor junior team members
Requirements
• 8+ years of experience in Data Engineering, ETL/ELT, and Data Warehousing
• 5+ years of hands-on experience with Databricks, PySpark & Apache Spark
• Strong expertise in Delta Lake and Lakehouse Architecture
• Advanced SQL and PL/SQL development skills
• Experience developing scalable batch and real-time data pipelines
• Strong knowledge of Spark SQL, DataFrames, Hive, and distributed computing
• Hands-on AWS experience: S3, IAM, Glue, Lambda & Redshift
• Experience with Databricks-AWS integration and cloud-native architectures
• Strong understanding of data modeling, performance tuning, and data quality
• Experience with CI/CD, Git, and DevOps practices
• Technical leadership, team mentoring, and stakeholder management experience