Data Engineer
Jyothika YerramshettyUnited KingdomSENIORPosted 4h ago
DatabricksPythonSQLPySparkApache SparkDBTData ModellingDelta LakeAzure
About the Role
We are looking for a Data Engineer to join our team at Databricks. This role focuses on designing, building, and migrating scalable data pipelines and developing end-to-end data ingestion and transformation workflows.
Key Responsibilities
• Design, build and migrate scalable data pipelines
• Develop end-to-end data ingestion and transformation workflows
• Optimize large-scale data processing and pipeline performance
• Implement data modelling and data quality frameworks
• Build and maintain Delta Lake architectures
• Work with cross-functional teams to deliver cloud data solutions
Requirements
• Strong experience in Databricks, Python and SQL
• Hands-on experience with PySpark and Apache Spark
• Experience with DBT and Data Modelling
• Strong knowledge of Delta Lake
• Azure Cloud platform experience
• Data validation, quality monitoring and pipeline optimization