Databricks Engineer
Mohammad KhizarUnited KingdomMIDPosted 13h ago
Databricks NotebooksPySpark DataFrame APISQL transformationsDelta LakeDatabricks JobsJob FlowsWorkflowsDeclarative PipelinesS3IAMKMSGlueLambda
About the Role
We are looking for a talented Databricks Engineer to join our team based in London or Manchester.
Key Responsibilities
• Work with Databricks Notebooks and PySpark DataFrame API
• Implement SQL transformations and manage Delta Lake
• Develop and manage Databricks Jobs, Job Flows, and Workflows
• Create and maintain Declarative Pipelines
• Work with S3, IAM, KMS, Glue, and Lambda
Requirements
• Strong hands-on experience with Databricks Notebooks
• Proficiency in PySpark DataFrame API
• Experience with SQL transformations
• Knowledge of Delta Lake
• Familiarity with Databricks Jobs, Job Flows, and Workflows
• Experience with Declarative Pipelines
• Understanding of S3, IAM, KMS, Glue, and Lambda