Databricks Data Engineer
Kagitapu AlekhyaUnited StatesMIDPosted 2h ago
DatabricksAzurePySparkKafkaSQLPythonDelta LakeData modelingGitHubCI/CD
About the Role
We are seeking a Databricks Data Engineer for a 1-year+ contract position. The role requires extensive hands-on experience with Databricks and Azure cloud environments.
Key Responsibilities
• Build end-to-end data engineering pipelines with CDC capabilities
• Design and implement data models using SCD Type 1 & Type 2
• Integrate data from multiple structured and unstructured sources
• Optimize data architecture for performance and scalability
• Implement CI/CD pipelines for version control and deployment
Requirements
• Extensive hands-on experience with Databricks
• Strong proficiency in PySpark and SQL
• Experience with Microsoft Azure cloud environments
• Knowledge of Delta Lake and distributed data processing frameworks
• Experience with streaming technologies like Kafka
• Familiarity with GitHub and CI/CD pipelines
• Understanding of data modeling and pipeline scalability