Databricks Developer
Manish Kumar YadavUnited StatesMIDPosted 6d ago
DatabricksPySparkSQLDelta LakeETLELTData PipelinesDatabricks WorkflowsGitCI/CDAzureAWSGCP
About the Role
We are looking for an experienced Databricks Developer to join our team. This role focuses on data pipeline development, data optimization, and cloud-based data engineering.
Key Responsibilities
• Develop and maintain data pipelines using Databricks
• Optimize data processing and storage solutions
• Implement ETL/ELT processes
• Utilize PySpark and SQL for data manipulation
• Work with Delta Lake for data lakehouse architecture
• Manage Databricks Workflows
• Implement Git and CI/CD practices
• Work with cloud platforms including Azure, AWS, and GCP
Requirements
• 5+ years of experience in data engineering
• Strong hands-on experience with Databricks
• Proficiency in PySpark and SQL
• Experience with Delta Lake and ETL/ELT processes
• Knowledge of Databricks Workflows
• Familiarity with Git and CI/CD
• Experience with Azure, AWS, or GCP