Databricks Data Engineer
Surya BaddeLatin AmericaSENIORPosted 1h ago
DatabricksPySparkPythonSQLApache SparkDelta LakeETLELTLakehouse architectureAzureAWSGCPGitCI/CDworkflow orchestration
About the Role
We are looking for an experienced Databricks Data Engineer to join our growing data engineering team. The ideal candidate will have strong hands-on experience designing, developing, and optimizing scalable data pipelines using Databricks, PySpark, Python, and SQL.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines using Databricks
• Build and optimize ETL/ELT workflows using Python and PySpark
• Develop data processing solutions using Apache Spark
• Implement and manage Delta Lake architecture and Delta tables
• Integrate data from multiple sources into cloud-based data platforms
• Perform data transformation, cleansing, and validation
• Optimize Spark jobs and SQL queries for performance
• Implement data governance, security, and quality standards
• Collaborate with data architects, analysts, and cross-functional teams
Requirements
• Strong hands-on experience with Databricks
• Excellent proficiency in Python, PySpark, and SQL
• Strong experience with Apache Spark and Delta Lake
• Experience developing complex ETL/ELT pipelines
• Knowledge of Lakehouse architecture
• Experience with Azure, AWS, or GCP cloud platforms
• Familiarity with Git, CI/CD, and workflow orchestration
• Strong analytical and problem-solving skills
Candidate Eligibility
• Candidates must be based in Latin America
• Candidates from Brazil are not eligible
• Strong English communication skills preferred
• Immediate joiners or candidates with short notice periods preferred