Databricks Data Engineer
Yathin DoraRemoteSENIORPosted 6d ago
DatabricksApache SparkPySparkPythonSQLDelta LakeMedallion ArchitectureAzureAWSGCPETLELTData WarehousingAzure Data FactoryAirflowDatabricks WorkflowsSpark Performance TuningGitAzure DevOpsCI/CD
About the Role
We are looking for an experienced Databricks Data Engineer with strong expertise in building scalable data pipelines and developing cloud-based data engineering solutions.
Key Responsibilities
• Build scalable data pipelines
• Develop cloud-based data engineering solutions
• Design and optimize large-scale data solutions
Requirements
• Strong expertise in Databricks & Apache Spark
• Proficiency in PySpark, Python & SQL
• Experience with Delta Lake & Medallion Architecture
• Knowledge of Azure / AWS / GCP
• Experience with ETL/ELT Pipelines & Data Warehousing
• Familiarity with Azure Data Factory / Airflow / Databricks Workflows
• Skills in Spark Performance Tuning & Optimization
• Experience with Git, Azure DevOps & CI/CD