Databricks Data/ETL Developer
shiva VUnited StatesMIDPosted 3h ago
DatabricksPySparkSQLDelta LakeMedallion ArchitectureAzureADLSIAMAuto LoaderStructured StreamingETL PipelinesData ModelingGitHubCI/CD
About the Role
We are looking for a Databricks Data/ETL Developer to join our team. This role requires experience with Medicaid Data Warehouse and strong technical skills in Databricks and related technologies.
Key Responsibilities
• Develop and maintain ETL pipelines
• Work with Databricks, PySpark, and SQL
• Implement Delta Lake and Medallion Architecture
• Utilize Azure services including ADLS and IAM
• Design and implement Auto Loader and Structured Streaming solutions
• Create and manage data models
• Contribute to CI/CD processes using GitHub
Requirements
• Mandatory Medicaid Data Warehouse experience
• Strong experience with Databricks, PySpark, and SQL
• Knowledge of Delta Lake and Medallion Architecture
• Experience with Azure (ADLS, IAM)
• Familiarity with Auto Loader and Structured Streaming
• ETL Pipelines and Data Modeling experience
• Preferred experience with GitHub and CI/CD