Azure Databricks Engineer
Lekhendra TomarUnited StatesMIDPosted 2h ago
DatabricksLakehouse ArchitectureDelta LakePySparkPythonSQLApache SparkStructured StreamingDelta Live TablesDatabricks WorkflowsUnity CatalogETL/ELTKafkaAzure Event HubReactAngular
About the Role
We are looking for an Azure Databricks Engineer consultant to join our client services team in Frederick, MD. This role requires extensive experience with Databricks, Lakehouse Architecture, and Delta Lake.
Key Responsibilities
• Design and implement Medallion Architecture and modern Data Lake/Data Warehouse solutions
• Develop and optimize ETL/ELT processes for data transformation
• Implement data ingestion strategies and deployment practices
• Work with event-driven and streaming technologies like Kafka or Azure Event Hub
• Integrate front-end applications using React and/or Angular
Requirements
• 10+ years of production experience with Databricks and Lakehouse Architecture
• Expertise in PySpark, Python, and advanced SQL
• Experience with Apache Spark, Structured Streaming, Delta Live Tables, Databricks Workflows, and Unity Catalog
• Strong background in data ingestion, ETL/ELT, data transformation, optimization, and deployment practices
• Working knowledge of React and/or Angular for front-end integration
• Experience with Microsoft Azure, AWS, or GCP
• Domain experience in Finance, Insurance, Regulatory Reporting, or GAAP reporting is preferred