Azure Data Engineer
Tamer Omar, MBA, PMPRemoteMIDPosted 6d ago
Azure DatabricksAdfsAzure CloudData/Cloud EngineerCloud AzureWorkflowDLTDelta LakePySpark
About the Role
We are seeking an experienced Azure Data Engineer to join our team. This role involves architecting and implementing Azure-based data solutions using cutting-edge technologies.
Key Responsibilities
• Architect and implement Azure-based data solutions
• Work with technologies like Azure Databricks, ADF, Synapse, Databricks Unity Catalog, Delta Lake, PySpark, SQL
• Provide optimized and cost-effective solutions
• Design solution architectures using Azure
• Implement CI/CD pipelines for deploying data solutions
Requirements
• 4-12 years of experience as a Data/Cloud Engineer on Azure Cloud technologies
• Expertise in Azure Databricks, including Architecture, Delta Lake, Workflow, DLT, Compute, with knowledge of Unity Catalog for data governance
• Hands-on experience with Delta Lake, building scalable and reliable data pipelines using PySpark, SQL
• Solid understanding of cloud administration, including resource provisioning, scaling, and cost optimization in Azure
• Experience in data modeling and designing schemas for analytical workloads
• Excellent communication skills to interact with technical and business teams effectively
Good To Have
• Independently take ownership of tasks and deliver solutions
• Work closely with business units and stakeholders
• At least one certification - Azure Data Engineering Associate or Databricks Data Engineer Associate