Azure Data Engineer
Shailaja VejendlaRemoteMIDPosted 7d ago
Azure DatabricksAdfsAzure CloudData/Cloud EngineerCloud AzureWorkflowDLTDelta LakePySpark
About the Role
We are seeking an experienced Azure Data Engineer to join our team. This role involves architecting and implementing Azure-based data solutions using cutting-edge technologies.
Key Responsibilities
• Architect and implement Azure-based data solutions
• Work with technologies like Azure Databricks, ADF, Synapse, Databricks Unity Catalog, Delta Lake, PySpark, SQL
• Provide optimized and cost-effective solutions
• Design solution architectures using Azure
• Implement CI/CD pipelines for deploying data solutions
• Collaborate with business and technical teams
Requirements
• 4-12 years of experience as a Data/Cloud Engineer on Azure Cloud technologies
• Expertise in Azure Databricks, including Architecture, Delta Lake, Workflow, DLT, Compute, with knowledge of Unity Catalog for data governance
• Hands-on experience with Delta Lake, building scalable and reliable data pipelines using PySpark, SQL
• Solid understanding of cloud administration, including resource provisioning, scaling, and cost optimization in Azure
• Experience in data modeling and designing schemas for analytical workloads
• Proven experience in designing or implementing solution architectures using Azure
• Excellent communication skills to interact with technical and business teams effectively
Benefits
• Opportunity to work with cutting-edge Azure technologies
• Collaborative work environment
• Chance to mentor team members