Loading...
Mid LevelFull-timeAzure
About the Role
We are seeking a Data Engineer to manage, operate, and support cloud-based data platforms. This role involves close collaboration with customers and internal teams to ensure stable, secure, and efficient operations of the cloud data ecosystem. The engineer will work across multiple technologies to ensure reliable data ingestion, processing, analytics, and reporting.
Key Responsibilities
- →Resolve data pipeline issues and perform proactive monitoring for sensitive and critical batch processes
- →Conduct Root Cause Analysis and retrospectives for incidents and operational issues
- →Create, update, and maintain operational runbooks and manage entitlements as required
- →Implement configuration changes to batch processes and underlying cloud infrastructure
- →Manually control and manage pipeline executions during scheduled maintenance windows
- →Perform on-demand operational changes based on instructions from the Data Engineering team
- →Handle user service requests and coordinate with the Data Engineering team for non-runbook requests
- →Participate in Disaster Recovery testing activities twice a year
- →Support development and production data synchronization activities
- →Represent the team in weekly change management board meetings
Requirements
- ✓Bachelor's degree in Computer Science or a related field
- ✓3-6 years of hands-on experience in configuring and managing Azure-based data analytics solutions
- ✓Strong hands-on experience with Azure Data Lake Storage, Databricks, Azure Data Factory, Azure Synapse Analytics, Snowflake, Azure Event Hub, Tidal Scheduler, Pyramid, Collibra, Power BI, Tableau, MicroStrategy, and Alteryx
- ✓Ability to read, write, and troubleshoot SQL queries and stored procedures
- ✓Proven experience in configuring, managing, and troubleshooting cloud data platforms
- ✓Strong analytical and problem-solving skills
- ✓Excellent written and verbal communication skills with ability to explain technical concepts to non-technical stakeholders
- ✓Ability to work effectively in small teams while promoting collaboration and inclusiveness
- ✓Extensive problem-solving capabilities including independent investigation of issues and root cause identification
- ✓Ability to research and utilize multiple information sources to resolve complex issues
- ✓Capability to prioritize multiple incidents and tasks while managing competing deadlines
- ✓Prior experience working in Azure cloud environments is strongly preferred
- ✓Schedule flexibility required including regular weekend and holiday coverage to support 24x7 operations
- ✓Occasional travel may be required (less than 10%)
