Loading...
Mid LevelFull-timePythonRustAWSGCPAzureData ScienceCI/CDGit
Salary Range
$102,000 - $138,000 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a DataOps Engineer to join Megaport, the global leader in Network as a Service (NaaS). This role involves designing, implementing, and maintaining the Megaport Data Warehouse, working with stakeholders on Data Asset integration, and ensuring operational excellence in data management.
Key Responsibilities
- →Designing, implementing and managing data pipelines
- →Working closely with the Data Office on design and technical development
- →Building a team culture of good architecture and design
- →Focusing on day-to-day operations of the Megaport data warehouse environment
- →Supporting the BI reporting and analytics functions of Megaport
Requirements
- ✓Very strong SQL skills with extensive experience in ETL/ELT and Data modelling
- ✓Strong experience working in DataOps in a large data warehouse environment
- ✓Sound knowledge and experience in CI/CD while maintaining a data pipeline
- ✓Software Development and scripting experience (preferably with Python(PySpark), or similar)
- ✓Automated data quality checks, error handling processes and alerts
- ✓Data Lake & EDW methodologies; Data analysis, data modelling, data integration, data warehousing and database design(data vault); Azure Stack
- ✓Instincts for identifying, documenting and mitigating risks
- ✓Excellent documentation skills and communication skills
- ✓Passionate about data, showing a commitment to keeping on top of current industry trends
- ✓Experience troubleshooting and deploying Azure resources (or other major clouds like AWS/GCP) using Infrastructure as Code (IaC), scripting languages, and Azure DevOps for automated configuration
- ✓Proven track record managing complex data ecosystems, including Databricks (Unity Catalog), dbt, and Git, alongside seamless integration of D365, APIs, and Fivetran within the Azure environment
Free to sign up. Takes 30 seconds.
