Loading...
SeniorFull-timePythonRustData ScienceCI/CD
Salary Range
$99,450 - $134,550 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are seeking a Data Engineer to build, run, and scale modern data pipelines. This role involves developing production-grade pipelines and designing clean datasets for analytics and reporting.
Key Responsibilities
- →Develop production-grade pipelines in Databricks to ingest data from various sources
- →Define and optimize our Lakehouse approach for performance and cost
- →Contribute to engineering standards including version control, testing, and CI/CD
- →Design and model intuitive datasets for analytics and self-service reporting
- →Publish curated datasets for Power BI, working with analysts and report developers
- →Build data validation and monitoring to ensure report accuracy
- →Apply organization-wide governance standards for data management
- →Contribute to our data catalogue with clear documentation
- →Prepare feature datasets for data science applications
- →Collaborate on prototyping models in Python
- →Share ideas and best practices within the data community
- →Partner with business teams to understand data needs
- →Help upskill others through knowledge sharing
Requirements
- ✓Experience with Databricks and data pipeline development
- ✓Strong understanding of Lakehouse architecture
- ✓Proficiency in Power BI and dataset modeling
- ✓Knowledge of data governance and compliance standards
- ✓Experience with Python for data science applications
- ✓Ability to work collaboratively across global teams
- ✓Understanding of CI/CD practices and testing methodologies
