Loading...
Mid LevelFull-timePythonRustC#AzureTerraformAgileAIDevOps
Salary Range
$61,200 - $82,800 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
Shift Technology is seeking a Data Engineer to join our Engineering team. This role involves developing and maintaining scalable data models and data access layer frameworks, building and optimizing ETL pipelines, and collaborating with product and data science teams to create frameworks that support advanced analytics.
Key Responsibilities
- →Develop and maintain scalable data models and data access layer frameworks that serve as the foundation for centralized databases and downstream applications.
- →Build and optimize ETL pipelines to ingest, transform, and integrate various data sources, ensuring data consistency, quality, and availability, leveraging Apache Spark, .NET libraries, Azure Data Factory, DBT.
- →Contribute to Agile development processes by participating in sprint planning, stand-ups, and retrospectives to ensure continuous delivery and alignment with team goals.
- →Collaborate closely with the product team to translate roadmap priorities into technical designs and deliverables that meet business and customer needs.
- →Work hand-in-hand with Data Scientists and Engineers to create and enhance frameworks that simplify customer data integration and support advanced analytics.
- →Participate in code reviews, deployment processes, and monitoring to ensure high-quality production releases and smooth operation of data pipelines and frameworks.
Requirements
- ✓3+ years of experience in software development or data engineering in cloud-based environments.
- ✓Strong programming skills in C# and Python, with a solid grasp of OOP principles.
- ✓Proficiency in data transformation and processing tools (e.g., PySpark, dbt).
- ✓Previous experience with reporting tools (e.g., Power BI)
- ✓Knowledge of Azure Data Factory (ADF)
- ✓Experience designing scalable and robust data platforms.
- ✓Familiarity with data modeling techniques (e.g., star schema, data vault).
- ✓Experience with distributed data systems and Database optimization.
- ✓Comfortable working with distributed data stores and SQL Server.
- ✓Experience in ETL processes and orchestration tools.
- ✓A passion for continuous learning, mentoring, and solving complex problems.
- ✓Excellent communication skills in English.
Benefits
- ★Flexible remote and hybrid working options
- ★Competitive Salary and a variable component tied to personal and company performance
- ★Multiple Learning and Development opportunities, including Focus Fridays, a half-day each month to focus on learning and personal growth
- ★Generous PTO and paid holidays
- ★Mental health benefits
- ★2 MAD Days per year (Make A Difference Days for paid volunteering)
Free to sign up. Takes 30 seconds.
