Loading...
SeniorFull-timePythonAzureMySQLMachine LearningData ScienceGit
Salary Range
$132,600 - $179,400 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a Senior Data Engineer to join our team at Social Finance, LLC, a next-generation financial services company and national bank. This role involves designing and building a data warehouse using Snowflake for machine learning, data analysis, and reporting needs.
Key Responsibilities
- →Design and build a data warehouse using Snowflake for machine learning, data analysis, and reporting needs
- →Develop ETL pipelines to automate data transformation and loading into data warehouses
- →Perform data cleansing, validation, testing, and schema design to ensure accuracy and reliability of data insights
- →Manage and build automated workflows and monitor pipelines and DAGs
- →Identify and work on improvements by automating manual processes to optimize data delivery
- →Collaborate with cross-functional teams to understand business logic and needs to create effective and efficient pipelines and data models
- →Create ad-hoc reports and data visualizations based on user requirements
- →Perform data quality checks and alerting to identify issues and resolve bugs in a timely manner
- →Participate in source code and design reviews in a software development lifecycle (SDLC) driven environment
- →Provide support for customer requests for all the products handled by the team
Requirements
- ✓Master’s degree in Analytics, Data Science, Engineering, or a related quantitative discipline
- ✓Six months of experience in the job offered or in any occupation in a related field
- ✓Data warehouse design and dimensional modeling
- ✓Extract, Transform, Load (ETL)
- ✓SQL
- ✓Python
- ✓Data Visualization (Tableau or Power BI)
- ✓Gitlab
- ✓Azure
- ✓PySpark
- ✓OLAP and OLTP system experience (MySQL Database, Postgres DB, or Snowflake)
- ✓Machine Learning
- ✓Data Pipeline - Performance & Scalability Techniques
