Loading...
Mid LevelFull-timePythonAWSAzureMySQLAgileAPI
Salary Range
$28,560 - $38,640 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
IDT is looking for a skilled Data Engineer to join their BI team and take an active role in performing data analysis, ELT/ETL design and support functions to deliver on strategic initiatives.
Key Responsibilities
- →Design, implement, and validate ETL/ELT data pipelines for batch processing, streaming integrations, and data warehousing
- →Maintain end-to-end Snowflake data warehouse deployments and develop Denodo data virtualization solutions
- →Recommend process improvements to increase efficiency and reliability in ELT/ETL development
- →Stay current on emerging data technologies and support pilot projects
- →Architect, implement and maintain scalable data pipelines that ingest, transform, and deliver data into real-time data warehouse platforms
- →Partner with data stakeholders to gather requirements for language-model initiatives
- →Create and maintain comprehensive documentation for all data processes
Requirements
- ✓5+ years of experience in ETL/ELT design and development
- ✓Excellent English communication skills
- ✓Demonstrated experience in utilizing Python for data engineering tasks
- ✓Experience in data analysis, root cause analysis and proven problem solving capabilities
- ✓Experience designing complex data pipelines extracting data from RDBMS, JSON, API and Flat file sources
- ✓Demonstrated expertise in SQL and PLSQL programming
- ✓Understanding of software engineering principles and skills working on Unix/Linux/Windows Operating systems
- ✓Proficiency in version control systems
- ✓Interest in business operations and comprehensive understanding of how robust BI systems drive corporate profitability
