Jobs → Data & Analytics → Data Engineer

About the Role VY Systems Inc. is seeking an experienced Data Engineer to join their team. This role involves migrating and optimizing data systems from Teradata to Azure Databricks. Key Responsibilities • Analyze existing DataStage jobs and their Teradata dependencies • Migrate and optimize Teradata-specific SQL for Databricks/Spark SQL compatibility • Perform data reconciliation and validation, including row-count and checksum validation • Troubleshoot migration issues involving SQL, connectivity, schemas, metadata, and data types • Support unit testing, SIT, UAT, cutover, and post-production stabilization • Maintain strong understanding of ADLS Gen2, Delta tables, Unity Catalog, and Azure connectivity/security Requirements • Strong hands-on experience with IBM DataStage, Teradata, SQL, and Azure Databricks • Knowledge of Teradata utilities and components, including BTEQ and TPT • Experience with JDBC/ODBC database connectivity from ETL platforms • Experience in large-scale Teradata-to-Azure/Databricks migration projects • Strong troubleshooting and data validation skills • Ability to support end-to-end ETL modernization and migration activities