Data Engineer
Vikas DhobaleUnited StatesSENIORPosted 2h ago
DataStageAzure DatabricksTeradataBTEQTPTJDBCODBCADLS Gen2Delta tablesUnity Catalog
About the Role
We are looking for an experienced Data Engineer to join a critical cloud migration project, focusing on migrating legacy workloads from IBM DataStage and Teradata to Azure Databricks.
Key Responsibilities
• Analyze existing IBM DataStage jobs and Teradata dependencies
• Migrate legacy workloads to Azure Databricks and optimize Teradata SQL for Spark SQL compatibility
• Work with Teradata utilities like BTEQ and TPT, plus JDBC/ODBC connectivity
• Perform rigorous data reconciliation, checksum validation, and schema troubleshooting
• Support testing phases (SIT/UAT) through cutover and post-production stabilization
• Leverage ADLS Gen2, Delta tables, and Unity Catalog