Data Engineer
Mohammed YoonusRemoteSENIORPosted 2h ago
IBM DataStageTeradataSQLAzure DatabricksSpark SQLADLS Gen2Delta TablesUnity Catalog
About the Role
We are looking for an experienced Data Engineer to join our team for a DataStage to Azure Databricks migration project.
Key Responsibilities
• Analyze IBM DataStage jobs and migrate them to Azure Databricks
• Work with Teradata, BTEQ, TPT, and SQL
• Utilize Azure Databricks and Spark SQL
• Manage ADLS Gen2, Delta Tables, and Unity Catalog
• Perform data reconciliation, validation, and troubleshooting
• Support SIT, UAT, cutover, and production
Requirements
• Strong hands-on expertise in IBM DataStage
• Experience with Teradata, BTEQ, TPT, and SQL
• Proficiency in Azure Databricks and Spark SQL
• Knowledge of ADLS Gen2, Delta Tables, and Unity Catalog
• Experience in large-scale Teradata-to-Azure Databricks migration