Data Engineer
Sherwin DcunhaUAEMIDPosted 5d ago
Informatica BDMPySparkSQLMS SQL ServerETLData IntegrationUnix/Linux Shell ScriptingGitHubDevOpsCI/CD PipelinesApache Oozie
About the Role
We are looking for a Data Engineer to join our team in Dubai for a 1-year extendable contract. This role focuses on data engineering, ETL development, and workflow orchestration.
Key Responsibilities
• Develop and maintain data engineering solutions using Informatica BDM
• Implement ETL processes and data integration strategies
• Design and manage workflow scheduling and orchestration using Apache Oozie
• Utilize PySpark and SQL for data processing and analysis
• Work with Unix/Linux Shell Scripting for automation
• Implement DevOps practices and CI/CD pipelines
Requirements
• 6+ years of experience in Data Engineering (Informatica BDM)
• Strong skills in PySpark and SQL, including MS SQL Server
• Expertise in ETL and Data Integration with Informatica BDM
• Proficiency in Unix/Linux Shell Scripting
• Experience with GitHub, DevOps, and CI/CD Pipelines
• Knowledge of Apache Oozie for workflow scheduling and orchestration