Data Engineer
Priyanka WiliamQASENIORPosted 52m ago
PySparkSQLPythonDatabricksAzure Data FactoryAzure DevOpsAzure Cloud ServicesCosmos DBMongoDBNeo4jELK
About the Role
We are looking for a Data Engineer to join our client engagement in Doha, Qatar. This role focuses on designing, developing, and maintaining scalable ETL and data integration pipelines.
Key Responsibilities
• Design, develop, and maintain scalable ETL and data integration pipelines
• Build and operate solutions using Databricks and Azure Data Factory
• Integrate proprietary and third-party data sources into the platform
• Extend and maintain data models, ontologies, and knowledge graph structures
• Implement entity-resolution and record-linkage capabilities across diverse datasets
• Define and enforce data-quality standards, monitoring, and observability practices
• Evaluate data-source costs, scalability requirements, and operational efficiency
• Develop documentation, runbooks, and sustainable handover processes
• Ensure solutions are tested, automated, secure, and production-ready
Requirements
• Master's degree in Computer Science, Engineering, or a related field
• 7+ years of significant Data Engineering experience (excluding internships)
• Strong programming skills in PySpark, SQL, and Python
• Proven experience processing data at terabyte scale in production environments
• Hands-on experience with Databricks, Azure Data Factory, Azure DevOps, and Azure Cloud Services
• Experience building and operating robust ETL/data pipelines with automation, testing, and CI/CD
• Strong understanding of SQL and NoSQL databases, distributed computing, and data architecture
• Familiarity with Cosmos DB, MongoDB, Neo4j, and ELK technologies
• Experience with entity resolution, record linkage, fuzzy matching, and data-quality frameworks
• Knowledge of data modelling, ontology design, and knowledge graph concepts
• Experience integrating external client datasets, data contracts, secure data transfer, and access controls
• Ability to work directly with client teams and communicate complex technical concepts effectively
• Experience working in regulated environments and data-residency frameworks is an advantage
• Financial services, private markets, energy, or sustainability domain experience is preferred