Jobs → Data & Analytics → Data Engineer

About the Role We are looking for a Data Engineer to join a leading global technology consultancy. This role focuses on building scalable, enterprise-grade data platforms and leading architecture decisions. Key Responsibilities • Design and build scalable data ingestion pipelines for high-volume, high-velocity data • Develop complex transformation logic using Python, PySpark, pandas, and SQL • Lead architecture decisions on data platforms, frameworks, and technology selection • Build data quality, schema management, and governance frameworks • Optimize Spark jobs, SQL queries, performance, and cloud costs • Implement IaC (Terraform/ARM), CI/CD pipelines, monitoring, and automation • Mentor junior engineers and set coding and review standards • Use AI-assisted coding tools to accelerate development, while validating output for correctness, security, and performance Requirements • 8+ years of hands-on data engineering experience • Strong Python, PySpark, pandas, and advanced SQL, with solid OOP fundamentals • Apache Spark 3.3+ and Azure Databricks • Azure: ADLS Gen2, Data Factory, Entra ID, Azure Monitor • GCP: BigQuery, Dataproc, Cloud Run, Cloud IAM, GCS, BigLake • Terraform and/or ARM templates, CI/CD, container orchestration knowledge • Experience with data governance, lineage, access control, and cloud cost optimization • Hands-on experience with AI-assisted coding tools • Excellent communication and the ability to work independently in a remote setup • UAN is mandatory.