Jobs → Data & Analytics → Data Engineer

About the Role We are looking for a Data Engineer to join our team. This role focuses on building scalable data pipelines, cloud-based data platforms, and AI-powered solutions. Key Responsibilities • Design and implement data pipelines using Databricks, Apache Spark, and SQL • Develop and maintain cloud-based data platforms on Azure • Work with AI/GenAI technologies including LLM Fine-Tuning, RAG, and Prompt Engineering • Automate processes using Airflow, GitHub, and Terraform • Integrate systems using Kafka and Event-Driven Architecture Requirements • Experience with Data Engineering: Databricks, Apache Spark (PySpark), Python/Scala, SQL, Snowflake • Proficiency in Azure Cloud: Azure Data Factory (ADF), ADLS, Azure Functions, Key Vault, Azure DevOps • Knowledge of AI/GenAI: LLM Fine-Tuning, RAG, Prompt Engineering • Skills in Automation & DevOps: Airflow, GitHub, GitHub Actions, CI/CD, Terraform, Infrastructure Automation • Experience with Streaming & Integration: Kafka, Event-Driven Architecture, CDC, Streaming Integrations