Jobs → Data & Analytics → Data Technical Lead

About the Role We are seeking a Data Technical Lead with expertise in Azure Databricks to join our team. This role involves designing and developing scalable data pipelines and architectures. Key Responsibilities • Design and develop scalable Databricks ETL/ELT pipelines using Azure Databricks, PySpark, and Python • Build real-time and batch data ingestion frameworks using Apache Kafka and Java-based streaming • Develop and optimize data processing workflows in Azure Databricks • Integrate data across PostgreSQL, YugabyteDB, Cassandra, and cloud platforms • Build reusable frameworks for data ingestion, transformation, validation, and orchestration • Develop SQL-based transformations and optimize query performance • Design and implement GitLab CI/CD pipelines for automated deployment and release management • Support Snowflake on-premises to Azure cloud migration initiatives • Design enterprise-scale Data Lake / Lakehouse architectures • Develop Power BI dashboards, reports, and API integration solutions • Ensure performance tuning, monitoring, coding standards, and operational stability Requirements • 12 to 15+ years of experience in data engineering • Strong experience in Azure Databricks • Strong hands-on experience with SQL • Expertise in Apache Spark / PySpark • Experience with Java, Python, Apache Kafka, PostgreSQL, YugabyteDB, Cassandra, Snowflake, GitLab CI/CD, and Power BI