Jobs → Engineering → PySpark Developer

About the Role We are looking for an experienced PySpark Developer to join our growing data engineering team. This role focuses on building scalable data solutions and working with cutting-edge cloud technologies. Key Responsibilities • Develop and optimize large-scale ETL/ELT pipelines using PySpark and Spark SQL • Build data ingestion and transformation workflows in Azure Databricks • Design and implement Delta Lake and Lakehouse solutions • Work with Azure Data Lake Storage Gen2 and Azure Data Factory • Optimize Spark performance through partitioning, caching, and execution-plan analysis • Implement data quality, reconciliation, logging, and monitoring frameworks • Collaborate with architects, analysts, QA teams, and stakeholders to deliver reliable data solutions Requirements • Strong experience with Python, PySpark, Apache Spark, and SQL • Hands-on expertise in Azure Databricks and ETL/ELT development • Experience with Delta Lake, ADLS Gen2, and data integration patterns • Knowledge of Git, CI/CD, and Agile methodologies • Strong troubleshooting and performance optimization skills Preferred Skills • Azure Data Factory & Azure Synapse Analytics • Databricks Workflows & Unity Catalog • Delta Lake optimization techniques • Kafka / Event Hubs / Streaming Data Processing • Data Warehousing & Dimensional Modeling