Jobs → Engineering → PySpark Developer

About the Role We are looking for a PySpark Developer to join our team. This role focuses on designing and developing scalable data processing pipelines. Key Responsibilities • Design and develop scalable data processing pipelines using PySpark and Python • Build and optimize ETL/ELT workflows for large datasets • Develop distributed data processing applications using Apache Spark • Work with Spark SQL, DataFrames, Datasets, and RDDs • Optimize Spark jobs through partitioning, caching, and shuffling Requirements • 5–8 years of experience with PySpark and Python • Experience with Apache Spark, Java, Kafka, and SQL • Ability to design and implement scalable data processing solutions