Jobs → Engineering → PySpark Developer

About the Role We are seeking a PySpark Developer with 5-7 years of experience to join our team. This role involves working with big data technologies and developing data pipelines. Key Responsibilities • Develop data pipelines on Cloudera Data Platform (CDP) • Design and manage workflows using Apache Airflow • Work with large-scale structured and unstructured datasets • Implement data processing solutions using PySpark • Collaborate with team members on technical requirements Requirements • 5-7 years of experience in Data Engineering and Big Data development • Strong hands-on experience with PySpark and Spark-based data processing • Knowledge of Apache Iceberg table architecture and data lake concepts • Experience with SQL and data modeling techniques • Understanding of ETL/ELT development and data transformation frameworks • Familiarity with Git, CI/CD pipelines, and DevOps practices • Strong analytical, troubleshooting, and problem-solving skills • Excellent communication and collaboration skills