Jobs → Engineering → Scala Spark Developer

About the Role We are looking for an experienced Scala Spark Developer to join our team in NYC. This role involves developing and maintaining scalable data pipelines using Scala and Apache Spark. Key Responsibilities • Develop and maintain scalable Scala/Spark data pipelines • Build ETL workflows for structured and unstructured data • Use Python for data processing and Spark workflow integration • Optimize Spark applications for performance and scalability • Participate in code reviews and technical design discussions • Document workflows, architecture and solutions Requirements • 8+ years of experience with Scala & Apache Spark • Strong experience with Spark Core, Spark SQL, DataFrames & RDDs • Python for data processing, scripting & automation • Distributed computing & large-scale data processing • ETL development, data warehousing & data modeling • Spark performance tuning, partitioning & caching • Data transformation and pipeline development Preferred Skills • AWS / GCP / Azure with Spark services • Spark Streaming / Structured Streaming • Hadoop, Hive, Kafka or HBase • Data governance, security & compliance • Basic understanding of Machine Learning workflows