Scala Spark Developer
Deepika BalachandranUnited StatesMIDPosted 11d ago
ScalaApache SparkPythonETLData WarehousingData ModelingDistributed ComputingBig Data ProcessingHadoopHiveKafkaHBaseAWSGCPAzureSpark StreamingStructured StreamingMachine Learning
About the Role
We are looking for an experienced Scala Spark Developer to build and optimize scalable data processing pipelines and ETL workflows using Scala, Apache Spark, and Python.
Key Responsibilities
• Develop, test, and maintain scalable data pipelines using Scala and Apache Spark
• Build ETL workflows and transform structured and unstructured data
• Use Python for data processing, scripting, and automation
• Optimize Spark performance through partitioning, caching, and tuning
• Participate in code reviews, architecture discussions, and technical documentation
• Work with distributed computing and large-scale data processing systems
Requirements
• Strong Scala and Apache Spark experience
• Spark Core, Spark SQL, DataFrames, and RDDs
• Python programming and scripting
• ETL development, data warehousing, and data modeling
• Distributed computing and big data processing
• Strong communication and collaboration skills