Scala Spark Developer
VARRSA TANUSYA S SUnited StatesSENIORPosted 10d ago
ScalaApache SparkPythonETLHadoopHiveKafkaHBaseAWSGCPAzureSpark StreamingStructured StreamingMachine Learning
About the Role
We are looking for an experienced Scala Spark Developer to join our team. This role focuses on building and optimizing scalable data pipelines using Scala, Apache Spark, and Python.
Key Responsibilities
• Develop, test, and maintain scalable data processing pipelines using Scala and Apache Spark
• Build ETL workflows for structured and unstructured data
• Use Python for data processing, scripting, and automation
• Optimize Spark application performance through tuning, partitioning, and caching
• Participate in code reviews, design discussions, and technical documentation
• Ensure best practices for scalable and reliable data processing
Requirements
• Strong experience with Scala and Apache Spark
• Hands-on experience with Spark Core, Spark SQL, DataFrames, and RDDs
• Proficiency in Python
• Distributed computing and large-scale data processing
• ETL development, data warehousing, and data modeling