Scala Developer
Aman SolankiUnited StatesMIDPosted 13d ago
ScalaApache SparkPythonETLHadoopKafkaData EngineeringBig Data
About the Role
We are looking for an experienced Scala Developer with strong expertise in Apache Spark, distributed computing, and large-scale data processing to join our team.
Key Responsibilities
• Develop and maintain scalable data processing pipelines.
• Optimize Spark jobs using partitioning, caching, and performance tuning.
• Build efficient ETL workflows for structured and unstructured data.
• Participate in code reviews, technical discussions, and solution design.
Requirements
• Strong hands-on experience with Scala and Apache Spark
• Expertise in Spark Core, Spark SQL, DataFrames, and RDDs
• Proficiency in Python for data processing, scripting, and automation
• Experience developing scalable ETL pipelines and data transformation workflows
• Strong understanding of distributed computing and performance optimization
• Experience with data warehousing and data modeling
• Familiarity with Hadoop, Hive, Kafka, or HBase is a plus
• Excellent problem-solving, communication, and collaboration skills