Scala & Apache Spark Developer
Anuj SolankiUnited StatesMIDPosted 13d ago
ScalaApache SparkSpark CoreSpark SQLDataFramesRDDsPythonETLHadoopHiveKafkaHBase
About the Role
We are looking for a Scala & Apache Spark Developer to join our team in New York. This role focuses on building and optimizing scalable data pipelines and ETL workflows.
Key Responsibilities
• Build and optimize scalable data pipelines
• Develop ETL workflows
• Process structured and unstructured data
• Improve Spark application performance
Requirements
• Strong hands-on experience with Scala and Apache Spark
• Expertise in Spark Core, Spark SQL, DataFrames, and RDDs
• Proficiency in Python for data processing and automation
• Experience developing ETL pipelines and data transformation workflows
• Strong understanding of distributed computing and large-scale data processing
• Experience with performance tuning, partitioning, and caching
• Knowledge of Hadoop, Hive, Kafka, or HBase is a plus