Big Data Engineer
Anurag SinghUnited StatesMIDPosted 10d ago
HadoopApache SparkPythonGoogle Cloud PlatformHiveShell ScriptingJavaScala
About the Role
We are looking for a Big Data Engineer to join our team. This role focuses on designing and developing scalable big data solutions using Hadoop, Spark, and Hive.
Key Responsibilities
• Design and develop scalable big data solutions using Hadoop, Spark, and Hive
• Build and maintain enterprise-grade data pipelines and workflows
• Develop data processing applications using Python, Java, or Scala
• Leverage GCP services for cloud-based big data solutions
• Optimize data platforms for performance, scalability, and cost efficiency
• Troubleshoot distributed data processing and performance issues
• Collaborate with cross-functional and Agile teams
Requirements
• 7–10 years of experience in Big Data engineering
• Mandatory experience with Hadoop, Apache Spark (Batch & Streaming), Python, and Google Cloud Platform (GCP)
• Required experience with Hive and Shell Scripting
• Preferred experience with Java or Scala