Jobs → Data & Analytics → Hadoop Data Engineer

About the Role We are looking for an experienced Hadoop Data Engineer to join our team in Scottsdale, AZ. This role focuses on building and maintaining scalable enterprise data-processing applications using the Hadoop ecosystem. Key Responsibilities • Design and develop scalable applications using Java 8+ and Spring Boot • Build and optimize big data pipelines using Apache Spark and Scala • Develop and integrate RESTful web services • Implement batch and streaming pipelines using Spark Streaming and Kafka • Write and optimize Hive queries and SQL for performance and scalability • Work with Hadoop ecosystem components and distributed data platforms • Perform code reviews and follow Git, version control, and CI/CD best practices • Troubleshoot performance, scalability, and data reliability issues • Collaborate with cross-functional teams to deliver effective data solutions Requirements • 8–12 years of hands-on Java development experience (Java 8+) • Strong expertise in Spring Boot • Excellent proficiency in Apache Spark and Scala • Strong experience with Hadoop, Hive, SQL optimization, and Kafka • RESTful web services and API integration • Spark Streaming and Kafka Streams • Git/GitLab and Maven/Gradle • Distributed systems and big data architecture • Performance tuning and capacity planning • Enterprise-scale data platform experience • DevOps/CI/CD knowledge is a plus