Cloudera Hadoop Engineer
Leela KrishnaRemoteSENIORPosted 13d ago
HDFSHiveSparkOoziePythonAWSAmazon EMRAWS GlueAirflowLambdaTerraformBitbucketGradleOctopus DeployArtifactory
About the Role
We are looking for an experienced Cloudera Hadoop Engineer for a contract opportunity with a healthcare analytics organization. This role focuses on migrating on-premises Hadoop workloads to AWS and building scalable Big Data solutions.
Key Responsibilities
• Analyze existing Cloudera Hadoop architecture and data pipelines
• Design and execute migration strategies from on-premises Hadoop to AWS
• Build scalable, secure, and reliable Big Data solutions
• Troubleshoot data pipeline and platform issues
• Develop migration documentation and operational runbooks
• Collaborate with engineering, DevOps, QA, and business teams
• Mentor team members on AWS Big Data best practices
Requirements
• 10-12+ years of experience with the Cloudera Hadoop ecosystem: HDFS, Hive, Spark, Oozie, and Python
• 10+ years of experience in enterprise/application design patterns and Big Data platforms
• Strong AWS Big Data experience, including Amazon EMR, AWS Glue, Airflow, and Lambda
• Proven experience migrating on-premises Hadoop workloads to AWS
• Expertise in data pipeline migration, re-platforming, testing, and validation
• Proficiency in Python and Bash/Shell scripting
• Experience with Terraform or other Infrastructure as Code (IaC) tools
• Familiarity with Bitbucket, Gradle, Octopus Deploy, and Artifactory
• Knowledge of data security, governance, monitoring, and logging
Preferred
• Healthcare data experience, particularly claims, members, providers, and related entities