Lead Software Engineer
Nithish KumarUnited StatesLEADPosted 1h ago
Cloudera Hadoop StackHDFSHiveSparkOoziePythonShell ScriptingAWS Big DataEMRGlueAirflowLambdaTerraformBitbucketGradleOctopusArtifactoryXMLJSON
About the Role
We are looking for an experienced Lead Software Engineer with strong expertise in enterprise Hadoop ecosystems, AWS Big Data services, and large-scale cloud migration projects. This role focuses on migrating and modernizing on-premises Cloudera Hadoop workloads to AWS.
Key Responsibilities
• Design and implement solutions for Cloudera Hadoop to AWS Big Data migration
• Lead technical aspects of large-scale cloud migration projects
• Develop Terraform code for Infrastructure as Code implementation
• Ensure data processing, ingestion, validation and migration processes are robust
• Provide monitoring, logging and troubleshooting for the migration process
Requirements
• 11+ years of experience with enterprise Hadoop ecosystems
• Strong experience with Cloudera Hadoop Stack: HDFS, Hive, Spark, Oozie
• Proficiency in Python and Shell Scripting (Bash)
• 5+ years of experience with Bitbucket, Gradle, Octopus and Artifactory
• Knowledge of enterprise architecture and application design patterns
• Understanding of data security, governance and compliance
• Strong stakeholder communication and team leadership skills
Preferred
• Healthcare domain experience
• Knowledge of claims, providers, members and healthcare data relationships
• AWS certifications