Lead Software Engineer
Nikhil PuriRemoteLEADPosted 2h ago
Cloudera HadoopHDFSHiveSparkOoziePythonAWS EMRAWS GlueAirflowAWS LambdaBashTerraformBitbucketGradleOctopusArtifactory
About the Role
We are looking for an experienced Lead Software Engineer with strong expertise in the Cloudera Hadoop ecosystem and AWS Big Data modernization.
Key Responsibilities
• Design and implement solutions for migrating on-premises Hadoop workloads to AWS
• Lead technical migration projects and mentor engineers
• Develop technical documentation and migration runbooks
• Ensure data security, governance, monitoring, and logging
Requirements
• 10+ years of experience in enterprise software/application design and Big Data platforms
• Hands-on expertise with Cloudera Hadoop, HDFS, Hive, Spark, Oozie, and Python
• Strong experience migrating on-premises Hadoop workloads to AWS
• Knowledge of AWS EMR, Glue, Airflow, Lambda, and cloud-native data architectures
• Proficiency in Bash/shell scripting and operational automation
• Experience with Terraform or other Infrastructure as Code tools
• 5+ years of experience with platform engineering tools such as Bitbucket, Gradle, Octopus, and Artifactory
• Strong understanding of data security, governance, monitoring, and logging
• Excellent communication skills, including the ability to communicate effectively with executive leadership
• Experience mentoring engineers
Preferred
• Healthcare data experience, particularly claims, providers, and members