Lead Software Engineer
AKHIL VADDEUnited StatesLEADPosted 36m ago
Cloudera Hadoop StackHDFSHiveSparkOoziePythonShell ScriptingAWS Big DataEMRGlueAirflowLambdaTerraformBitbucketGradleOctopusArtifactoryXMLJSONData processingData ingestionData validationData migrationMonitoringLoggingTroubleshootingEnterprise architectureApplication design patternsData securityData governanceData complianceTechnical documentationMigration runbooksStakeholder communicationTeam leadership
About the Role
We are looking for an experienced Lead Software Engineer with strong expertise in enterprise Hadoop ecosystems, AWS Big Data services, and large-scale cloud migration projects.
Key Responsibilities
• Migrate and modernize on-premises Cloudera Hadoop workloads to AWS
• Design and implement solutions for Hadoop-to-AWS migration and modernization
• Utilize Terraform for Infrastructure as Code
• Handle data processing, ingestion, validation and migration
• Implement monitoring, logging and troubleshooting solutions
• Create technical documentation and migration runbooks
Requirements
• 11+ years of experience with enterprise Hadoop ecosystems
• Strong experience with Cloudera Hadoop Stack: HDFS, Hive, Spark, Oozie
• Proficiency in Python and Shell Scripting (Bash)
• 5+ years of experience with Bitbucket, Gradle, Octopus and Artifactory
• Experience with AWS Big Data services: EMR, Glue, Airflow, Lambda
• Knowledge of enterprise architecture and application design patterns
• Understanding of data security, governance and compliance
• Strong stakeholder communication and team leadership skills
Preferred
• Healthcare domain experience
• Knowledge of claims, providers, members and healthcare data relationships
• AWS certifications