Jobs → Engineering → Lead Software Engineer

About the Role We are looking for an experienced Lead Software Engineer with strong expertise in the Cloudera Hadoop ecosystem and AWS Big Data migration. This role requires hands-on technical experience, leadership capabilities, and excellent communication skills to coordinate with various stakeholders. Key Responsibilities • Analyze existing Cloudera Hadoop architecture, workflows, and data pipelines • Lead migration of on-premises Hadoop workloads to AWS • Design scalable, secure, and cost-effective AWS Big Data architectures • Manage data migration, application re-platforming, testing, and validation • Coordinate with Infrastructure, Content, DevOps, Engineering, and business stakeholders • Prepare technical documentation, migration strategies, and operational runbooks • Mentor engineering teams and drive technical best practices Requirements • 13+ years of overall IT experience • Strong hands-on experience with Cloudera Hadoop stack (HDFS, Hive, Apache Spark, Oozie, and Python) • Strong AWS Big Data experience (AWS EMR, Glue, Airflow, and Lambda) • Experience with on-premises Hadoop to AWS migration and modernization • Bash / Shell scripting and automation skills • Terraform and Infrastructure as Code (IaC) experience • Knowledge of data ingestion, processing, and migration strategies • Experience with XML / JSON data formats • Monitoring, logging, and troubleshooting skills • Experience with Bitbucket, Gradle, Octopus, and Artifactory