Loading...
Mid LevelFull-timeAWSTerraformMongoDBCI/CD
Salary Range
$45,900 - $62,100 /year
This salary is estimated based on similar roles. The actual salary may vary.
As an important aide to both the IT Infrastructure and Development teams, you will help support existing systems 24x7 and responsible for administering current Big Data environments. You will manage BigData Group environments and will work with teammates to maintain working solutions for our big data tech stack. To support product development following the product roadmap for product maintenance and enhancement such that the quality of software deliverables maintains excellent customer relationships and increases the customer base. You will report to the Engineering Manager, Data Platforms.
 
If you have the skills and we would love to talk to you!
 
What you'll do:
• Implement, support, and administer Hadoop and AWS EMR environments.
• Maintain Terraform and IaC for provisioning and managing AWS resources.
• Provide CI/CD solutions and apply SDLC best practices.
• Automate deployment and operations of Big Data technologies using DevOps tools.
• Onboard Hadoop users and manage Kerberos, HDFS, Hive, HBase, and Yarn access.
• Implement security best practices across HBase, HDFS, Kafka, Hive, and related components.
• Tune Hadoop clusters, MapReduce, Spark workloads, and optimize EMR for performance and cost.
• Monitor group health, logs, storage, and perform proactive capacity management.
• Collaborate with infrastructure, network, DB, application, and BI teams to ensure platform reliability.
• Support upgrades and patching for EMR, HBase, Spark, and other data platforms.
• Troubleshoot system issues and analyze CPU, memory, OS, storage, and network performance.
• Deploy and manage Hadoop clusters, configure HA, manage nodes, schedule jobs, and perform backups.
• Support integrations across cloud/on‑prem networks and data platforms.
• Configure and maintain tools like Sentry, Spark, Kafka, Oozie, Solr, MongoDB, DocumentDB, and ELK.
• Integrate AD/LDAP with Cloudera, manage Sentry policies.
Free to sign up. Takes 30 seconds.
About Experian
Experian is a global information services company that specializes in providing data and analytics solutions to businesses and consumers. Headquartered in Dublin, Ireland, with a presence in over 44 countries, Experian has been a leader in the information services industry since its inception in 1996. The company leverages advanced technology and extensive data resources to help organizations make informed decisions, mitigate risk, and identify growth opportunities. Its services are integral to sectors such as finance, retail, telecommunications, and healthcare, where accurate data is critical for operational efficiency and strategic planning. Experian offers a comprehensive suite of products and services, including credit reporting, fraud detection, marketing analytics, and decision automation. Key features of their solutions include real-time data processing, predictive analytics, and customizable reporting tools that enable clients to gain actionable insights. The company primarily targets financial institutions, retailers, and telecommunications providers, helping them manage credit risk, combat fraud, and enhance customer engagement. Additionally, Experian provides consumer credit reports and identity protection services, catering to individuals seeking financial transparency and security. Experian has established itself as a market leader, recognized for its innovative use of data and technology to solve complex business challenges. The company holds a significant market share in the information services industry, supported by its robust global infrastructure and commitment to data accuracy and compliance. Experian’s unique value proposition lies in its ability to integrate vast datasets with cutting-edge analytics, providing clients with unparalleled insights that drive business success and regulatory compliance. Its dedication to data privacy and ethical practices further reinforces its reputation as a trusted partner in the information services sector.
