Loading...
Senior Software Engineer (Senior Data Infrastructure Engineer) at NielsenIQ
NielsenIQPune, MH, in·7h ago
SeniorFull-timePythonKubernetesTerraformGit
Salary Range
$26,520 - $35,880 /year
This salary is estimated based on similar roles. The actual salary may vary.
Senior Data Infrastructure Engineer
Job Description
• Manage and optimize Databricks infrastructure, including cluster lifecycle management, job scheduling, Unity Catalog administration, user permissions, and cost monitoring.
• Manage Airflow clusters deployed on Kubernetes via Helm charts, including upgrades, configuration management, and integration with ArgoCD and Vault.
• Write and maintain Terraform modules to provision and manage cloud infrastructure in a scalable, reliable, and secure manner.
• Develop and maintain data pipelines and workflows using Python, PySpark, and dbt to support data processing and analytics use cases.
• Use GitHub Copilot with custom skills and agents to improve team productivity, automate repetitive development tasks, and accelerate code reviews and documentation.
• Communicate with stakeholders across the organization to understand their data needs and translate them into infrastructure and pipeline solutions.
• Collaborate with engineering teams to ensure data quality and consistency across the organization.
• Review and approve infrastructure and pipeline changes from team members, applying runbooks and automation components.
• Participate in on-call rotation for data infrastructure and pipeline incidents. You will be expected to take all necessary actions to resolve issues and restore services to a normal state.
• Review and maintain technical documentation, keeping it up to date with current system state and runbooks.
Free to sign up. Takes 30 seconds.
About NielsenIQ
NielsenIQ is a global leader in providing data and insights to help businesses understand consumer behavior and market trends. Operating at the intersection of retail, media, and consumer goods industries, the company was formed through the strategic merger of Nielsen and CACI International's information services division, leveraging decades of expertise in market analytics. Headquartered in the United States with a widespread international presence, NielsenIQ combines advanced technology with deep industry knowledge to deliver actionable intelligence to clients worldwide. The company offers a comprehensive suite of products and services, including retail measurement, media analytics, and consumer insights, all powered by cutting-edge data science and AI technologies. Key features of their solutions include real-time market tracking, granular consumer segmentation, and predictive analytics to optimize business strategies. NielsenIQ primarily serves large retailers, consumer packaged goods manufacturers, and media companies, providing them with the tools to enhance decision-making, drive growth, and adapt to evolving market dynamics. Notable achievements include being a long-standing benchmark in retail measurement and media ratings, with a reputation for accuracy and reliability. NielsenIQ holds a dominant market position, trusted by over 50,000 clients globally, and is recognized for its commitment to innovation and data integrity. The company’s unique value proposition lies in its ability to unify disparate data sources into cohesive insights, enabling clients to navigate complexity and capitalize on emerging opportunities with confidence.
