Loading...
Data Engineer (Spark with Scala/ Python and Azure Databricks and Airflow) at NielsenIQ
NielsenIQPune, MH, in·1h ago
SeniorFull-timePythonAzureKubernetesDockerData Science
Salary Range
$26,520 - $35,880 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a Data Engineer to join our team working with cutting-edge technologies. This role focuses on building and maintaining data pipelines for large datasets.
Key Responsibilities
- →Maintain and assemble data pipelines that consume large datasets
- →Integrate finished models into pipelines to build customer insights
- →Optimize Spark code including data science models
- →Build infrastructure for data extraction, transformation, and loading
- →Write and maintain documentation for features
Requirements
- ✓Experience with Spark, Scala, Pyspark, and Python
- ✓Knowledge of Databricks, Airflow, SQL, Docker, and Kubernetes
- ✓Ability to work with Azure and SQL technologies
- ✓Strong documentation skills
Free to sign up. Takes 30 seconds.
About NielsenIQ
NielsenIQ is a global leader in providing data and insights to help businesses understand consumer behavior and market trends. Operating at the intersection of retail, media, and consumer goods industries, the company was formed through the strategic merger of Nielsen and CACI International's information services division, leveraging decades of expertise in market analytics. Headquartered in the United States with a widespread international presence, NielsenIQ combines advanced technology with deep industry knowledge to deliver actionable intelligence to clients worldwide. The company offers a comprehensive suite of products and services, including retail measurement, media analytics, and consumer insights, all powered by cutting-edge data science and AI technologies. Key features of their solutions include real-time market tracking, granular consumer segmentation, and predictive analytics to optimize business strategies. NielsenIQ primarily serves large retailers, consumer packaged goods manufacturers, and media companies, providing them with the tools to enhance decision-making, drive growth, and adapt to evolving market dynamics. Notable achievements include being a long-standing benchmark in retail measurement and media ratings, with a reputation for accuracy and reliability. NielsenIQ holds a dominant market position, trusted by over 50,000 clients globally, and is recognized for its commitment to innovation and data integrity. The company’s unique value proposition lies in its ability to unify disparate data sources into cohesive insights, enabling clients to navigate complexity and capitalize on emerging opportunities with confidence.
