Software Engineer (ETL, Automation Testing, Databricks, Python, Pyspark, SQL) at NielsenIQ

Our Connect Technology teams are working on our new Connect platform, a unified, global, open data ecosystem powered by Microsoft Azure. Our clients around the world rely on Connect data and insights to innovate and grow.  As a QA Engineer, you’ll be part of a team of smart, highly skilled technologists who are passionate about learning and supporting cutting-edge technologies such as Cloud/Bigdata Automation, Python, Pyspark, SQL, Hive, Databricks, Airflow, Performance testing other Data engineering tools.  These technologies are deployed using DevOps pipelines leveraging Azure, Kubernetes, Jenkins and Bitbucket/GIT Hub.   WHAT YOU’LL DO:  • Develop, troubleshoot, debug and make application enhancements and create automation framework leveraging Python/Pyspark, SQL/NOSQL as the core development languages.   • Develop and build scalable automation frameworks and test suites working across technologies.   • Develop Gen AI Automation solutions using AI ML Framework.  • Develop documents and maintain test plans, procedures and scripts and perform well defined product level integration tests.   • Implement execute and debug automated test scripts using various technologies and tools.   • Perform manual testing, the scope of which will encompass all functionalities of services as prequel to automation.   • Work closely with other quality and development engineers to build, evolve and maintain a scalable continuous build and deployment pipeline.    • Deploy application components using CI/CD pipelines.   • Build utilities for monitoring and automating repetitive functions.   • Collaborate with Agile cross-functional teams - internal and external clients including Operations, Infrastructure, Tech Ops   • Research and evaluate a variety of software products and development tools.   • Provides technical guidance and support to colleagues such as code reviews, testing and software documentation as required.