Big Data Lead
soumya JoyceUnited StatesSENIORPosted 12d ago
SnowflakePythonSQLEnterprise Data WarehousingAzure Data TechnologiesAzure Data FactoryAirflowInformaticaAutomicMetadata ManagementData LineageShell ScriptingJavaScriptGitConfluenceJira
About the Role
We are looking for a highly skilled Big Data Lead to join our team at IQVIA. This role requires extensive hands-on experience in Snowflake, Python, SQL, and enterprise data warehousing technologies.
Key Responsibilities
• Design, develop, and maintain enterprise data warehouse solutions using Snowflake
• Develop advanced SQL queries and Python-based data processing solutions
• Optimize query performance and troubleshoot complex data issues
• Work with Azure Data Factory and related data engineering frameworks
• Implement and manage data orchestration workflows
• Maintain metadata, data lineage, and data quality standards
• Participate in requirements gathering, development, testing, and deployment
• Identify root causes of production incidents and implement preventive measures
• Collaborate with engineering teams to deliver scalable and reliable solutions
• Manage deliverables in a fast-paced enterprise environment
Requirements
• 10+ years of overall experience
• Minimum 5 years of USA onsite experience
• 8+ years of enterprise data solution development
• 5+ years of hands-on Snowflake experience
• Strong SQL and Python development skills
• Snowflake data warehouse design and development
• SQL analytical functions and query performance tuning
• Azure Data Factory and Azure data framework knowledge
• Experience with Airflow, Informatica, or Automic
• Metadata management and data lineage
• Shell scripting and JavaScript
• Git, Confluence, and Jira
• Strong problem-solving and communication skills
Preferred
• Pharma domain experience
• Omnichannel data expertise
• LinkedIn profile at least 6 years old
• Customer face-to-face interview in New Jersey is mandatory