Lead ETL Developer
Vishall bambelwalUnited StatesLEADPosted 11d ago
AWSSnowflakePythonPySparkIBM DataStageAWS GlueS3EC2SQLETLData EngineeringCI/CDDevOpsData Warehouse
About the Role
We are seeking an experienced Lead ETL Developer to lead the design, development, and optimization of scalable data pipelines within an Enterprise Data Warehouse (EDW) environment using AWS, Snowflake, and Python-based frameworks.
Key Responsibilities
• Lead the design, development, and maintenance of ETL/ELT pipelines
• Build and optimize pipelines using AWS Glue, Snowflake, Python/PySpark, and IBM DataStage
• Implement reusable, metadata-driven data integration patterns
• Establish coding standards, version control, and CI/CD practices
• Drive data quality, unit testing, regression testing, and data validation
• Troubleshoot pipeline issues and support production incident resolution
• Collaborate with architects, QA, product owners, and business teams
• Mentor developers, conduct code reviews, and provide technical leadership
• Contribute to cloud migration, automation, and data platform modernization
Requirements
• Bachelor's degree or equivalent additional relevant work experience
• 5+ years of ETL/Data Engineering experience
• 5+ years of SQL and database development experience
• 5+ years of hands-on Python/PySpark and ETL tools experience
• 3+ years of cloud-based data platform experience
• Strong expertise in AWS, Snowflake, and Python-based frameworks