Data Engineering Lead
Chimala NeelaveniRemoteLEADPosted 2h ago
SQLTeradataJCLSnowflakeMicrosoft FabricAgileScrumData WarehousingCI/CDGitAzure DevOpsGitHub ActionsGitLab
About the Role
We are seeking an experienced Data Engineering Lead & Scrum Master to provide technical leadership and agile delivery guidance to our data engineering team. This dual-function leadership role involves designing enterprise data pipelines and delivering large-scale data solutions using advanced SQL, Teradata, and mainframe technologies.
Key Responsibilities
• Design and develop enterprise data pipelines and large-scale data solutions
• Optimize Teradata performance through query tuning, physical schema design, and utility automation
• Integrate mainframe systems by developing and maintaining JCL scripts
• Build and support data ingestion and transformation jobs for modern cloud platforms like Snowflake and Microsoft Fabric
• Facilitate agile ceremonies including sprint planning, daily stand-ups, and retrospectives
• Track sprint velocity and optimize team throughput
• Collaborate with cross-functional teams to translate business requirements into technical specifications
Requirements
• 10+ years of dedicated data engineering or enterprise data warehousing experience
• 2+ years of hands-on experience as a Scrum Master or Agile Delivery Lead
• Deep hands-on experience with Teradata architecture, workload management, and enterprise utilities
• Proficient in reading, writing, and debugging JCL scripts
• Strong understanding of dimensional modeling, Data Vault, star/snowflake schemas, and data lifecycle management
• Experience with CI/CD pipelines and version control systems like Git
Preferred Qualifications
• Hands-on exposure to Snowflake architecture and features
• Hands-on exposure to Microsoft Fabric (OneLake, Lakehouse/Warehouse creation, Fabric Data Factory, or Delta Lake formats)
• Retail domain experience