Jobs → Data & Analytics → Data Engineer

About the Role We are looking for a Data Engineer to architect and implement end-to-end data pipelines using various cloud technologies. Key Responsibilities • Architect end-to-end pipelines using AWS, Snowflake, IICS, and PySpark • Design and deploy containerized PySpark workloads on EKS • Build and tune EMR clusters on EC2 or EKS for large-scale processing • Orchestrate workflows using AWS Step Functions and Control-M • Manage metadata using AWS Glue Data Catalog and integrate it with Snowflake Iceberg • Use DynamoDB for pipeline state, checkpoints, and configuration • Lead implementation of Snowflake capabilities including Iceberg Tables, Dynamic Tables, Views, Materialized Views, Tasks and Streams, Data Governance, Horizon Catalog, Semantic Views, Cortex (Cortex AI), Snowflake Agents, and token-usage optimization strategies Requirements • 9+ years of experience in data engineering • Strong experience with AWS, Snowflake, IICS, and PySpark • Experience with EKS, EMR, EC2 • Knowledge of AWS Step Functions and Control-M • Familiarity with AWS Glue Data Catalog and DynamoDB • Experience with Snowflake capabilities and data governance