AI Data Engineer (Cloud)
Rakesh ReddyUnited StatesSENIORPosted 3h ago
SnowflakeSnowflake Cortex AI (LLM)ETL/ELT PipelinesAWSSnowparkSnowflake Native App FrameworkPythonGenAI Application DevelopmentCI/CD (GitHub Actions/Jenkins)Terraform/CloudFormationML/LLM Observability (Arize)LLM Evaluation & Drift MonitoringStructured Data ExtractionHuman-in-the-Loop ClassificationData Privacy/ComplianceSnowflake Governance (RBAC, Masking)Prompt Regression TestingSnowpark Container Services
About the Role
Our client is seeking an AI Data Engineer to join its Data Engineering team, building ingestion and transformation pipelines and GenAI-enabled workflows on Snowflake and AWS, and packaging them as Snowflake Native Apps.
Key Responsibilities
• Design and build scalable data ingestion and transformation pipelines in Snowflake and AWS
• Develop GenAI-enabled workflows using Snowflake Cortex AI or an equivalent production LLM platform, including structured extraction from free text at scale
• Package solutions as Snowflake Native Apps using the Native App Framework and Snowpark
• Implement ML/LLM observability, evaluation design, and drift monitoring
• Define and track data quality and model quality KPIs
• Build CI/CD and infrastructure-as-code for pipeline deployment
• Support production rollout, documentation, and handoff to operations teams
Requirements
• 10+ years of experience, including 5+ years in data engineering and 2+ years of hands-on GenAI application development
• Advanced Snowflake: SQL, Tasks/Streams, stored procedures, performance tuning
• Snowflake Cortex AI or equivalent production LLM platform
• Snowflake Native App Framework / Snowpark
• AWS: S3, Lambda, Glue, Step Functions, DynamoDB, EC2, CloudFormation, Kinesis
• Production-grade Python
• CI/CD (GitHub Actions/Jenkins) and IaC (Terraform/CloudFormation)
• ML/LLM observability (Arize or comparable), evaluation design, and drift monitoring.