Jobs → Data & Analytics → Data Engineer With Agentic AI

About the Role We are seeking a Data Engineer with expertise in Agentic AI for the insurance industry. This role involves designing and architecting multi-agent systems for data management and governance. Key Responsibilities • Design and architect multi-agent systems that autonomously manage ETL/ELT pipelines using Databricks, Delta Lake, and Auto Loader • Architect agent-driven data lake/lakehouse solutions with medallion architecture (Bronze/Silver/Gold layers) • Develop intelligent agentic governance frameworks leveraging Unity Catalog, ABAC policies, and Row-Level Security • Design and implement multi-agent orchestration patterns for scalable workflows across cloud regions • Build agent-driven data quality frameworks with autonomous quality monitoring • Architect agents for autonomous data discovery, cataloging, and metadata management • Collaborate with data product owners, analysts, and business stakeholders • Implement comprehensive logging, monitoring, and audit trails for multi-agent systems • Design fallback mechanisms and human-in-the-loop workflows for complex scenarios • Stay current with evolving agent frameworks and industry best practices Requirements • Experience with Databricks, Delta Lake, and Auto Loader • Knowledge of ETL/ELT processes and multi-agent systems • Understanding of Unity Catalog, ABAC policies, and Row-Level Security • Experience with AWS services and LLM integration • Familiarity with medallion architecture and data lakehouse solutions • Strong problem-solving and analytical skills • Ability to work in a team and communicate effectively • Visa status: GC-USC Only