Agentic Data Engineer
Rishabh RaghavUnited StatesMIDPosted 11d ago
Agentic Data EngineeringAI-driven data workflowsIntelligent workflow automationPipeline orchestrationData cleansingData quality remediationException managementHuman-in-the-loop processesAI-powered automationDatabricks architectureLakehouse architectureDelta LakeUnity CatalogData pipeline developmentDatabricks WorkflowsData governanceEnterprise security frameworksABACData lineageRow-level securityPythonGitCI/CDData pipelinesETL/ELTAWSData modelingEnterprise data domain designModern data engineering practices
About the Role
We are seeking an Agentic Data Engineer to join our team in Chicago, IL. This role focuses on implementing intelligent data engineering solutions using Agentic AI and Databricks technologies.
Key Responsibilities
• Design and implement Agentic Data Engineering and AI-driven data workflows
• Develop intelligent workflow automation and pipeline orchestration
• Create automated data cleansing and data quality remediation processes
• Manage exception handling and human-in-the-loop processes
• Reduce manual intervention through AI-powered automation
• Implement production-ready intelligent data engineering solutions
Requirements
• Expertise in Agentic Data Engineering and AI-driven data workflows
• Strong experience with intelligent workflow automation and pipeline orchestration
• Proficiency in automated data cleansing and data quality remediation
• Knowledge of exception management and human-in-the-loop processes
• Experience with production implementation of intelligent data engineering solutions
• Databricks architecture and ecosystem expertise
• Medallion and Lakehouse architecture knowledge
• Delta Lake and Unity Catalog experience
• End-to-end data pipeline development skills
• Databricks Workflows and pipeline orchestration experience
• Data governance and enterprise security frameworks understanding
• ABAC (Attribute-Based Access Control) knowledge
• Data lineage and auditability experience
• Row-level security and entitlement-based architectures understanding
• Python, Git, and CI/CD proficiency
• Data pipelines and ETL/ELT experience
• AWS or other cloud platform experience
• Data modeling and enterprise data domain design skills
• Modern data engineering practices and automation strategies knowledge