Agentic Data Engineer
Sahil IrfanUnited StatesMIDPosted 11d ago
Agentic Data EngineeringAI-driven data workflow automationdata cleansingdata quality remediationintelligent pipeline orchestrationexception handlinghuman-in-the-loop workflowsDatabricksLakehouseMedallion ArchitectureDelta LakeUnity Catalogdata governancesecuritylineageaccess controlPythonGitCI/CDdata modelingETL/ELTcloud data engineering
About the Role
We are seeking an Agentic Data Engineer for a 6-month Contract-to-Hire position in Chicago, IL with a hybrid work arrangement. This role focuses on AI-driven data workflow automation and Databricks expertise.
Key Responsibilities
• Develop and implement automated data cleansing and quality remediation processes
• Orchestrate intelligent data pipelines with exception handling
• Implement human-in-the-loop workflows for data processing
• Maintain data governance, security, and access control measures
• Utilize Databricks Lakehouse and Medallion Architecture for data solutions
Requirements
• Hands-on experience in Agentic Data Engineering and AI-driven data workflow automation
• Strong Databricks expertise: Lakehouse, Medallion Architecture, Delta Lake, Unity Catalog
• Experience with data governance, security, lineage, and access control
• Proficiency in Python, Git, CI/CD, data modeling, ETL/ELT, and cloud data engineering
• Ability to explain architecture decisions and automation strategies
Candidates must be open to an onsite final-round interview and potential full-time conversion. A current, non-tailored resume is required.