Agentic Data Engineer
Sanjay ChaudharyUnited StatesMIDPosted 11d ago
Agentic Data EngineeringAI-Driven Data EngineeringIntelligent Workflow AutomationAutomated Data CleansingData Quality RemediationIntelligent Pipeline OrchestrationException ManagementHuman-in-the-Loop WorkflowsDatabricks ArchitectureMedallion ArchitectureLakehouse ArchitectureDelta LakeUnity CatalogEnd-to-End Pipeline DevelopmentDatabricks WorkflowsPythonGitCI/CDData PipelinesData ModelingETL/ELTCloud ExperienceAWSABACData GovernanceData LineageRow-Level SecurityAuditabilityEnterprise Security FrameworksEntitlement-Based ArchitecturesData MasteringEnterprise IntegrationsHierarchy ModelingCross-Domain Connectivity
About the Role
We are looking for an experienced Agentic Data Engineer who combines strong Databricks expertise with AI-driven automation to build intelligent, enterprise-scale data engineering solutions. This is NOT a traditional ETL/Data Engineer role.
Key Responsibilities
• Implement intelligent workflows and automated data quality remediation
• Build AI-enabled data pipelines in production
• Design and manage Databricks architecture and Lakehouse solutions
• Develop end-to-end data pipelines and implement data governance
• Create unified enterprise data domains and AI-enabled data products
Requirements
• Strong experience in Agentic Data Engineering and AI-Driven Data Engineering
• Proficiency in Intelligent Workflow Automation and Pipeline Orchestration
• Experience with Automated Data Cleansing and Data Quality Remediation
• Knowledge of Databricks Architecture, Medallion & Lakehouse Architecture
• Familiarity with Delta Lake and Unity Catalog
• End-to-End Pipeline Development skills
• Experience with Databricks Workflows, Python, Git & CI/CD
• Data Pipelines, Data Modeling & ETL/ELT experience
• Cloud Experience – AWS Preferred
• Understanding of ABAC, Data Governance, Data Lineage, Row-Level Security
• Experience with data mastering, enterprise integrations, hierarchy modeling, and cross-domain connectivity