Agentic Data Engineer
Riyansh PathakUnited StatesMIDPosted 11d ago
Agentic AIIntelligent Workflow AutomationDatabricksDelta LakeUnity CatalogMedallionLakehouse ArchitecturePythonETL/ELTData PipelinesData Quality AutomationRemediationData GovernanceABACData SecurityAWSGitCI/CD
About the Role
We are looking for an experienced Agentic Data Engineer with hands-on expertise in AI-driven data engineering and Databricks.
Key Responsibilities
• Design and implement AI-driven data engineering solutions
• Utilize Databricks, Delta Lake, and Unity Catalog
• Work with Medallion and Lakehouse Architecture
• Develop Python-based ETL/ELT and data pipelines
• Implement data quality automation and remediation
• Ensure data governance, ABAC, and data security
• Work with AWS, Git, and CI/CD
Requirements
• Experience in AI-driven data engineering
• Proficiency in Databricks, Delta Lake, and Unity Catalog
• Knowledge of Medallion and Lakehouse Architecture
• Strong Python skills for ETL/ELT and data pipelines
• Experience with data quality automation and remediation
• Understanding of data governance, ABAC, and data security
• Familiarity with AWS, Git, and CI/CD