Jobs → Data & Analytics → Azure Data Engineer

About the Role We are seeking a highly skilled Data Engineer to design, develop, and maintain scalable data platforms and pipelines using modern cloud-based data solutions. Key Responsibilities • Design, develop, and maintain scalable data pipelines using Databricks, PySpark, SQL, and Python • Build and optimize ETL/ELT processes to ingest, transform, and load data from multiple source systems Requirements • 10+ years of Data Engineering experience with modern cloud data platforms • Hands-on experience with Databricks, PySpark, SQL, and Python • Strong understanding of ETL/ELT design patterns, data integration, and data warehousing concepts • Experience with relational databases, data modeling, partitioning, indexing, and query optimization • Expertise in building and maintaining large-scale data pipelines and batch processing solutions • Experience working with cloud platforms such as Azure, AWS, or GCP • Strong problem-solving, debugging, and analytical skills • Proven experience architecting and delivering systems using agentic IDEs • Ability to define architectural intent that agents can follow and integrate agentic workflows into CI/CD pipelines • Experience supervising AI agents across multi-service systems, legacy modernization, and large codebases • Strong understanding of security implications of autonomous code execution, compliance, auditability, and traceability • Core responsibility to guide effective use of agentic IDEs for complex changes and establish review practices for AI-generated code • Design system architectures that support AI-augmented and agentic development workflows • Define guardrails, standards, and governance for the use of autonomous coding agents • Evaluate impact of agentic IDEs on SDLC, CI/CD pipelines, security posture, and technical debt • Authorized to work in the United States without requiring visa sponsorship