Jobs → Data & Analytics → Data / AI Native Engineer

About the Role We are seeking a Senior Data / AI Native Engineer with strong hands-on experience in data engineering, software engineering, Databricks, PySpark, and AWS. The ideal candidate should have experience leading complex data engineering initiatives and using AI-assisted development tools such as GitHub Copilot and Claude Code CLI to accelerate application development and data pipeline engineering. Key Responsibilities • Design, develop, and maintain scalable Databricks lakehouse pipelines using PySpark and AWS services • Implement modern lakehouse architecture using Delta Lake and Bronze/Silver/Gold data layers • Lead complex data engineering initiatives while remaining actively involved in hands-on development • Leverage GitHub Copilot and/or Claude Code CLI to accelerate coding, debugging, testing, and pipeline development • Build POCs and MVPs rapidly using AI-assisted engineering practices • Integrate AI capabilities directly into data pipelines for schema inference, data quality, anomaly detection, and transformation generation • Develop AI-enabled data products involving feature stores, vector databases, RAG data layers, and embedding pipelines • Implement scalable batch and streaming data processing solutions • Ensure data quality, reliability, performance, and maintainability across the data platform Requirements • Proven experience in data engineering and software engineering • Experience leading complex data engineering initiatives or teams • Hands-on Databricks experience, including Delta Lake, Medallion Architecture (Bronze/Silver/Gold), and Unity Catalog • Strong experience with Apache Spark and PySpark for high-volume data processing • AWS data ecosystem experience, including EMR, S3, Glue, Lambda, and Redshift • Daily hands-on experience with GitHub Copilot and/or Claude Code CLI, with specific examples of usage • Ability to rapidly build POCs and MVPs using AI-assisted development