Jobs → Data & Analytics → Data Engineer

About the Role We are seeking a highly skilled Data Engineer to design, build, and optimize our next-generation data infrastructure. This role focuses on developing robust, scalable data pipelines and expanding our cloud data warehouse architecture. Key Responsibilities • Design, build, and maintain scalable batch and real-time ETL/ELT data pipelines using Python and distributed systems • Architect and optimize our cloud data warehouse (Snowflake/Databricks) and data lake layouts • Implement clean, reliable data structures using dimensional modeling (Kimball methodology) • Author and manage complex workflows using scheduling tools like Apache Airflow, Prefect, or Dragster • Implement automated testing, CI/CD deployment pipelines via Git, and data observability frameworks • Structure and optimize unstructured text, vector databases, and pipelines to support large language models (LLMs) and AI agent infrastructure Requirements • Expert-level mastery of SQL and Python (or Scala/Java) • Hands-on, production-level experience with major cloud platforms, primarily AWS (S3, EMR, Redshift, Lambda) or Azure/GCP equivalents • Proven experience with dbt (data build tool) for transformations and version-controlled data pipelines • Practical experience managing massive datasets using Apache Spark or PySpark • Strong familiarity with Git, Docker, and CI/CD best practices