Jobs → Data & Analytics → Data Engineer with AI

About the Role We are seeking a highly experienced Data Engineer to join our data platform team. The successful candidate will design, build, and optimize our next-generation data architecture and pipelines, transforming raw data into actionable insights for analytics, reporting, and Machine Learning. Key Responsibilities • Design and build robust, scalable ETL/ELT pipelines for ingesting data from diverse sources into our data lake and data warehouse • Write and optimize complex data transformation jobs using PySpark and the Spark DataFrame API • Utilize advanced SQL for complex querying, data manipulation, and performance tuning • Implement data validation, cleansing, and monitoring routines to ensure high data quality • Design and implement optimal data models for our data warehouse to support business intelligence • Drive cloud-native data solutions leveraging Azure Databricks, Azure Data Lake, and Synapse • Implement orchestration tools like Apache Airflow Requirements • 12+ years of experience • Databricks Certification • Strong proficiency with SQL and Pyspark • Azure Databricks Certification • Experience with ETL/ELT processes • Expertise in data modeling techniques • Knowledge of cloud platforms like Azure, AWS, or Google Cloud • Experience with data orchestration tools • Ability to handle petabytes of structured and unstructured data efficiently