Jobs → Data & Analytics → Databricks Data Engineer

About the Role We are looking for a Databricks Data Engineer to join our team. This role requires extensive experience with Databricks and Apache Spark for building and maintaining data pipelines. Key Responsibilities • Design and implement data pipelines using Databricks and Spark • Develop and maintain Lakehouse architecture with Delta Lake • Build bronze, silver, and gold data layers • Implement data ingestion from various AWS services • Create streaming pipelines using Kinesis, Kafka, or Spark Structured Streaming • Implement data quality controls and monitoring • Manage CI/CD processes and technical documentation Requirements • 5+ years of data engineering experience • 2+ years of hands-on experience with Databricks or large-scale Apache Spark • Strong development experience with Python, PySpark, and Spark SQL • Production experience with Delta Lake and its features • Experience with AWS services including S3, Glue, Kinesis, RDS, Redshift, and Athena • Knowledge of Unity Catalog and AWS IAM • Strong Git and CI/CD experience