Jobs → Data & Analytics → Databricks Engineer

About the Role We are seeking a Databricks Engineer for a long-term contract position. This role involves building ETL pipelines using Databricks and working with various AWS services. Key Responsibilities • Build and maintain ETL pipelines using Databricks • Work with AWS services including S3, Glue, Athena, Lambda, Step Functions, and EventBridge • Implement Data Lake concepts and Medallion Architecture • Develop CI/CD pipelines using Git, GitHub Actions • Design dimensional data models and process distributed data • Manage stakeholder communications Requirements • 5–7+ years of enterprise Data Engineering experience • Strong hands-on experience building ETL pipelines using Databricks • Advanced Python, SQL, Apache Spark, and PySpark skills • Experience with AWS services: S3, Glue, Athena, Lambda, Step Functions, and EventBridge • Knowledge of Data Lake concepts and Medallion Architecture • Proficiency with Git, GitHub Actions, and CI/CD pipelines • Experience with CloudFormation or Terraform • Dimensional data modeling and distributed data processing skills • Excellent communication and stakeholder management skills Important Requirements • Candidates must have real, hands-on experience building ETL pipelines using Databricks • Mandatory ID verification (IDV) is required • The screening process includes a Solutions Screening • An onsite, face-to-face interview in Malvern, PA is mandatory