Databricks Data Engineer
Bulbul BaliyanUnited StatesSENIORPosted 10d ago
SparkPySparkSQLDelta LakeAzure Data Lake StorageREST APIsGitCI/CDKafkaAirflowdbtAzure Data FactoryUnity Catalog
About the Role
We are looking for a Senior Databricks Data Engineer to build scalable data pipelines supporting Adobe Experience Platform (AEP), Adobe Journey Optimizer (AJO), and enterprise customer data platforms.
Key Responsibilities
• Build scalable data pipelines for Adobe Experience Platform (AEP) and Adobe Journey Optimizer (AJO)
• Design and implement solutions using Databricks, Spark, PySpark, SQL, and Delta Lake
• Integrate with enterprise systems using REST APIs
• Implement CI/CD practices and data modeling
Requirements
• 4+ years of Databricks experience
• Expert-level Spark and PySpark skills
• Strong SQL and Python programming
• Experience with Delta Lake and scalable ETL/ELT pipelines
• Familiarity with Azure Data Lake Storage (ADLS) or AWS S3
• Knowledge of Git, CI/CD, and data modeling
Preferred Skills
• Experience with Adobe Experience Platform (AEP) and Adobe Journey Optimizer (AJO)
• Understanding of Real-Time CDP and Customer 360
• Customer identity resolution
• Familiarity with Kafka, Airflow, dbt, Azure Data Factory, and Unity Catalog