Senior Data Engineer
Ganesh Kumar Reddy ApepalliUnited KingdomSENIORPosted 4h ago
DatabricksPythonSQLPySparkApache SparkDBTDelta LakeAzure CloudData ModellingEnd-to-End Data Pipeline EngineeringData Quality & Validation
About the Role
We are looking for a Senior Data Engineer to join our team at PrimusGlobal. This role focuses on designing, building, and migrating scalable data pipelines using Databricks.
Key Responsibilities
• Design, build, and migrate scalable data pipelines using Databricks
• Develop production-grade ingestion, transformation, and curated data layers
• Build and optimize large-scale data processing workflows using PySpark, Spark, and SQL
• Implement data transformation and modelling using DBT
• Design and maintain Delta Lake architectures
• Establish data quality frameworks, validation rules, and automated monitoring
• Deploy and optimize secure, scalable data solutions on Azure
• Troubleshoot pipeline issues and improve performance across data workflows