Data Engineer
Pradeep Mahandha MRemoteSENIORPosted 2h ago
PySparkSQLDelta Live TablesdbtADFDatabricksSnowflakeCI/CDGenAI
About the Role
We are looking for a Data Engineer to join our team. This role focuses on building and maintaining data pipelines and enabling data for AI consumption.
Key Responsibilities
• Hands-on pipeline engineering with production PySpark/SQL, Delta Live Tables or dbt
• Workflows orchestration using ADF and Databricks/Snowflake
• Rapid POCs and reusable accelerators development
• Data profiling, consolidation and optimization
• Delivery engineering and BI enablement
• Enabling data for AI consumption
• AI-assisted productivity with GenAI tooling
Requirements
• 6 to 9 years of experience in pipeline engineering
• Strong skills in PySpark, SQL, Delta Live Tables, dbt, ADF, Databricks, Snowflake
• Experience with CI/CD and automated testing
• Knowledge of semantic layer, context layer and knowledge graph enablement
• Strong written English skills
• Reliable overlap hours