Senior Data Engineer
Vikas DhobaleRemoteSENIORPosted 2h ago
PySparkSQLDelta Live TablesdbtAzure Data FactoryDatabricksSnowflakeCI/CDGenAI
About the Role
We are looking for a hands-on Senior Data Engineer to join our team on a Contract or Full-time basis. This role focuses on building scalable data pipelines, optimizing cloud data warehouses, and enabling data for AI consumption.
Key Responsibilities
• Build working prototypes for ingestion, data quality, and reconciliation frameworks
• Perform duplicate/overlap analysis, source-to-target mapping, and Spark tuning
• Implement cost control measures on Databricks and Snowflake
• Develop semantic/SQL layers for reporting
• Enable data for AI consumption through semantic layers, context layers, and knowledge graph enablement
• Utilize GenAI tooling for code conversion, testing, and documentation
Requirements
• 6 to 9 years of experience in hands-on pipeline engineering
• Proficiency in PySpark, SQL, Delta Live Tables, dbt, Azure Data Factory, and Databricks/Snowflake workflows
• Experience with CI/CD, automated testing, and building semantic/SQL layers for reporting
• Strong written communication and collaboration skills