Senior Data Platform Engineer
kruthiTechRemoteSENIORPosted 48m ago
AzureDatabricksSnowflakeAirflowPythonSQLETLELTData ModelingDistributed Data ProcessingData Platform RefactoringPerformance OptimizationAI-Assisted DevelopmentAutomation Tools
About the Role
We are looking for an experienced Senior Data Platform Engineer to build, refactor, and optimize enterprise-scale data platforms using Azure, Databricks, Snowflake, and Airflow.
Key Responsibilities
• Assess, refactor, and optimize existing data platforms and pipelines
• Design, develop, and maintain scalable end-to-end data pipelines
• Implement data ingestion, transformation, and storage solutions using Databricks and Snowflake
• Build and optimize data processing workflows using Apache Spark and Delta Lake
• Collaborate with architects and application developers on data models and schemas
• Ensure data quality, reliability, observability, and governance
• Optimize cloud workloads for performance, scalability, and cost efficiency
• Implement engineering best practices, CI/CD, testing, version control, and documentation
• Support application development, analytics, and data science teams with trusted data assets
Requirements
• Strong expertise in Microsoft Azure
• Databricks (Apache Spark, Delta Lake, Notebooks)
• Apache Airflow
• Snowflake
• Python
• Advanced SQL
• ETL / ELT Pipelines
• Data Modeling & Distributed Data Processing
• Data Platform Refactoring & Performance Optimization
• AI-Assisted Development & Automation Tools