Senior Data Engineer
Tanuja PenumatsaUnited StatesSENIORPosted 7h ago
PythonSQLDatabricksPySparkSnowflakeDelta LakeApache IcebergdbtApache AirflowGitDockerAzureAWSGCPUnity CatalogKafkaData MeshData LakehouseGreat Expectations
About the Role
We are seeking a Senior Data Engineer with expertise in modern Lakehouse architecture, Databricks, Delta Lake, Snowflake, and Apache Iceberg. The ideal candidate will design and build scalable cloud-native data platforms supporting enterprise analytics, AI/ML, and Generative AI initiatives.
Key Responsibilities
• Design enterprise Lakehouse architecture
• Build scalable ETL/ELT pipelines using Databricks
• Develop PySpark applications for large-scale data processing
• Build data models using dbt
• Implement Delta Lake and Apache Iceberg
• Optimize Snowflake performance
• Build batch and streaming pipelines
• Develop reusable data engineering frameworks
• Implement data governance and quality
• Support AI/ML data pipelines
Requirements
• Python
• SQL
• Databricks
• PySpark
• Snowflake
• Delta Lake
• Apache Iceberg
• dbt
• Apache Airflow
• Git
• Docker
• Azure / AWS / GCP