Principal Data Engineer
Tanuja PenumatsaUnited StatesSENIORPosted 10d ago
PythonSQLDatabricksSparkKafkaSnowflakedbtApache IcebergDelta LakeAirflowKubernetesDockerTerraformData MeshData LakehouseMicrosoft FabricAWSAzureGCPUnity CatalogAI Data Pipelines
About the Role
We are looking for a Principal Data Engineer to architect enterprise-scale data platforms supporting AI, Machine Learning, analytics, and real-time data processing. The ideal candidate should possess deep expertise in distributed systems, modern data architecture, and cloud-native engineering.
Key Responsibilities
• Architect enterprise data platforms
• Design Data Lakehouse architecture
• Build real-time streaming solutions
• Develop enterprise data APIs
• Design Data Mesh architecture
• Implement enterprise metadata management
• Build scalable cloud-native data services
• Optimize large-scale data processing
• Mentor engineering teams
• Define enterprise data engineering standards
Requirements
• Python
• SQL
• Databricks
• Spark
• Kafka
• Snowflake
• dbt
• Apache Iceberg
• Delta Lake
• Airflow
• Kubernetes
• Docker
• Terraform
• Data Mesh
• Data Lakehouse