Principal Data Architect
Jyotsana SinghRemoteSENIORPosted 13d ago
SQLPythonPySparkDatabricksDelta LakeSnowflakeKafkaAWSAirflowTerraformGitMLflowBI semantic layersDockerKubernetesFastAPIGrafanaCloudWatchvector databasesNeo4jRAGLLM frameworks
About the Role
We are looking for a Principal Data Architect to own enterprise-scale data platforms end to end, from modeling and lakehouse design through governance and AI-ready data layers.
Key Responsibilities
• Architect lakehouse and/or data mesh platforms on Databricks, Delta Lake, Snowflake, Kafka and Spark Structured Streaming
• Lead dimensional, normalized and Data Vault modeling, with sound judgment on grain and conformance
• Own data governance, quality, master data, metadata and lineage, including the operating model
• Drive SQL performance engineering: query optimization, partitioning, clustering and cost management at scale
• Lead migrations of legacy on-prem warehouses and ETL estates to cloud-native platforms (AWS, Azure)
• Architect data for ML and AI: feature pipelines, training data curation, and retrieval/vector layers
• Secure data and keep it compliant in regulated environments
Requirements
• 15+ years in data engineering and architecture, owning enterprise platforms
• Expert in SQL, Python, PySpark, Databricks, Delta Lake, Snowflake and Kafka
• Strong AWS (S3, Glue, Redshift, Kinesis, EKS, Lambda), Airflow, Terraform and Git-based CI/CD
• Regulated-industry experience (financial services, payments, cybersecurity or healthcare)
• BS/MS in Computer Science, Information Systems, Data Engineering or a related field