Senior Data Engineer-Databricks at Versant3

About the Role

The Data Engineering team is seeking a Senior Data Engineer to help design, build, and scale the modern data platform that powers analytics, data science, and data products across Versant brands. This role involves collaborating with multiple teams to deliver reliable, high-impact data solutions used by hundreds of internal users.

Key Responsibilities

• →Design and implement lakehouse architecture using Delta Lake, including medallion pipeline patterns (Bronze/Silver/Gold), schema enforcement, and time travel
• →Build and operate batch and real-time ingestion pipelines leveraging Databricks Auto Loader, Structured Streaming, and Change Data Capture patterns
• →Implement data governance and security using Unity Catalog, RBAC, and compliance-driven practices for sensitive environments
• →Optimize performance and manage costs through FinOps strategies, including cluster sizing, workload tagging, Spark tuning, and Photon acceleration
• →Design, implement, and maintain CI/CD pipelines and orchestration workflows using Databricks Workflows, Delta Live Tables, and tools such as Airflow
• →Collaborate with Data Science teams on ML workflows, including MLflow, feature store integration, and model lifecycle management
• →Ensure data quality, observability, and lineage across media-specific datasets such as streaming logs, ad impressions, and audience metrics
• →Provide technical mentorship through code reviews, pairing, and knowledge sharing