Jobs → Data & Analytics → Lead DataOps Engineer

About the Role We are seeking a Lead DataOps Engineer to join Selective Insurance. This role requires strong data engineering experience and technical leadership skills. Key Responsibilities • Design and implement data pipelines using Databricks, PySpark, and SQL • Develop and maintain CI/CD processes for data workflows • Orchestrate and automate data pipelines using tools like Azure Data Factory, Airflow, or dbt • Ensure production monitoring, data quality, and pipeline reliability • Provide technical leadership and mentor junior team members Requirements • 8+ years of data engineering experience • Strong expertise in Databricks, PySpark, SQL, and cloud platforms (Azure preferred) • Hands-on experience with DataOps, CI/CD, pipeline orchestration, and automation • Experience with Azure Data Factory, Airflow, or dbt • Production monitoring, data quality, and pipeline reliability experience • Technical leadership and mentoring experience