Databricks QA Engineer
RAJU JUnited StatesSENIORPosted 4h ago
DatabricksData EngineeringMedallion ArchitectureDelta LakeData LakeData IngestionELT pipelinesSQLAutomation testingPythonPySparkPytestUnity CatalogLakeflow PipelinesAsset BundlesAzure DevOpsCI/CD pipelinesData Quality frameworksODCSDQXAI-assisted QAMCP-based testing
About the Role
We are looking for an experienced Databricks QA Engineer with a strong background in Data Engineering, Data Quality, and Automation Testing.
Key Responsibilities
• Develop and execute automated test cases
• Perform data validation and regression testing
• Identify, report, and troubleshoot data quality issues
• Validate Databricks pipelines and data transformations
• Support automation-first QA practices and release sign-off
Requirements
• Strong experience in Databricks and Data Engineering
• Hands-on experience with Medallion Architecture (Bronze, Silver, Gold)
• Strong knowledge of Delta Lake, Data Lake, Data Ingestion, and ELT pipelines
• Expert-level SQL skills
• Automation testing using Python, PySpark, and Pytest
• Experience with Unity Catalog, Lakeflow Pipelines, and Asset Bundles
• Experience with Azure DevOps CI/CD pipelines and quality gates
• Knowledge of Data Quality frameworks such as ODCS and DQX
• Experience with AI-assisted QA and MCP-based testing is a plus