Databricks Data Engineer
Murugesan SubramaniRemoteMIDPosted 2h ago
DatabricksPySparkPythonSQLApache SparkDelta LakeETLELTUnity CatalogAWSAzureGCPAIMLflowMLOpsGenAILLMsRAG
About the Role
We are looking for a Data Engineer with Databricks expertise to join our team in the Life Sciences domain. This role involves working with AI/ML and GenAI technologies to support pharmaceutical, biotechnology, and clinical research customers.
Key Responsibilities
• Build and maintain ETL/ELT pipelines using Databricks, PySpark, and Delta Lake
• Work with Unity Catalog and cloud platforms (AWS, Azure, or GCP)
• Support Life Sciences, Pharmaceutical, Biotechnology, or Clinical Research customers
• Implement solutions using AI/ML, MLflow, MLOps, GenAI, LLMs, and RAG
Requirements
• 5+ years of Data Engineering experience with hands-on Databricks expertise
• Strong skills in PySpark, Python, SQL, Apache Spark, and Delta Lake
• Experience building ETL/ELT pipelines and working with Unity Catalog
• Cloud platform experience (AWS, Azure, or GCP)
• Experience supporting Life Sciences, Pharmaceutical, Biotechnology, or Clinical Research customers
• Working knowledge of AI/ML, MLflow, MLOps, GenAI, LLMs, and RAG
• Databricks Certified Data Engineer Associate or Professional certification preferred