Data & ML Engineer
Himanshu VermaUnited StatesMIDPosted 2h ago
Microsoft AzureAzure DatabricksAzure Data FactorySynapse AnalyticsPythonSQLScalaApache SparkPySparkETL/ELT PipelinesData EngineeringCI/CDDevOpsMLOpsMLflowDockerKubernetes/AKSAzure Data LakeDelta Lake
About the Role
We are looking for an experienced Data & ML Engineer to join our team. This role requires strong hands-on expertise in Microsoft Azure, data engineering, and machine learning operations.
Key Responsibilities
• Design and implement data solutions using Microsoft Azure services
• Develop and maintain ETL/ELT pipelines for data engineering
• Build and deploy machine learning models using MLOps practices
• Optimize production data pipelines for performance
• Utilize Azure Databricks, Data Factory, and Synapse Analytics
Requirements
• Strong expertise in Microsoft Azure Data Services
• Experience with Azure Databricks, Azure Data Factory & Synapse Analytics
• Proficiency in Python, SQL, and Scala
• Knowledge of Apache Spark / PySpark
• Experience with ETL/ELT Pipelines & Data Engineering
• Familiarity with CI/CD, DevOps & MLOps practices
• Understanding of MLflow, Docker, and Kubernetes/AKS
• Experience with Azure Data Lake & Delta Lake
• Ability to optimize production data pipelines