Data Scientist
Anjali SenUnited StatesSENIORPosted 10d ago
DatabricksAWS MLOpsPythonGenerative AISQLPL/SQLTerraformCI/CDML PipelinesModel DeploymentOpenAIClaudeObservabilityMonitoring Dashboards
About the Role
We are looking for an experienced Data Scientist with strong expertise in Databricks, AWS MLOps, Python, and Generative AI to join our team.
Key Responsibilities
• Design and implement scalable data science and ML solutions using Databricks and AWS.
• Develop and manage Databricks pipelines, SQL Warehouses, Unity Catalog, and compute configurations.
• Implement MLOps practices, CI/CD pipelines, and automated deployments.
• Build and optimize cloud-based ML workflows using AWS services.
• Work with Generative AI and Large Language Models (LLMs).
• Develop monitoring dashboards and observability solutions.
Requirements
• 10 years of relevant IT/Data Science experience.
• Strong hands-on expertise in Databricks and AWS cloud services.
• Experience implementing MLOps solutions and scalable ML pipelines.
• Knowledge of Generative AI, LLMs, and cloud infrastructure automation.
• Experience with Databricks: Genie, Unity Catalog, SQL Warehouse, Compute Setup, Databricks Asset Bundles (DABs).
• Experience with AWS MLOps: SageMaker, ECS, Lambda, SSM Parameter Store, EventBridge.
• Programming skills in Python, SQL, PL/SQL.
• Infrastructure as Code: Terraform.
• DevOps & MLOps: CI/CD, ML Pipelines, Model Deployment.
• Generative AI: OpenAI, Claude, GCP LLM Models.
• Monitoring: Observability and Monitoring Dashboards.