Devops Engineer
MD RafiiUnited StatesMIDPosted 11d ago
PythonFastAPIDockerKubernetesPostgresAzure/AKSAWS/EKSGCP/GKEvLLMKubernetesKServeKnativeDockerPodmanPostgreSQLObservabilityGitOpsPrometheusGrafanaOpenTelemetry
About the Role
A leading Telecom customer is seeking a skilled DevOps Engineer to join their Data Platform team within the Chief Data Office. This Engineer will play a key role in building, operating, and scaling a production-grade AI inferencing platform that supports high-throughput, low-latency large language model (LLM) workloads.
Key Responsibilities
• Build, operate, and scale a production-grade AI inferencing platform
• Develop Python-based services and automate model deployments
• Optimize model serving performance using vLLM, Kubernetes, KServe, and Knative
• Containerize applications with Docker and Podman
• Maintain and tune PostgreSQL data models
• Troubleshoot production issues and drive platform reliability
• Work closely with ML engineers and platform architects to scale mission-critical AI services
Requirements
• Strong hands-on Python coding and development experience
• Experience with FastAPI
• Expertise with Docker and Kubernetes, including deployments, services, autoscaling, and troubleshooting
• Practical experience with Postgres, including query optimization and schema design
• Cloud platform experience, such as Azure/AKS, AWS/EKS, or GCP/GKE
• Strong debugging skills across the stack
Benefits
• Opportunity to work on cutting-edge AI technologies
• Collaborative and innovative work environment