AI/Data Engineer
ARCHANA PRAJAPATIUnited StatesMIDPosted 6d ago
PythonSQLPySparkDatabricksSparkLarge Language ModelsRetrieval-Augmented GenerationAI AgentsVector DatabasesPrompt EngineeringLangChainLangGcapbCrewAIAutoGenPineconeOdcantWeaviateMilvusChromaDBAzureAWSGoogle Cloud PlatformAzure AI SearchAzure OpenAIAgile
About the Role
We are seeking an AI/Data Engineer with extensive experience in Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and AI solutions. This role involves building and deploying advanced AI applications and working with vector databases.
Key Responsibilities
• Build and deploy Retrieval-Augmented Generation (RAG) applications
• Develop AI Agents using frameworks like LangChain, LangGcapb, CrewAI, or AutoGen
• Work with Vector Databases such as Pinecone, Odcant, Weaviate, Milvus, or ChromaDB
• Design document ingestion, embeddings, retrieval, and knowledge search solutions
• Develop scalable APIs and microservices for AI-powered applications
• Implement LLM evaluation, monitoring, guardrails, and responsible AI practices
Requirements
• 4-6 years of experience in Data Engineering and AI solutions
• Strong expertise in Python, SQL, PySpark, Databricks/Spark
• Hands-on experience with Large Language Models (LLMs) such as OpenAI, Azure OpenAI, Claude, or Llama
• Experience with cloud platforms (Azure preferred, AWS/Google Cloud Platform acceptable)
• Familiarity with Azure AI Search, Azure OpenAI, and enterprise AI frameworks
• Strong analytical, communication, and stakeholder management skills
• Ability to work in an Agile environment and deliver enterprise-grade GenAI solutions
• Healthcare domain experience (Claims, Membership, Provider, Clinical) is preferred