Senior Data Engineer
Adarsh TripathiUnited StatesSENIORPosted 4d ago
AWSPythonGenerative AISQLAWS Step FunctionsLambdaS3Amazon TextractComprehendDocument processingChunkingEmbeddingsVector indexingVector databasesSemantic searchRAG pipelinesAmazon BedrockKnowledge-base integrationGitHub ActionsCI/CD pipelinesIAMAPI integrationsAWS CertificationClaude Agent SDKAmazon Bedrock AgentCore RuntimeOpenSearchPineconepgvectorLangChainLlamaIndexAWS GlueTypeScriptTerraformAWS CDK
About the Role
TMS LLC is seeking a highly skilled Senior Data Engineer with expertise in AWS, Python, and Generative AI for a contract opportunity in Los Angeles, CA.
Key Responsibilities
• Design and build scalable AWS data pipelines
• Develop automated workflows for structured and unstructured document processing
• Build RAG-based solutions using embeddings, vector databases, and knowledge bases
• Integrate AI agents for contextual information retrieval
• Optimize pipelines for performance, security, scalability, and reliability
Requirements
• 12+ years of experience
• Strong hands-on experience with Python and SQL
• AWS Step Functions, Lambda, and S3
• Amazon Textract and Comprehend
• Document processing, chunking, embeddings, and vector indexing
• Vector databases, semantic search, and RAG pipelines
• Amazon Bedrock and knowledge-base integration
• GitHub Actions and CI/CD pipelines
• AWS IAM and API integrations
• Valid AWS Certification is mandatory
• Experience with Claude Agent SDK, Amazon Bedrock AgentCore Runtime, OpenSearch, Pinecone, pgvector, LangChain, LlamaIndex, AWS Glue, TypeScript, Terraform, or AWS CDK
• Advanced retrieval and reranking techniques