Data Engineer
Deepak Kumar SinghRemoteSENIORPosted 13d ago
PythonAirflowAI/MLETLSalesforceSQLSnowflakedbtAWSGCPLLM APIsLangChainLangGraphCrewAIAutoGenPineconeChromaMilvus
About the Role
We are looking for an experienced Senior Data Engineer / Data Architect with strong expertise in Python, Airflow, data engineering, and AI/ML to build intelligent, agent-driven data enrichment solutions and modern data pipelines.
Key Responsibilities
• Build agentic capabilities to improve operational efficiency in how third-party data is ingested and consumed by internal stakeholders
• Manage data egress from Data 360 to destination systems, including Salesforce's main CRM, as directed by stakeholders
• Conduct deep discovery on a top-priority agentic use case targeting operational efficiency improvements and deliver an initial Proof of Concept (POC)
Requirements
• Strong experience in data engineering, ETL (preferably Informatica), and data architecture
• Experience working with Salesforce platforms and data models
• Hands-on experience with Airflow
• Strong SQL skills with Snowflake and other relational databases
• Experience writing complex Python modules for custom ETL workflows
• Expertise in building batch and real-time data pipelines
• Experience with dbt for data transformation and modeling
• Familiarity with AWS/GCP and distributed/event-driven architectures
• Strong understanding of data modeling, data warehousing, and big data processing
• Experience with data quality, monitoring, and pipeline orchestration frameworks
• Strong Python experience for AI application development
• Experience working with LLM APIs (OpenAI, Anthropic, Gemini) and prompt engineering beyond basic demos
• Experience with agentic frameworks: LangChain, LangGraph, CrewAI, AutoGen, or similar
• Familarity with vector databases (Pinecone, Chroma, Milvus) and RAG pipelines