Jobs → Data & Analytics → Data Science & Analytics Subject Matter Expert

About the Role We are looking for a Data Science & Analytics Subject Matter Expert to contribute to a high-impact project focused on advanced analytical pipelines and LLMs. This role involves evaluating and improving next-generation AI systems by applying real-world data science and analytics expertise. Key Responsibilities • Map scaled-analysis and pipeline-integration scenarios to established evaluation taxonomies. • Create detailed analytical test cases covering automation, data enrichment, triage, and large-scale analysis. • Evaluate model responses for reasoning, source handling, limitations, and practical usefulness. • Identify over-refusal issues affecting legitimate analytical workflows. • Document edge cases, methodology gaps, and actionable improvement recommendations. • Provide clear written and verbal feedback to improve AI model performance. Requirements • 6+ years of experience in data science and analytics. • Experience integrating LLMs into complex data or analytical pipelines. • Strong understanding of large-scale analysis, automation failure modes, and evaluation metrics. • Experience in mentoring, technical leadership, or teaching data science. • Excellent technical documentation and written English communication skills. • Exposure to evaluation frameworks or benchmarking systems. • Government, defense, intelligence, or related analytical domain experience is a plus. • Ability to work independently with distributed international teams.