Loading...
ManagerContractAWSData ScienceAgileScrumAIML
Salary Range
$176,800 - $239,200 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for data-driven Project Managers to lead our large-scale multilingual data collection and Large Language Model (LLM) evaluation initiatives. In this role, you will be the operational backbone of our AI development, orchestrating global teams of annotators and data specialists.
Key Responsibilities
- →Manage the full lifecycle of AI data projects, from scoping and guidelines creation to data delivery and post-mortem analysis.
- →Oversee large-scale data pipelines for multilingual data collection (audio, text, image) and LLM evaluation (RLHF, SFT, ranking, and safety testing).
- →Forecast capacity needs and manage the allocation of internal and external workforce across multiple time zones and languages.
- →Monitor and report on key performance indicators, including throughput, quality, and productivity.
- →Implement robust QA loops and corrective training for annotator pools.
- →Build and maintain dashboards to visualize project health and flag bottlenecks in real-time.
- →Manage relationships with data experts and crowd pools, ensuring adherence to SLAs regarding localized nuances and linguistic accuracy.
- →Liaise with Applied AI Technical Ops teams and translate technical requirements into clear, actionable guidelines for non-technical annotators.
- →Facilitate continuous feedback loops where data insights drive updates to annotation guidelines and model fine-tuning strategies.
Requirements
- ✓3-5+ years of project management experience within AI/ML data operations.
- ✓Strong understanding of LLM training processes and evaluation methodologies.
- ✓Advanced proficiency in Excel/Google Sheets and ability to write SQL queries.
- ✓Proven track record using Agile, Scrum, or Kanban methodologies to manage complex workflows.
- ✓Exceptional ability to write clear, unambiguous guidelines for multilingual audiences.
Free to sign up. Takes 30 seconds.
