Strategic Project Lead – Software Engineering
Umadevi NaiduRemoteSENIORPosted 2h ago
PythonSQL
About the Role
We are looking for experienced Strategic Project Leads with hands-on experience managing software engineering data programs for frontier AI models. The ideal candidate should combine strong software engineering judgment with end-to-end program delivery, quality management, and operational leadership.
Key Responsibilities
• Manage end-to-end software engineering data and evaluation programs.
• Oversee coding data, coding RLHF/preference data, SWE benchmarks, model evaluations, agentic coding, code generation, and code repair.
• Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance.
• Track throughput, quality, rework, defects, costs, and delivery timelines.
• Review code, tests, task metadata, and final deliverables for technical accuracy.
• Identify quality issues and improve task design, rubrics, instructions, and review processes.
• Lead recovery plans for delivery, quality, cost, or timeline challenges.
• Coordinate distributed software engineers, reviewers, and team leads.
• Communicate project progress, risks, and corrective actions to customer research and program teams.
• Use Python, SQL, or similar tools for quality analysis, defect tracking, and operational reporting.
Requirements
• 10+ years of overall experience.
• Direct experience managing production software engineering data programs for frontier AI models.
• Experience with coding training, coding RLHF, SWE benchmarks, model evaluations, agentic coding, code generation, or code repair.
• Proven ownership of end-to-end program operations, including contributor calibration, quality, throughput, rework, cost management, and delivery recovery.
• Strong software engineering skills, including the ability to review code and tests and identify technically invalid work.
• Experience managing distributed engineering contributors, reviewers, and team leads.
• Ability to take over active programs, independently diagnose operational issues, and drive corrective actions.
• Availability for 8 hours per day, including at least 4 hours of PST overlap.