AI Evaluations Program Manager at Sofi

Employee Applicant Privacy Notice Who we are: Shape a brighter financial future with us. Together with our members, we’re changing the way people think about and interact with personal finance. We’re a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an unprecedented transformation, and we’re at the forefront. We’re proud to come to work every day knowing that what we do has a direct impact on people’s lives, with our core values guiding us every step of the way. Join us to invest in yourself, your career, and the financial world. The role: We are seeking an AI Evaluations Program Manager to own the end-to-end process for evaluating AI chat outputs in a financial services context. This role is critical to ensuring our AI delivers guidance and education that is accurate, compliant, consistent, and genuinely helpful to members who want to Get Their Money Right. You’ll be responsible for managing the daily evaluation workflows for AI-generated chat responses, with particular attention to financial accuracy, regulatory risk, and user helpfulness. You’ll also own the continuous improvement loop, translating evaluation insights into measurable improvements through partnership with our Legal, Compliance, Engineering, Product, and Design (EPD) teams. As the program manager, you’ll sit at the intersection of product, AI, operations, risk, and financial expertise, helping us achieve our mission to empower members to reach financial independence. What you’ll do: • Own the AI Evaluation Program on SoFi’s AI powered financial coach, designing processes related to daily workflows, schedules for grading and reporting. • Work alongside our technology team to integrate feedback and test improvements of AI guardrails and overall knowledge base. • Establish and lead the continuous improvement loop to ensure all stakeholders are informed of performance, improvements, trends, issues and other metrics. • Partner with Product, Legal & Compliance to maintain the AI knowledge base as well as any data retention and documentation processes. What you’ll need: • 8+ years of professional experience working in program management, operations, quality, risk, or evaluation roles within a financial services organization. • Familiarity with AI/LLM technologies and their application in providing personalized guidance. • Experience building and managing structured processes in complex or regulated environments. • Excellent analytical skills and comfort working with both qualitative and quantitative data. • Strong Stakeholder Management skills, with the ability to drive alignment across technical, financial, and regulatory partners. • Familiarly with financial products such as investments, retirement accounts, loans and banking. Nice to have: • Credentials: CFP® or other professional financial designation is a ✓++ • Licenses: FINRA Series 65 or interest in obtaining • Prior experience in financial technology (fintech), Financial Advisory or Wealth Management. • Experience directly working with technical teams Compensation and Benefits The base pay range for this role is listed below. Final base pay offer will be determined based on individual factors such as the candidate’s experience, skills, and location. To view all of our comprehensive and competitive benefits, visit our Benefits at SoFi page! SoFi provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion (including religious dress and grooming practices), sex (including pregnancy, childbirth and related medical conditions, breastfeeding, and conditions related to breastfeeding), gender, gender identity, gender expression, national origin, ancestry, age (40 or over), physical or medical disability, medical condition, marital status, registered domestic partner status, sexual orientation, genetic information, military and/or veteran status, or any other basis prohibited by applicable state or federal law. The Company hires the best qualified candidate for the job, without regard to protected characteristics. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. New York applicants: Notice of Employee Rights SoFi is committed to an inclusive culture. As part of this commitment, SoFi offers reasonable accommodations to candidates with physical or mental disabilities. If you need accommodations to participate in the job application or interview process, please let your recruiter know or email [Upgrade to PRO to see contact]. Due to insurance coverage issues, we are unable to accommodate remote work from Hawaii or Alaska at this time. Internal Employees If you are a current employee, do not apply here - please navigate to our Internal Job Board in Greenhouse to apply to our open roles.