Jobs → Engineering → Python Developer

About the Role We are looking for an experienced Python Developer to join our team. This role focuses on designing and refining rubrics and evaluation criteria for preference data collection and labeling. Key Responsibilities • Design and refine rubrics and evaluation criteria for preference data collection and labeling • Develop and maintain Python pipelines, infrastructure, and data collection/evaluation workflows • Analyze results and communicate actionable insights through clear technical documentation • Collaborate with researchers and engineers to build scalable evaluation processes • Identify subtle quality issues and distinguish exceptional examples from average ones • Work effectively in fast-paced, ambiguous environments with a strong focus on quality and execution Requirements • 5+ years of hands-on experience with Python or TypeScript • Strong Python expertise in pipeline development and infrastructure, or TypeScript experience working with large codebases • Experience with preference data collection and/or rubric creation • Strong analytical skills and exceptional attention to detail • Excellent written and verbal communication skills • Ability to explain complex technical concepts clearly and make quality-driven decisions • Experience with large codebases, such as VS Code, is a plus for TypeScript candidates • An active LinkedIn profile is mandatory • Include your LinkedIn profile URL in your resume • Must be available for at least 20 hours per week and meet the required PST overlap