Python / TypeScript Software Engineer
Atul DandageUnited StatesSENIORPosted 13d ago
PythonTypeScriptPipelinesInfrastructureData CollectionEvaluation WorkflowsPreference DataRubric DevelopmentTechnical Documentation
About the Role
We are looking for an experienced Software Engineer to join our team, focusing on building scalable systems and improving evaluation criteria for preference data.
Key Responsibilities
• Design, refine, and improve rubrics and evaluation criteria for preference data
• Review and label data while maintaining high standards for quality and accuracy
• Build and maintain Python pipelines, infrastructure, and data collection/evaluation workflows
• Analyze findings and communicate actionable insights through clear, concise technical documentation
• Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes
• Identify subtle quality issues and distinguish exceptional examples from average ones
• Work effectively in fast-paced, ambiguous environments with a strong focus on execution
Requirements
• 5+ years of hands-on experience with Python or TypeScript
• Strong Python experience building and maintaining pipelines and infrastructure, or TypeScript experience navigating large codebases
• Hands-on experience with preference data collection and/or rubric creation
• Strong analytical skills and exceptional attention to detail
• Excellent written and verbal communication skills
• Ability to explain complex technical concepts clearly and make quality-driven decisions
• Experience with large codebases such as VS Code is a plus for TypeScript candidates
Important Requirements
• Candidates with experience at Tier 1 product companies and/or strong academic backgrounds from Tier 1 universities are preferred
• A LinkedIn profile is mandatory and must be included in the resume
• Candidates must not currently be employed by Microsoft
• Must be available for at least 20 hours per week with the required PST overlap