Loading...
Mid LevelFull-timeJavaScriptPythonJavaAI
Salary Range
$80,750 - $109,250 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are seeking a detail-oriented Freelance Coding QA Analyst to manage the process of testing and onboarding new and existing partners via coding pilots as well as managing the quality of developer outputs and adherence to project standards in technical data annotation projects.
Key Responsibilities
- →Coordinate quality standards, guideline updates, and feedback loops across QAs, experts, and vendors to ensure consistent interpretation and execution.
- →Coordinate coding pilot projects for new potential partners.
- →Design unique pilot pipelines to test potential partners.
- →Assign coding tasks ensuring alignment with agreed languages (primarily Python, Java, or JavaScript).
- →Create and manage collaboration platform spaces for partners during pilots and handle task-related queries.
- →Ensure task designs allow for comparison of model-generated answers and prompt engineering assessment (when needed).
- →Prepare reports and recommendations to inform vendor and partnership decisions.
- →Serve as the primary point of contact for partner and expert queries during pilot and production phases.
Requirements
- ✓Experience in Software Quality Assurance or technical vendor assessments.
- ✓Experience working with developer or documentation teams, high-volume review queues, and structured quality monitoring systems.
- ✓Ability to deliver precise, objective feedback on code quality and logic to help developers align with project requirements.
- ✓Strong understanding of coding languages (Python, Java, JS) and familiarity with additional or less common programming languages.
- ✓Ability to create and manage structured testing projects and pipelines.
- ✓Excellent communication skills for vendor interaction and cross-functional coordination.
- ✓Comfortable using collaboration platforms and organizing technical documentation.
- ✓Analytical mindset for assessing developer outputs and making recommendations.
