Audio Annotator | $40/hr Remote

Crossing Hurdles is a recruitment firm. We refer top candidates to our partners working with the world’s leading AI research labs to help build and train cutting-edge AI systems.

Position: Audio Evaluator Expert

Type: Hourly Contract (Remote)

Compensation: $35 – $40/hour

Location: Remote

Duration: Flexible (10–40 hrs/week, 1-2 months, extension feasible)

Requirements

• Strong writing and critical thinking skills.
• Familiarity with Chat-GPT or similar tools for personal decision-making or hobbies / general interests
• Strong attention to detail and ability to follow precise guidelines
• Breaking down complex concepts into well-crafted text
• Prior teaching or research experience is an advantage, though not mandatory

Role(Training support will be provided)

• Design and Optimize Prompts – Create detailed audio prompts with multiple constraints and instructions.
• Define and Document Evaluation Standards – Establish high-level expectations for correct responses in general audio consumer contexts, and develop comprehensive rubric.
• Conduct Model Testing and Grading – Run prompts through models and assess preliminary outputs against expectations.
• Support Benchmarking and Quality Assurance – Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

Application Process

• Upload resume
• Participate in AI interview (10 min)
• Written task may be allocated
• Submit form