Overview

Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for Portuguese-speaking experts to join our team.

What you will do:

Identify realistic search-related failures where an AI model provides inadequate responses. Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers.

Common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability. Testing multiple queries before finding failures is expected.

Project Details:

• Start Date: ASAP
• Duration: Ongoing Project.
• Commitment: 20 hours per week.
• Job Type: Freelance contract.
• Location: Remote
• Rate: $20 per hour.

Requirements: