AI Fact-Checking & Response Evaluation Reviewer (Portuguese)

TrustScale · Remoto, BR

**AI Fact\-Checking \& Response Evaluation Reviewer (French)** **Mission of the Role** Apply independent judgment to identify AI blind spots, reasoning failures, factual inaccuracies, contradictory evidence, and quality gaps. Successful reviewers do not simply validate AI\-generated conclusions, they critically evaluate them. Your role is to verify evidence, challenge unsupported assumptions, and ensure AI systems learn from accurate, reliable, and well\-supported information. Your expertise will help build more reliable, trustworthy, and human\-centered AI systems. **About the Role** **At TrustScale, we believe AI improves when people are willing to question it.** As an AI Fact\-Checking \& Response Evaluation Reviewer, you will evaluate AI\-generated responses, verify evidence, challenge unsupported conclusions, and help define the standards that AI systems learn from. Good AI is built on good judgment. TrustScale is seeking experienced Spanish \-language professionals to evaluate AI\-generated responses, verify factual accuracy, assess supporting evidence, and help define the quality standards that AI systems learn from. As an AI Fact\-Checking \& Response Evaluation Reviewer, you will review AI\-generated content, determine whether conclusions are supported by evidence, identify reasoning gaps, challenge unsupported claims, and help improve the reliability of next\-generation AI systems. This is not a traditional annotation, translation, or data\-entry role. This role requires individuals who are comfortable questioning conclusions, investigating claims, and making evidence\-based decisions—even when those decisions differ from AI\-generated recommendations. The strongest reviewers are naturally curious, skeptical of unsupported claims, detail\-oriented, and confident applying their own judgment when evaluating information. This is a remote freelance opportunity with flexible hours and payment in USD. **Remote \| Freelance \| Flexible Schedule \| Paid in USD** We are seeking a small group of experienced reviewers to support upcoming AI quality initiatives. Applications are reviewed on a rolling basis. **What You'll Do** * Review and evaluate AI\-generated responses in Portuguese * Verify factual claims using reliable online sources and supporting evidence * Assess whether evidence supports, contradicts, or fails to support AI\-generated conclusions * Identify AI blind spots, reasoning failures, factual inaccuracies, and quality gaps * Evaluate response quality, relevance, completeness, and alignment with user intent * Detect inconsistencies, unsupported claims, contradictory information, and missing evidence * Apply independent judgment rather than relying solely on automated decisions * Challenge AI\-generated conclusions when evidence suggests a different outcome * Provide clear quality feedback and rationale for review decisions * Participate in training, calibration, and quality alignment sessions conducted in English * Maintain quality, consistency, commitment, and productivity expectations while meeting project requirements * Collaborate with project teams to continuously improve reviewer standards and AI quality outcomes **What Success Looks Like** Successful reviewers: * Verify information before accepting conclusions * Challenge AI\-generated decisions when evidence suggests otherwise * Distinguish between supported, unsupported, and contradictory claims * Remain objective when evaluating information * Demonstrate consistency across complex review tasks * Maintain strong productivity while preserving quality standards * Use evidence rather than assumptions to make decisions * Take ownership of quality outcomes * Demonstrate reliability and commitment throughout the project lifecycle **Required Qualifications** * Native or near\-native fluency in Portuguese * Strong English proficiency, including the ability to understand guidelines and participate in training sessions * Previous experience in Fact\-Checking, Quality Assurance, Content Review, Search Evaluation, Annotation Review, Trust \& Safety, Data Quality, Linguistic QA, Research Analysis, or similar analytical roles * Excellent critical\-thinking and analytical skills * Strong evidence\-based decision\-making abilities * Strong attention to detail and consistency * Ability to independently evaluate and challenge AI\-generated conclusions * Ability to distinguish between factual support, contradiction, and insufficient evidence * Ability to interpret complex queries and assess response quality accurately * Comfortable working with structured data and AI\-related projects * Comfortable working with ambiguity and incomplete information * Ability to pass a qualification assessment in English/Portuguese **Preferred Qualifications** * Experience reviewing AI training data or annotation projects * Experience with Response Evaluation, Search Quality Rating, RLHF, LLM evaluation, AI model assessment, or human\-in\-the\-loop review workflows * Exper