Image Evaluator Expert

Remote · Part-time · All Levels Level

🌍 Remote Part-time All Levels Quality Assurance
About This Role
1\. Role Overview

Mercor is collaborating with a leading AI lab to identify detail-oriented image evaluation specialists for a project focused on assessing AI-powered image editing systems. In this project, you will evaluate how accurately and effectively AI models modify images based on user instructions. Your work will directly contribute to improving the quality, safety, and reliability of frontier multimodal models. This is a project-based opportunity suited for professionals with strong visual judgment and structured evaluation skills.

2\. Key Responsibilities

  • Review original images, user edit instructions, and AI-generated edited images
  • Conduct a pre-evaluation feasibility check to confirm the instruction is valid and achievable
  • Flag unsafe, harmful, or policy-violating content in edited outputs
  • Assess instruction adherence, structural integrity, and preservation of unedited areas
  • Evaluate visual quality, style alignment, and character consistency
  • Provide structured ratings across defined grading dimensions
  • Deliver clear, consistent evaluations following detailed rubric guidelines

3\. Ideal Qualifications

  • Experience in image review, visual quality assurance, content moderation, or related fields
  • Strong attention to detail and ability to identify subtle visual inconsistencies
  • Familiarity with image editing concepts, digital art, or generative AI systems
  • Ability to apply structured evaluation rubrics consistently and objectively
  • Clear written communication skills for documenting assessments
  • Comfort reviewing a wide range of visual content, including _potentially sensitive material_

*

4\. Application Process

  • Submit your resume or professional background to express interest
  • Complete a short screening assessment to demonstrate evaluation skills
  • Selected candidates will receive detailed project guidelines and next steps
  • Communication regarding status and next steps typically occurs within a few business days

Interview Prep Guide

EXCLUSIVE

Many top hiring platforms use AI-powered screening as the first step. Here's how to stand out when applying for a Image Evaluator Expert role:

Critical Thinking: Demonstrate your ability to assess content for factual accuracy, logical consistency, and source credibility. Show a systematic evaluation framework.

Attention to Detail: Be prepared with examples of catching subtle errors or inconsistencies that others might miss. Precision is the core skill being evaluated.

Calibration: Discuss how you maintain consistent evaluation standards across many items. Self-awareness about your own biases is a strong signal.

Practice Behavioral Question

"Tell me about a piece of work you're most proud of. What made it challenging, and what did you learn from the experience?"