Freelance and remote AI evaluators jobs

We are seeking a US-based, fully licensed dermatologist to evaluate AI-generated clinical content and dermatology images for accuracy, safety, relevance, and diagnostic usability. You will review dermatology-related diagnoses, treatment plans, summaries, and images through a structured online tool, identifying issues such as image quality, lighting, exposure, colour, framing, and potential skin conditions where applicable. The role requires an MD or MBBS with dermatology specialization, at least five years of post-residency clinical experience, and an active licence to practise medicine in the United States. You should be comfortable reviewing sensitive medical images, using web-based annotation tools, and providing clear, evidence-based feedback. Experience with medical content review, clinical research, annotation, or AI/ML evaluation is preferred. Read more

We are seeking an AI Quality Analyst to evaluate a new Gemini personalization feature. You will create prompts based on your personal experiences and assess how effectively the model uses information from past Gemini conversations, Gmail, Google Search, and YouTube activity to produce relevant and helpful responses. You will review side-by-side model outputs and evaluate grounding, integration, helpfulness, naturalness, and personalization quality. The role requires strong written English, analytical judgement, attention to detail, and the ability to write clear rationales and annotations. You should be comfortable identifying incorrect or forced personalization, poor inferences, and subtle differences between responses. Applicants must be willing to use their primary personal Google account, enable relevant data sources for authentic testing, and work independently with a desktop or laptop and reliable internet connection. Read more

Micro Workers is seeking a remote AI Quality Analyst (English) to evaluate, test, and refine text, video, and audio data outputs used to train AI models. You will review annotations, dialogue outputs, contextual labels, and domain-specific language content to ensure accuracy, natural language fluency, and compliance with project guidelines. This is a three-month contractor engagement requiring at least four hours per day, up to 40 hours per week, with four hours of overlap with PST. Read more