SH

Sara Hwanjiru

Available to hire

I’m an AI evaluation specialist with 4+ years of experience improving language and vision models through rigorous, feedback-driven assessment.

About

I’m an AI evaluation specialist with 4+ years of experience improving language and vision models through rigorous, feedback-driven assessment. I focus on evaluating response quality and safety (helpfulness, harmlessness, and honesty), identifying hallucinations, and ensuring outputs comply with policy and platform standards.

I also contribute to high-quality multimodal data work—annotating audio (transcription and speaker diarization), labeling image and video datasets, and supporting large-scale training with careful attention to detail. I enjoy structured reasoning, systematic evaluation, and providing actionable recommendations that help teams and models perform better over time.

  • 5 years' experience
  • Joined April 2026

Industry experience

  • Software & Internet
  • Computers & Electronics
  • Media & Entertainment

Work experience· 4 roles

AI Evaluation Specialist (Remote)Mar 2025 – Mar 2026 · 1 yr 1 mo

Contributed to image generation evaluations by reviewing how well generated images follow prompts, focusing on quality and safety. Performed audio transcription and ASR labeling to support large-scale training of speech recognition models. Carried out speaker diarization tasks by identifying and labeling multiple speakers in audio conversations for voice assistant use cases. Provided verbatim and ASR-corrected transcriptions for phone calls with over 98% accuracy, ensuring transcripts are reliable for downstream tasks.

AI Evaluation / Safety & Quality Rater (Remote)Jan 2022 – Mar 2024 · 2 yrs 3 mos

Rated AI model responses on helpfulness, harmlessness, and honesty (RLHF) across large-scale LLM training datasets. Caught and documented hallucinations in AI-generated text, pairing each failure with reference-backed corrections. Evaluated safety and policy adherence of model outputs, detecting unsafe, biased, or non-compliant responses according to platform policies. Assessed code generation responses across multiple programming languages for correctness, efficiency, and style. Conducted response ranking and Likert-scale evaluations to inform reinforcement learning and shape model preferences.

Multimodal Data Annotator (Remote)Jan 2021 – Mar 2022 · 1 yr 3 mos

Labeled video datasets for action recognition, segmentation, and labeling of human activities and interactions to support training of action detection models. Segmented long videos with scene and event labels for video surveillance and sports video analytics. Classified short-form text data (e.g., social media posts, reviews, and headlines) for sentiment and category. Annotated Named Entity Recognition (NER) and Part-of-Speech (POS) tasks on multilingual datasets to support training for search engines and conversational AI. Created image classification labels and generated tight bounding boxes to train computer vision models for retail and e-commerce applications.

Search Relevance & Content Moderation Evaluator (Remote) · TolokaJan 2020 – Jan 2021 · 1 yr 1 mo

Education

BSc. Computer Science · Kenyatta University2015 – 2019
Data Analyst Nanodegree · Udacity2022 – 2023

Certifications and awards

Data Analyst Nanodegree2022 – 2026

Hire Sara Hwanjiru today

Post a job and invite Sara, or contact them directly. No hidden commission.

Post a job