I’m Jill J. Dorje, an AI content trainer and evaluator with a strong focus on improving the quality and relevance of large language model outputs. I design rubrics, perform intent analysis, verify ground-truth data, and apply evidence-based methods to ensure accurate, contextually aligned responses across high-volume workflows. I excel at crafting clear prompts and structured feedback to boost precision, completeness, and tonal consistency. With a background spanning university communications and clinical trial operations, I collaborate across cross-functional teams to plan, write, and edit content for diverse audiences. I document failure modes (hallucinations, overconfidence, no-answers) and provide guidance to maintain reviewer consistency, while adapting to text, audio, and video formats in fast-paced environments.

Jill J. Dorje

I’m Jill J. Dorje, an AI content trainer and evaluator with a strong focus on improving the quality and relevance of large language model outputs. I design rubrics, perform intent analysis, verify ground-truth data, and apply evidence-based methods to ensure accurate, contextually aligned responses across high-volume workflows. I excel at crafting clear prompts and structured feedback to boost precision, completeness, and tonal consistency. With a background spanning university communications and clinical trial operations, I collaborate across cross-functional teams to plan, write, and edit content for diverse audiences. I document failure modes (hallucinations, overconfidence, no-answers) and provide guidance to maintain reviewer consistency, while adapting to text, audio, and video formats in fast-paced environments.

Available to hire

I’m Jill J. Dorje, an AI content trainer and evaluator with a strong focus on improving the quality and relevance of large language model outputs. I design rubrics, perform intent analysis, verify ground-truth data, and apply evidence-based methods to ensure accurate, contextually aligned responses across high-volume workflows. I excel at crafting clear prompts and structured feedback to boost precision, completeness, and tonal consistency.

With a background spanning university communications and clinical trial operations, I collaborate across cross-functional teams to plan, write, and edit content for diverse audiences. I document failure modes (hallucinations, overconfidence, no-answers) and provide guidance to maintain reviewer consistency, while adapting to text, audio, and video formats in fast-paced environments.

See more

Work Experience

AI Content Trainer & Evaluator at AI Content Training & Evaluation (Remote)
January 1, 2024 - Present
Rate relevance and quality of AI responses using rubrics and 1–5 scales; assess intent match, correctness, descriptiveness, tone, and context at high volume. Rewrite prompts and responses to improve accuracy and clarity; apply guidelines to maintain consistent quality. Perform query–document relevance assessment and intent classification to support retrieval and ranking quality. Conduct web research to establish ground truth and validate model responses; document sources and rationale. Document recurring failure modes (hallucination, overconfidence, no-answers) and provide examples/guidance to improve reviewer consistency. Support multiple projects across formats (text/audio/video), adapting quickly to changing instructions and QA standards.
Assistant Editorial Director at Tulane University Communications & Marketing
May 1, 2021 - November 1, 2022
Co-produced and edited a university-wide daily newsletter reaching the full campus community and external stakeholders; collaborated with leadership to manage editorial planning across 10+ schools and departments; wrote and edited diverse content for university-wide distribution.
Senior Department Administrator at The University of Washington
February 1, 2017 - May 1, 2021
Implemented a financial reporting system for a $5M+ budget, improving transparency and forecasting. Partnered with leadership to streamline administrative processes; managed HR functions and compliance.
Program Operations / Grants and Contracts Manager at University of Washington – Medicine, Cardiology Clinical Trials
August 1, 2013 - August 1, 2016
Managed a large research portfolio with proactive oversight to ensure compliance with federal requirements. Optimized financial tracking/reports across 30+ budgets; supported forecasting and resource planning.
Country Program Coordinator at University of Washington – Psychology & Social Health, Reconnecting Youth
July 1, 2011 - July 1, 2013
Coordinated multi-country initiatives and stakeholder collaboration; streamlined monitoring/data processes. Monitored IRB submissions, research proposals, and publications for compliance and timely processing.
Research Coordinator at University of Washington – Psychiatry & Behavioral Sciences, ADAPT Trial
June 1, 2009 - June 1, 2011
Improved human-subjects application tracking and processing; supported writing/editing for grants and manuscripts. Developed participant-facing study materials and updated the study website.
Research Study Coordinator at University of Washington – Psychiatry & Behavioral Sciences, ADAPT Trial
February 1, 2007 - May 1, 2009
Coordinated multi-site study logistics and documentation; administered/scored psychometric assessments. Supported human subjects applications and research reporting to ensure compliant, clear documentation.

Education

Master of Liberal Arts at Tulane University
January 11, 2030 - January 14, 2026
Graduate Work in Linguistics at Southern Illinois University at Carbondale
January 11, 2030 - January 14, 2026
Bachelor of Arts at Columbia College of Chicago
January 11, 2030 - January 14, 2026

Qualifications

Add your qualifications or awards here.

Industry Experience

Education, Healthcare, Professional Services