Brandy Mathis
I’m Brandy Mathis, an AI training and model evaluation specialist with deep hands-on experience since 2018.
About
I’m Brandy Mathis, an AI training and model evaluation specialist with deep hands-on experience since 2018. I build and assess training data for large language models and search systems by authoring evaluation tasks, golden responses, and grading guidance grounded in real-world workflows—especially in healthcare administration, where accuracy and documentation matter.
I’ve supported both pre-release and ongoing model improvement by rating and comparing outputs for instruction-following, safety, and factuality, including red-teaming with adversarial prompts to surface failures. Alongside my AI work, I bring 5+ years of healthcare administration and operations experience, which helps me verify details, catch hallucinations, and keep deliverables aligned with strict guidelines and rubrics.
- 8 years' experience
- Joined November 2026
Skills· 32
- Microsoft Office
Google Drive- Object Detection
- AI Data Labelling
- Stripe
Canva- Business Card
- Social Media Design
- Leadership
- Voiceover
- Mobirise
Weebly- Letterhead
- Prompt Engineering
- Flyer
- Explainer Video
- Carrd
- Presentation Design
- Brochure
Facebook Ads- T-shirt Design
- Monday
- Signage
- Infographic
- Bubble
- Book Cover
- Claude
- Postcard
- ElevenLabs
- LQA testing
- Data Science
Industry experience
- Healthcare
- Professional Services
- Software & Internet
- Education
- Non-Profit Organization
Work experience· 5 roles
Author evaluation tasks for a frontier AI lab, including world files, scenarios, golden responses, and grading guidance based on real healthcare administration workflows. Create grader feedback, failure analyses, and RLHF preference labels comparing model responses against detailed rubrics. Review automated QA/linter flags and dispute incorrect results with documented reasoning. Produce all deliverables independently under strict no-AI-assistance project rules.
Manage a caseload of 65–75 patients and process 40–50 visit notes per week. Maintain accurate, audit-ready EMR documentation and track authorizations. Resolve claim discrepancies in coordination with billing teams.
Support executives across multiple industries by managing calendars and producing business documents. Build SOPs and onboarding processes for client teams.
Education
Certifications and awards· 7
Hire Brandy Mathis today
Post a job and invite Brandy, or contact them directly. No hidden commission.