Shravya Nalivela

Evaluate complex AI model outputs, search queries, and prompt-response workflows against stringent safety and engineering guidelines. Measure precision, toxicity, hallucination, and policy compliance while managing high-volume queues under strict SLAs. Conduct root-cause analysis on ambiguous edge cases and maintain auditable decision documentation. Identify recurring evaluation trends and policy gaps, and contribute recommendations to improve guidelines and review consistency. Support onboarding and peer guidance for remote evaluators to align on evaluation rubrics.

Audited high-volume Facebook Marketplace listings and job postings daily, enforcing Meta policies and maintaining 95%+ quality accuracy. Served as a primary escalation point for high-risk, fraud, and policy-violating content, coordinating with stakeholders for swift remediation. Conducted calibration and peer quality reviews to coach nuanced policy interpretation and minimize decision variance. Tracked productivity and accuracy metrics to streamline queue handling and improve operational processes.

Led pre-publication content review and enforcement workflows using proprietary moderation platforms to prevent policy violations from going live. Collaborated with Quality, Legal, and Policy teams to refine enforcement guidelines and standardize decision frameworks. Created documentation for edge cases and decision rationales to support audit readiness and continuous team learning. Recognized repeatedly for top performance, including accuracy and SLA adherence.