I’m Carles Rodríguez, a Senior Quality Engineer focused on AI systems—especially LLM evaluation and quality assurance for chat, search, and RAG workflows. I’ve built and applied reliable LLM-as-a-Judge evaluation frameworks, including gold standards, rubrics, and scoring criteria designed for repeatability and consistent decision-making across distributed teams. I’ve worked on hallucination detection, retrieval grounding validation, instruction-following checks, and multilingual quality review (Spanish/Catalan/English). I enjoy turning evaluation findings into actionable improvements—through calibration, inter-rater consistency work, structured QA procedures, and detailed failure-mode analysis—while supporting AI alignment and safety quality in real-world production pipelines.…

Carles Rodríguez

I’m Carles Rodríguez, a Senior Quality Engineer focused on AI systems—especially LLM evaluation and quality assurance for chat, search, and RAG workflows. I’ve built and applied reliable LLM-as-a-Judge evaluation frameworks, including gold standards, rubrics, and scoring criteria designed for repeatability and consistent decision-making across distributed teams. I’ve worked on hallucination detection, retrieval grounding validation, instruction-following checks, and multilingual quality review (Spanish/Catalan/English). I enjoy turning evaluation findings into actionable improvements—through calibration, inter-rater consistency work, structured QA procedures, and detailed failure-mode analysis—while supporting AI alignment and safety quality in real-world production pipelines.…

Available to hire

I’m Carles Rodríguez, a Senior Quality Engineer focused on AI systems—especially LLM evaluation and quality assurance for chat, search, and RAG workflows. I’ve built and applied reliable LLM-as-a-Judge evaluation frameworks, including gold standards, rubrics, and scoring criteria designed for repeatability and consistent decision-making across distributed teams.

I’ve worked on hallucination detection, retrieval grounding validation, instruction-following checks, and multilingual quality review (Spanish/Catalan/English). I enjoy turning evaluation findings into actionable improvements—through calibration, inter-rater consistency work, structured QA procedures, and detailed failure-mode analysis—while supporting AI alignment and safety quality in real-world production pipelines.

See more

Language

Spanish; Castilian
Fluent
Catalan; Valencian
Fluent
English
Advanced

Work Experience

AI Evaluation Specialist / Research Analyst at Barcelona Supercomputing Center (BSC)
April 1, 2025 - December 1, 2025
Designed and reviewed structured evaluation scenarios to assess LLM reasoning, instruction-following, and factual accuracy. Defined expected agent behaviors (gold standards) and scoring criteria to evaluate decision paths and task execution. Identified failure modes, inconsistencies, and implicit assumptions; translated findings into clear, actionable feedback for multidisciplinary teams to improve model behavior and evaluation design.
AI Language & Model Evaluation Specialist (Remote) at Outlier / Thoth AI / Data Force
June 1, 2024 - February 28, 2025
Evaluated AI-generated outputs in Spanish and English for logical coherence, semantic accuracy, and instruction adherence. Conducted scenario validation and edge-case analysis for LLM tasks. Applied quality guidelines, checklists, and scoring frameworks to ensure evaluation quality and reproducibility across large-scale evaluation workflows. Contributed qualitative feedback to refine evaluation logic and task design.
AI Language & Model Evaluation Specialist at Outlier · Thoth AI · DataForce
January 1, 2024 - December 31, 2025
Evaluated AI-generated outputs in Spanish and English for logical coherence, semantic accuracy, instruction-following, and factual grounding at scale. Participated in calibration sessions to align evaluation criteria across distributed evaluator teams and improve inter-rater consistency. Performed scenario validation and edge-case analysis, applying quality checklists and structured scoring guidance. Provided structured qualitative feedback used to refine prompt logic, task design, and evaluation rubrics for project and research teams.
Content Quality & Policy Specialist at TELUS International / Majorel
January 1, 2019 - December 31, 2023
Performed high-precision quality reviews of complex content under strict editorial and policy frameworks, with an emphasis on ambiguity handling and risk assessment. Participated in calibration, consistency audits, and process improvement initiatives while maintaining a 99% audit return rate. Trained and supported team members in quality decision-making frameworks, adapting guidance to evolving policy requirements.
Quality & Policy Specialist at TELUS International
January 1, 2019 - December 31, 2023
Performed quality reviews and auditing of complex content under strict policy and decision frameworks. Participated in calibration, consistency checks, and process-improvement initiatives. Maintained high accuracy in decision-making environments involving ambiguity and risk assessment.

Education

Bachelor of Sociology at Universidad de Oriente
September 1, 2004 - June 15, 2009
Postgraduate studies in Social Communication, Advertising and NewMedia at Universidad de Oriente
September 1, 2009 - June 20, 2010
Procesamiento de Lenguaje Natural con Python: fundamentos, bibliotecas y aplicaciones at Universidad de la Rioja
September 21, 2025 - September 28, 2025
Recovery Augmented Generation (RAG): theory and applications at Universidad de la Rioja
June 8, 2025 - June 15, 2025
Licenciatura (Sociology) at Universidad de Oriente
January 1, 2004 - January 1, 2009
NLP with Python (coursework/training) at Universidad de La Rioja
January 1, 2025 - January 1, 2025
RAG Theory & Applications (coursework/training) at Universidad de La Rioja
January 1, 2025 - January 1, 2025
AWS: Introduction to Responsible AI (training) at Amazon Web Services (AWS)
January 1, 2025 - January 1, 2025

Qualifications

Generative AI Foundations (training)
January 1, 2025 - January 1, 2025
AWS: Introduction to Responsible AI (training)
January 1, 2025 - September 23, 2026
Generative AI Foundations (training)
January 1, 2025 - September 23, 2026

Industry Experience

Software & Internet, Professional Services, Media & Entertainment, Education, Computers & Electronics
    LLM Evaluation, Alignment and Language Analysis Portfolio

    This repository documents my practical experience in the evaluation, alignment, and qualitative analysis of large language models (LLMs) and speech systems.

    The work presented here focuses on applied evaluation rather than model training, covering tasks related to alignment, reasoning quality, linguistic robustness, and real-world language behavior.

    All materials are synthetic and designed exclusively for professional portfolio purposes.

    https://www.twine.net/signin