I'm an AI Engineer with a passion for building intelligent systems that can change the way we interact with technology. With experience in LLM evaluation and prompt engineering, I love pushing the boundaries of what's possible in AI. I thrive in collaborative environments and enjoy tackling complex challenges through innovative solutions.

Pavan Sai Merugumala

I'm an AI Engineer with a passion for building intelligent systems that can change the way we interact with technology. With experience in LLM evaluation and prompt engineering, I love pushing the boundaries of what's possible in AI. I thrive in collaborative environments and enjoy tackling complex challenges through innovative solutions.

Available to hire

I’m an AI Engineer with a passion for building intelligent systems that can change the way we interact with technology. With experience in LLM evaluation and prompt engineering, I love pushing the boundaries of what’s possible in AI. I thrive in collaborative environments and enjoy tackling complex challenges through innovative solutions.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
Intermediate
See more

Language

Telugu
Fluent
English
Fluent
Hindi
Fluent

Work Experience

Associate Analyst – Google Client at Vaco Binary Semantics LLP
December 1, 2024 - Present
Prepared audit reports and quality statistics for human raters on AI evaluation tasks. Automated data handling in Google Sheets using Google Apps Script to improve process efficiency. Contributed to developing an AI model analyzing image-topic relevance based on scraped web data. Evaluated AI responses using Reinforcement Learning with Human Feedback (RLHF) under a Human-in-the-Loop (HITL) framework.
Freelance AI Trainer – Coding Expert at Outlier AI
June 30, 2025 - July 28, 2025
Debugged and assessed LLM-generated code responses for DSA and full-stack problems (HTML, CSS, JS). Tested responses in IDEs like VS Code to identify bugs and ensure instruction-following. Designed and evaluated prompts using prompt engineering techniques to optimize LLM outputs. Created adversarial prompts to test model failure cases and evaluate factuality of generated content.
Freelance AI Trainer – Bilingual (Telugu) at Appen
June 1, 2025 - Present
Reviewed and rated AI-generated Telugu responses for linguistic accuracy, fluency, and prompt alignment. Evaluated translations based on grammar, completeness, cultural sensitivity, and context.
Associate Analyst at Vaco Binary Semantics LLP
December 1, 2024 - Present
Prepare audit reports and quality statistics for human raters on AI evaluation tasks. Automate data handling in Google Sheets using Google Apps Script, improving process efficiency. Contribute to the development of an AI model that analyzes image-topic relevance based on scraped web data. Evaluate AI responses using Reinforcement Learning with Human Feedback (RLHF) under a Human-in-the-Loop (HITL) framework.
Freelance AI Trainer at Outlier AI
June 1, 2025 - September 8, 2025
Debug and assess LLM-generated code responses for DSA and full-stack problems (HTML, CSS, JS). Test responses in IDEs like VS Code to identify bugs and ensure instruction-following. Design and evaluate prompts using prompt engineering techniques to optimize LLM outputs. Create adversarial prompts to test model failure cases and evaluate factuality of generated content.
Freelance AI Trainer at Appen
June 1, 2025 - Present
Review and rate AI-generated Telugu responses for linguistic accuracy, fluency, and prompt alignment. Evaluate translations based on grammar, completeness, cultural sensitivity, and context.
Associate Analyst – Google Client at Vaco Binary Semantics LLP
December 1, 2024 - Present
Prepare audit reports and quality statistics for human raters on AI evaluation tasks. Automate data handling in Google Sheets using Google Apps Script, improving process efficiency. Contribute to the development of an AI model that analyzes image-topic relevance based on scraped web data. Evaluate AI responses using Reinforcement Learning with Human Feedback (RLHF) under a Human-in-the-Loop (HITL) framework.
Freelance AI Trainer – Coding Expert at Outlier AI
June 1, 2025 - September 8, 2025
Debug and assess LLM-generated code responses for DSA and full-stack problems (HTML, CSS, JS). Test responses in IDEs like VS Code to identify bugs and ensure instruction-following. Design and evaluate prompts using prompt engineering techniques to optimize LLM outputs. Create adversarial prompts to test model failure cases and evaluate factuality of generated content.
Freelance AI Trainer – Bilingual (Telugu) at Appen
June 1, 2025 - Present
Review and rate AI-generated Telugu responses for linguistic accuracy, fluency, and prompt alignment. Evaluate translations based on grammar, completeness, cultural sensitivity, and context.
Associate Analyst at Vaco Binary Semantics LLP
December 1, 2024 - Present
Prepare audit reports and quality statistics for human raters on AI evaluation tasks. Automate data handling in Google Sheets using Google Apps Script, improving process efficiency. Contribute to the development of an AI model that analyzes image-topic relevance based on scraped web data. Evaluate AI responses using Reinforcement Learning with Human Feedback (RLHF) under a HITL framework.
Freelance AI Trainer at Coding Expert
June 1, 2025 - September 8, 2025
Debug and assess LLM-generated code responses for DSA and full-stack problems (HTML, CSS, JS). Test responses in IDEs like VS Code to identify bugs and ensure instruction-following. Design and evaluate prompts using prompt engineering techniques to optimize LLM outputs. Create adversarial prompts to test model failure cases and evaluate factuality of generated content.
Freelance AI Trainer at Appen
June 1, 2025 - Present
Review and rate AI-generated Telugu responses for linguistic accuracy, fluency, and prompt alignment. Evaluate translations based on grammar, completeness, cultural sensitivity, and context.
Associate Analyst at Vaco Binary Semantics
December 1, 2024 - Present
Audited AI evaluation tasks; produced quality reports and performance metrics. Automated reporting workflows with Google Apps Script, improving efficiency. Evaluated AI responses within an RLHF Human-in-the-Loop (HITL) framework.
Freelance AI Trainer — Coding Expert at Outlier AI
September 1, 2024 - June 1, 2025
Debugged and validated LLM outputs for DSA and full-stack tasks (HTML, CSS, JS). Applied advanced prompt engineering to craft adversarial tests and optimize outputs. Ensured instruction-following and factuality via IDE-based execution and verification.
Master STEM Specialist — AI Trainer at Invisible Technologies
June 1, 2025 - Present
Trained/evaluated LLMs on multilingual and complex reasoning tasks with clear rubrics. Authored structured guidelines and prompts to improve consistency and accuracy. Performed quality assessments for correctness, completeness, and contextual alignment.

Education

B.Tech at Vishnu Institute of Technology, Andhra Pradesh
January 1, 2020 - December 31, 2024
Class 12 (MPC) at NRI Junior College, Andhra Pradesh
January 1, 2018 - December 31, 2020
B.Tech in Computer Science and Engineering at Vishnu Institute of Technology, Andhra Pradesh
January 1, 2020 - January 1, 2024
Class 12 (MPC) at NRI Junior College, Andhra Pradesh
January 1, 2018 - January 1, 2020
B.Tech in Computer Science and Engineering at Vishnu Institute of Technology
January 1, 2020 - January 1, 2024
Class 12 (MPC) at NRI Junior College
January 1, 2018 - January 1, 2020
B.Tech in Computer Science and Engineering at Vishnu Institute of Technology, Andhra Pradesh
January 1, 2020 - January 1, 2024
Class 12 (MPC) at NRI Junior College, Andhra Pradesh
January 1, 2018 - January 1, 2020
B.Tech in Computer Science and Engineering at Vishnu Institute of Technology
January 1, 2020 - January 1, 2024
Class 12 (MPC) at NRI Junior College
January 1, 2018 - January 1, 2020

Qualifications

Data Science Professional
January 1, 2023 - December 31, 2023
Python for Data Analysis
January 1, 2023 - December 31, 2023
SQL for Data Science
January 1, 2023 - December 31, 2023
Web Development
January 1, 2023 - December 31, 2023
Data Science Professional
January 11, 2030 - September 8, 2025
Python for Data Analysis
January 11, 2030 - September 8, 2025
SQL for Data Science
January 11, 2030 - September 8, 2025
Data Science Professional
January 11, 2030 - September 8, 2025
Python for Data Analysis
January 11, 2030 - September 8, 2025
SQL for Data Science
January 11, 2030 - September 8, 2025
Web Development
January 11, 2030 - September 8, 2025
Data Science Professional
January 11, 2030 - September 8, 2025
Python for Data Analysis
January 11, 2030 - September 8, 2025
SQL for Data Science
January 11, 2030 - September 8, 2025
Web Development
January 11, 2030 - September 8, 2025
Data Science Professional
January 11, 2030 - April 27, 2026
Python for Data Analysis
January 11, 2030 - April 27, 2026

Industry Experience

Software & Internet, Professional Services, Education, Media & Entertainment, Computers & Electronics