I'm an AI Evaluator and Data Annotation Specialist with 1+ years of hands-on experience in high-quality dataset creation, LLM evaluation, and AI output validation across NLP and multimodal workflows. I have strong expertise in prompt engineering (zero-shot, few-shot, CoT), RLHF evaluation, and hallucination detection, with a track record of improving model accuracy through structured feedback. I am proficient in Python, SQL, REST APIs, and building data pipelines, and I regularly work with OpenAI API, Hugging Face, LangChain, and SageMaker. I have hands-on experience with annotation platforms such as Label Studio, CVAT, Labelbox, Prodigy, Roboflow, AWS SageMaker, and Azure ML, and I thrive in Agile environments, managing annotation tasks at scale to deliver audit-ready datasets under tight deadlines.

Lokesh Umamaheswari Ethirajan

I'm an AI Evaluator and Data Annotation Specialist with 1+ years of hands-on experience in high-quality dataset creation, LLM evaluation, and AI output validation across NLP and multimodal workflows. I have strong expertise in prompt engineering (zero-shot, few-shot, CoT), RLHF evaluation, and hallucination detection, with a track record of improving model accuracy through structured feedback. I am proficient in Python, SQL, REST APIs, and building data pipelines, and I regularly work with OpenAI API, Hugging Face, LangChain, and SageMaker. I have hands-on experience with annotation platforms such as Label Studio, CVAT, Labelbox, Prodigy, Roboflow, AWS SageMaker, and Azure ML, and I thrive in Agile environments, managing annotation tasks at scale to deliver audit-ready datasets under tight deadlines.

Available to hire

I’m an AI Evaluator and Data Annotation Specialist with 1+ years of hands-on experience in high-quality dataset creation, LLM evaluation, and AI output validation across NLP and multimodal workflows. I have strong expertise in prompt engineering (zero-shot, few-shot, CoT), RLHF evaluation, and hallucination detection, with a track record of improving model accuracy through structured feedback.

I am proficient in Python, SQL, REST APIs, and building data pipelines, and I regularly work with OpenAI API, Hugging Face, LangChain, and SageMaker. I have hands-on experience with annotation platforms such as Label Studio, CVAT, Labelbox, Prodigy, Roboflow, AWS SageMaker, and Azure ML, and I thrive in Agile environments, managing annotation tasks at scale to deliver audit-ready datasets under tight deadlines.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
See more

Language

English
Advanced

Work Experience

AI Prompt Engineer & LLM Quality Specialist at Madhuram Consulting LLC
January 1, 2025 - Present
Role focused on leading healthcare claims data annotation, multimodal video annotation, and NLP/LLM pipeline QA. Key projects included Healthcare Claims Data Annotation (CMS-1500, UB-04) with 10,000+ claims and extraction of ICD-10, CPT/HCPCS, and NDC codes; Ice Hockey Video Annotation using CVAT, Labelbox, Roboflow with bounding boxes, keypoints, and temporal tracking; AI Text Pre-Annotation Platform (full-stack) for NER, sentiment, and text classification; and a theoretical Multimodal QA/RLHF feedback system. Implemented prompt-driven workflows (zero-shot, few-shot, CoT) via OpenAI API and LangChain; developed Python/SQL QA pipelines with RLHF to reduce hallucinations and cross-field errors by 28%; delivered audit-ready datasets via SageMaker/Azure ML.

Education

M.S. in Data Science at University of New Haven
January 1, 2024 - December 1, 2025
B.E. in Electrical & Electronics Engineering at Anna University
August 1, 2019 - July 1, 2023
Master of Science in Data Science at University of New Haven
January 1, 2024 - December 31, 2025
Bachelor of Engineering in Electrical & Electronics Engineering at Anna University
August 1, 2019 - July 31, 2023

Qualifications

Add your qualifications or awards here.

Industry Experience

Software & Internet, Healthcare, Education, Professional Services