Headline

Functional Analyst | AI/ML Evaluation & Data Operations | NLP Benchmarking | SQL | LLM Evaluation | Annotation QA

About

Functional Analyst with experience in AI/ML evaluation workflows, NLP benchmarking, annotation QA, and data operations across finance and healthcare-focused datasets. Currently involved in benchmark-based LLM validation workflows including prompt/output assessment, relevance adjudication, dataset auditing, and quality analysis using structured evaluation methodologies. Experienced in evaluating model outputs against gold-standard reference answers, identifying retrieval and generation gaps, and supporting iterative model improvement cycles. Skilled in SQL, Python, Excel, Power BI, Linux-based evaluation operations, benchmarking automation, and reporting workflows. Contributed to HELM benchmark ranking improvements through evaluation support, relevance validation, and dataset optimization initiatives.

Location

Pune District

Work experience

Business Analyst at Gyan, Dec 2022 - Present · 3 yrs 6 mos, Pune District, • Executing benchmark-based AI/ML and LLM validation workflows across finance and healthcare-focused datasets. • Evaluating model outputs against gold-standard reference answers using structured comparison workflows and QA methodologies. • Performing relevance adjudication and classification of generated outputs to identify retrieval gaps, incomplete responses, and irrelevant generations. • Supporting iterative model improvement cycles through validation, quality analysis, and evaluation reporting. • Benchmarking NLP/search systems using structured evaluation methodologies and relevance analysis workflows. • Working with SQL, Python, Power BI, Linux-based evaluation pipelines, and benchmarking dashboards for reporting and quality analysis.

Document Processor at ICE, Oct 2020 - Jun 2022 · 1 yr 9 mos, Pune District, • Processed and validated approximately 20,000 structured document fields daily across mortgage and loan-processing workflows while maintaining high QA accuracy and compliance standards. • Performed high-volume extraction, classification, mapping, and validation of structured information from mortgage-related documents. • Conducted quality assurance checks and discrepancy validation to ensure data accuracy, completeness, and workflow consistency. • Supported structured data annotation and validation workflows by reviewing extracted information and correcting inconsistencies. • Assisted with data cleaning, formatting, and large-scale document processing operations within fast-paced production environments.

Education

Bachelor of Engineering - BE, Computer Engineering, Sinhgad Institute of Technology & Science

Google data analytics certification 2022, Data analytics, Google