Headline

MTS, Applied NLP Engineer @ Zoho | AI, NLP, LLM’s

About

Applied NLP Engineer with hands on experience building large-scale domain specific distributed ETL pipelines for data curation and Large Language Model alignment. My expertise spans across Data Engineering, LLM training, and AI safety.

Location

Chennai

AI stack

antigravity

hugging face

langchain

langgraph

vLLM

Weights & Biases Weave

Work experience

Member of Technical Staff [Applied NLP] at Zoho, Jul 2023 - Present · 3 yrs 2 mos, Chennai, Tamil Nadu, India, Implementing scalable, multi-node data processing pipelines leveraging Slurm for managing large-scale pretraining datasets. This included extensive work on collecting, cleaning, and applying advanced heuristic filters and research-backed data filtering techniques to ensure high-quality training data. Previously worked upon, AI Safety & Model Guardrails: Developed and deployed an AI Safety Classifier model using spaCy and Fastext frameworks, achieving 87% accuracy in real-time detection of harmful or malicious prompts, effectively acting as a guardrail to prevent undesirable LLM responses. RLHF Research and Model Study: Conducted research study on Reward Models and their role in Reinforcement Learning from Human Feedback (RLHF). LLM Data Preparation & Tokenization Optimisation: Engineered and executed efficient tokenization strategies for Indic LLM pretraining datasets using the Sentence-piece library, significantly reducing perplexity scores and decreasing model throughput costs, resulting in measurable savings in GPU training hours. Advanced Context and Encoding Research: Pioneered the implementation of state-of-the-art research methods, including different encoding techniques and context-preserving graph methods, to mitigate context loss and improve the robustness and overall performance of the LLM in complex tasks. Domain-Specific Data Categorisation: Utilised the Lilac tool for advanced data categorisation and analysis, which enabled the generalisation of specific domain content. This work directly contributed to improving the LLM's performance and benchmark scores within targeted application domains. Benchmarking and Performance Analysis: Closely monitored and analyzed the performance of ClickHouse against our own analytical database through rigorous benchmarking. Utilised shell scripts to fully automate the performance benchmarking and data collection process, significantly streamlining performance validation and reporting.

Project Trainee at Zoho, Feb 2023 - Mar 2023 · 2 mos, Chennai, Tamil Nadu, India, Worked on FixedDecimal, a PostgreSQL data type for efficient storage of numerical values and performance improvement over numeric aggregates.

Summer Intern at Zoho, May 2022 - Aug 2022 · 4 mos, Chennai, Tamil Nadu, India, Intern at Zoho Labs in Relational Database department. Exploring, Learning and making new findings in PostgreSQL.

Android Developer(Flutter) at Well Played Sports, Sep 2021 - Dec 2021 · 4 mos, Remote, Worked as a part of technical team at Well Played. Provided required analysis and solutions to business problems using Flutter. Provided valuable work on different types of module's while implementing MVC architecture, performing CRUD operations and restructuring of existing code. Gained hands-on experience on different flutter packages, Agile project management, API integration, User Interfaces, and Flutter development.

Education

Bachelor of Engineering - BE, Computer Science, Government College of engineering nagpur

Higher Secondary Certificate, Science, Major Hemant Jakate Institute of Science and Commerce

Public links

github: https://github.com/ArjunW08

leetcode: https://leetcode.com/arjunw08