Avishek Sharma profile photo 1 on Tal

Avishek Sharma

LLM Systems Engineer | Python-Native Rust Extensions (PyO3) | Zero-Copy & Inference Optimization | LLM as a White Box | AI Engineering

Greater Bengaluru Area

5+ years of work experience

GyanSys Inc.
May 20251 yr 5 mosPresent

GyanSys Inc.
Jun 20224 yrs 4 mosPresent

Bengaluru, Karnataka, India

GyanSys Inc.
Nov 20214 yrs 11 mosPresent

Avishek’s AI Stack

antigravity
antigravity
gemini
gemini
ollama
ollama
openai
openai
opencode
opencode
BentoML
BentoML

Education

Bachelor of Technology - BTech, Computer Science

Techno College of Engineering

Holy Cross School Agartala

Holy Cross School Agartala

200115 yrs2016

Join Avishek and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Avishek Sharma on Tal

Headline

LLM Systems Engineer | Python-Native Rust Extensions (PyO3) | Zero-Copy & Inference Optimization | LLM as a White Box | AI Engineering

About

Backend / AI Systems Engineer focused on building high-performance infrastructure for AI applications. I have 4+ years of professional software engineering experience, with a background in backend systems, system architecture, and performance-oriented engineering. I am now applying that foundation to AI Engineering, with a particular focus on building efficient, scalable, and resource-conscious Generative AI systems. Current Focus & Core Competencies Performance Engineering Profiling Python applications to optimize execution speed, memory usage, and system bottlenecks. I focus on understanding CPU, memory, concurrency, and hardware constraints for running Python. AI Engineering & GenAI Building local-first AI infrastructure, agentic RAG systems, and applications. I focus on making AI systems explicit, structured, and predictable, including the use of PydanticAI for transparent agent orchestration. Model Fine-Tuning & Optimization Working with LLM and SLM customization using parameter-efficient fine-tuning techniques such as LoRA, with emphasis on understanding the underlying mathematics, memory requirements, compute constraints, and inference behavior. High-Performance Backends Architecting concurrent backend services using Python, FastAPI, and Rust. I investigate performance bottlenecks such as the Python GIL, object allocation, memory movement, and CPU-bound workloads, and use native Rust extensions through PyO3 where lower-level execution and parallelism provide a meaningful advantage. Open Source — Lorealdb Lorealdb is a high-performance, SIMD-accelerated embedded dict/JSON database written in Rust and designed for Python AI applications. It focuses on fast reads, validation, scans, metadata filtering, and efficient data processing while leveraging native Rust performance from Python. The project is actively under development. GitHub: https://github.com/avisheksharmacoder/lorealdb I am driven by building fast, highly optimized AI systems and continuously expanding my understanding from the model internals all the way down to memory, CPU execution, concurrency, and hardware constraints. My long-term focus is building the infrastructure that makes local and efficient AI practical — using Python for rapid AI engineering and Rust where systems-level performance matters. Addicted to LLMs 👀 Former SAP MES Junior Full Stack Systems Developer with 4+ years of experience building and maintaining enterprise manufacturing systems. Interests: Deep Learning • AI Engineering • LLM Systems • Performance Engineering • Systems Programming • Athletics

Location

Greater Bengaluru Area

AI stack

antigravity

gemini

ollama

openai

opencode

BentoML

Work experience

Consultant at GyanSys Inc., May 2025 - Present · 1 yr 5 mos

Associate Consultant at GyanSys Inc., Jun 2022 - Present · 4 yrs 4 mos, Bengaluru, Karnataka, India

Software Engineer at GyanSys Inc., Nov 2021 - Present · 4 yrs 11 mos

Education

Bachelor of Technology - BTech, Computer Science, Techno College of Engineering

Holy Cross School Agartala

Public links

github: https://github.com/avisheksharmacoder

medium: https://medium.com/@avisheksharmacoder