LLM Systems Engineer | Python-Native Rust Extensions (PyO3) | Zero-Copy & Inference Optimization | LLM as a White Box | AI Engineering


Bengaluru, Karnataka, India







Bachelor of Technology - BTech, Computer Science
Techno College of Engineering

Holy Cross School Agartala
Join Avishek and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossLLM Systems Engineer | Python-Native Rust Extensions (PyO3) | Zero-Copy & Inference Optimization | LLM as a White Box | AI Engineering
Backend / AI Systems Engineer focused on building high-performance infrastructure for AI applications. I have 4+ years of professional software engineering experience, with a background in backend systems, system architecture, and performance-oriented engineering. I am now applying that foundation to AI Engineering, with a particular focus on building efficient, scalable, and resource-conscious Generative AI systems. Current Focus & Core Competencies Performance Engineering Profiling Python applications to optimize execution speed, memory usage, and system bottlenecks. I focus on understanding CPU, memory, concurrency, and hardware constraints for running Python. AI Engineering & GenAI Building local-first AI infrastructure, agentic RAG systems, and applications. I focus on making AI systems explicit, structured, and predictable, including the use of PydanticAI for transparent agent orchestration. Model Fine-Tuning & Optimization Working with LLM and SLM customization using parameter-efficient fine-tuning techniques such as LoRA, with emphasis on understanding the underlying mathematics, memory requirements, compute constraints, and inference behavior. High-Performance Backends Architecting concurrent backend services using Python, FastAPI, and Rust. I investigate performance bottlenecks such as the Python GIL, object allocation, memory movement, and CPU-bound workloads, and use native Rust extensions through PyO3 where lower-level execution and parallelism provide a meaningful advantage. Open Source — Lorealdb Lorealdb is a high-performance, SIMD-accelerated embedded dict/JSON database written in Rust and designed for Python AI applications. It focuses on fast reads, validation, scans, metadata filtering, and efficient data processing while leveraging native Rust performance from Python. The project is actively under development. GitHub: https://github.com/avisheksharmacoder/lorealdb I am driven by building fast, highly optimized AI systems and continuously expanding my understanding from the model internals all the way down to memory, CPU execution, concurrency, and hardware constraints. My long-term focus is building the infrastructure that makes local and efficient AI practical — using Python for rapid AI engineering and Rust where systems-level performance matters. Addicted to LLMs 👀 Former SAP MES Junior Full Stack Systems Developer with 4+ years of experience building and maintaining enterprise manufacturing systems. Interests: Deep Learning • AI Engineering • LLM Systems • Performance Engineering • Systems Programming • Athletics
Greater Bengaluru Area
antigravity
gemini
ollama
openai
opencode
BentoML
Consultant at GyanSys Inc., May 2025 - Present · 1 yr 5 mos
Associate Consultant at GyanSys Inc., Jun 2022 - Present · 4 yrs 4 mos, Bengaluru, Karnataka, India
Software Engineer at GyanSys Inc., Nov 2021 - Present · 4 yrs 11 mos
Bachelor of Technology - BTech, Computer Science, Techno College of Engineering
Holy Cross School Agartala
github: https://github.com/avisheksharmacoder
medium: https://medium.com/@avisheksharmacoder