Headline

SDE-2 @ Pibit.ai | Distributed Systems · Workflow Orchestration · Backend Architecture | Python · Django · MongoDB

About

I design and build scalable backend systems that power real-world platforms — from workflow orchestration engines to high-throughput data pipelines and video delivery systems. Currently an SDE-II at Pibit.ai, where I work on distributed scraping infrastructure, workflow orchestration, and platform services used by enterprise clients. Previously at Desynova Digital Pvt. Ltd., I owned critical backend systems in a high-scale video delivery platform, handling ingestion, transcoding, scheduling, and production reliability under strict SLAs. Key areas I work in: • Distributed backend systems • Microservices architecture • Workflow orchestration and schedulers • High-scale data pipelines • Performance optimization • Production incident ownership • System design and architecture Notable work: ✔ Designed a pipeline-based scraping platform for 150+ client websites ✔ Built GPU-aware scheduling systems for video processing ✔ Improved API performance by ~80% through architectural refactoring ✔ Reduced MTTR by 65% by leading production incident resolution ✔ Designing an orchestration engine similar to n8n I enjoy solving complex backend problems, mentoring engineers, and turning ambiguous requirements into scalable systems. Open to Senior Backend Engineer, Platform Engineer, and Tech Lead opportunities.

Location

Bengaluru

AI stack

antigravity

claude code

cursor

geminicli

langfuse

Work experience

SDE 2 at Pibit.ai, Mar 2025 - Present · 1 yr 6 mos, Bengaluru, Karnataka, India, - Led Python version upgrades across backend services, ensuring dependency compatibility and zero-downtime production releases. - Designed a scalable web scraping system for 150+ client websites using a pipeline-based architecture to support frequent client-specific workflow changes. - Implemented Factory Pattern–based adapters for Selenium, Playwright, and Kameleo drivers, enabling extensible and maintainable scraper execution. - Contributed to building a client-centric microservices dashboard platform, directly supporting enterprise client onboarding and deal closure. - Developed a workflow orchestration engine (n8n-like) with schedulers, node executors, and user-defined workflows.

Senior Software Developer, Backend Developer at Desynova, Jun 2023 - Apr 2025 · 1 yr 11 mos, Mumbai, Maharashtra, India, - Owned the end-to-end video delivery platform, handling ingestion, transcoding, QA, and final delivery under strict client SLAs. - Designed a Factory Pattern–based transcoding service integrated with Argo Workflows to orchestrate GPU-intensive video processing jobs. - Built a GPU-aware optimistic scheduler to maximize GPU utilization while safely handling concurrent transcoding workloads. - Acted as the primary on-call owner during peak delivery windows, resolving production issues in real time, including late-night escalations. - Improved backend API response times by approximately 80% through database optimization and architectural refactoring. - Led production incident resolution and root-cause analysis, reducing mean time to recovery (MTTR) by 65%.

Software Engineer at Desynova, Jun 2022 - May 2023 · 1 yr, Hyderabad, Telangana, India, - Developed Django-based REST APIs improving backend workflow efficiency by 25%. - Designed and implemented data synchronization pipelines integrating with Star TV and Hotstar, improving data accuracy by 70%. - Optimized MongoDB schemas and queries, reducing query execution times by approximately 40%.

Backend Intern at Desynova, Sep 2021 - Jun 2022 · 10 mos, Hyderabad, Telangana, India, - Developed and tested RESTful Django APIs focusing on performance, reliability, and security. - Created and maintained comprehensive API documentation, reducing developer onboarding time by approximately 80%. - Assisted in debugging production issues and optimizing backend services within Agile development workflows.

Education

Bachelor of Engineering - BE, Computer Science, United College of Engineering and Research, Allahabad

12, Physics chemistry maths, Sunbeam school, Lahartara

Public links

github: https://github.com/rahul06030

leetcode: https://leetcode.com/witty_coder

youtube.com: https://youtube.com/@witty.coder1