Data Engineering @ PayNearby | Building Scalable Data Platforms

Remote

Bengaluru, Karnataka, India

Remote

Bengaluru, Karnataka, India

Bengaluru, Karnataka, India
Bangalore, India






Bachelor's degree, Electronics and Communications Engineering
Bhilai institute of technology
Science
Kps, Bhilai
Join Avinash and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossData Engineering @ PayNearby | Building Scalable Data Platforms
I am an engineering leader with over a decade of experience in building scalable data platforms and high-performance engineering teams. My expertise lies in architecting real-time data pipelines, optimizing infrastructure costs, and integrating AI/ML solutions to accelerate development lifecycles. I have a proven track record of reducing latency for large-scale, user-facing analytics and delivering significant operational efficiencies. I am passionate about leveraging cutting-edge technology to solve complex data challenges that drive business impact and innovation.
Bengaluru, Karnataka
antigravity
claude
deepseek
gemini
geminicli
langgraph
Engineering Manager at PayNearby, Mar 2025 - Present · 1 yr 5 mos, Remote, Leading for Data, Observability & AI - Spearheading initiatives to build and implement cutting-edge AI and Machine Learning solutions. - Architecting in-house AI tools that directly accelerate the development lifecycle and boost engineering efficiency. - Integrating AI-powered assistance and features into applications to enhance user experience and capabilities. - Implementing ELK ML Solutions to deliver predictive insights and dynamic monitoring across systems.
Lead Data Engineer at PayNearby, Nov 2021 - Sep 2025 · 3 yrs 11 mos, Bengaluru, Karnataka, India, - Building the next-generation platform to handle scale and reduce development efforts - Spearheaded cost optimization initiatives, achieving a 30% reduction in expenses across the organization. - Internal Service to ingest Request/Response of upstream services for Auditing, Monitoring. - Design and Implemented a solution to serve static content from S3 using Nginx as a reverse proxy handling 120K at peak with ~<5ms response time, handled NoCache scenario when serving PII Data - Designed and Developed a platform to power real-time user-facing analytics using Apache Pinot and Trino as Gateway Languages: Python, Java, njs
Senior Data Engineer at PayNearby, Apr 2021 - Oct 2021 · 7 mos, Remote, Data Platform - Laid the foundation of the Data Team and set up a team of 7 engineers - Architected and implemented an In-house Data Platform from scratch - Designed and developed real-time Data Pipelines using Apache Kafka, Kafka Connect, Apache Airflow, and Apache Spark - Streamlined central data discovery and data query by implementing Data Hub - Optimised Queries on BigQuery to ensure low latency and reduced cost by 30%. - Transitioned from a proprietary enterprise BI tool to an open-source BI solution. Built service to server data at low latency - Handling peak 100k requests/second with sub-10ms latency. - Implemented a no-code solution for importing data from various sources directly into Cassandra.
Senior Data Engineer at Ezetap Mobile Solutions Pvt. Ltd, Aug 2018 - Dec 2020 · 2 yrs 5 mos, Bengaluru, Karnataka, India, In-house Data-Platform to ingest data from various data sources to Dataware-house. - Minimised time by 80% in serving data to Business Customers for reporting and Analytical needs. - Brought down avg query latency and streamlined day-2-day reporting needs Built framework and transformed data to address the geo-analytics needs of organizations. - Provided better insights into the organization. - Catered to reporting, analytics, alerting and ML needs. - Migrated from an enterprise's BI Tool to a self-hosted Open Source BI tool Designed and Implemented the Notification As A Service - Improved TAT on developing applications and reducing complexity across the organization
Senior Software Engineer at thinkAPPS Solutions Private Limited, Aug 2017 - Jul 2018 · 1 yr, Bengaluru, Karnataka, India, Developed MicroServices and integrated legacy SOAP endpoints - Did seamless transition from monolith to microservices. - Utility service to run batch operations, reduced processing time by 50%.
Software Developer at Vedant Tech Solutions, Oct 2014 - Jul 2017 · 2 yrs 10 mos, Bangalore, India, Developed VTS Core CSS library on Bootstrap Library - Streamlined UI and UX across products. Migrated a legacy web application from Jsp to Angular.
Bachelor's degree, Electronics and Communications Engineering, Bhilai institute of technology
Science, Kps, Bhilai