Headline

I build systems which solve real problems using tech | Lead Software Engineer

About

I love working and experimenting with Data and Backend! I'm a passionate Software & Data Engineer with ~7 years of industry experience in designing and developing data applications and MVPs. Key Skills: - Big Data technologies: Including but not limited to AWS, GCP, Spark, Kafka, Airflow, Hudi, Hive, BigQuery, RDBMS, NoSQL - Programming languages: Python, Javascript, SQL - Infrastructure as a code: Terraform - Data warehousing, data modeling, data pipelines, ETL, OLAP - CI/CD tools: Jenkins, Git Actions - Cloud: AWS, GCP - Strong communication (writing, conversation, presentation) skills The Work I love doing: - Translate business problems into scalable and reliable data and backend solutions to drive business impacts - Leverage big data techs to design, develop and optimise automated data pipelines from end to end - Develop batched and real-time data processes - Implement CI/CD to enable automated deployment and more frequent delivery (as I believe manual work cost more time and induce more human mistakes) - Create robust logics to tackle problems which come as an application scales Career Philosophy: - Take full ownership of my work and go above and beyond. - Step out of comfort zone: explore and try new technologies and ideas - Understand the business to really know what the end goal is - Team player: I don't feel shy in accepting constructive suggestions and don't feel afraid to give advice wherever necessary - Keep learning and sharing knowledge Contact: prateekjain6342@gmail.com

Location

Gurgaon

AI stack

codex

opencode

Work experience

Software Engineer at Mobility Global, Jul 2023 - Present · 3 yrs 2 mos, Gurugram, S&P Global Mobility Spin off • Constructed end-to-end data pipelines for complex computation of big data powering a forecasting app using Python, AWS (Step Functions, Lambda, Batch, Glue, DynamoDB, RDS) and Terraform; Reduce customer onboarding time by 30%. • Streamlined data sanity checks in existing data pipelines using Python, AWS Step Functions and Terraform reducing failures by 20% during application runtime. • Enhanced the speed of data migration service using DuckDB, Python and AWS Batch leading to reducing the time taken for data migration to run by 60% and improving the time required for debugging by 50%. • Established a Python-driven AWS pipeline for tracking incremental data changes, reducing manual data handling by 100% and streamlining on-demand generation of client data packages. • Built a data model using AWS (Lambda, Batch) and Python (Multiprocessing) to compare datasets and surface changes on the UI, onboarding 2 clients through automated data comparison.

Senior Software and Data Engineer at Milkbasket, Apr 2022 - Jun 2023 · 1 yr 3 mos, Gurugram, Haryana, India, • Engineered an automatic real-time customer support ticket resolving algorithm by constantly analyzing customer behavior and automatically resolving tickets using Python, AWS Batch and Kafka leading to automating 60% of customer support resolution. • Implemented a Lead Management System for the sales team by ingesting data from 3 sources using Python and Google Sheets reducing manual efforts by 70% and improving visibility for senior leadership. • Modeled data infrastructure using Python, AWS, and PostgreSQL to personalize in-app experiences based on user behavior and order history, increasing time spent on the app by 10% in the first 30 days.

Data Engineer at Milkbasket, Dec 2021 - Apr 2022 · 5 mos, Gurugram, Haryana, India, Key Achievements: Optimised the time taken by the Marketing team to make decisions for their next campaign by 6x Key Responsibility Areas: - Successfully automated monthly PPTs (Google Slides) for the business team to present sales and revenue reports to the stakeholders - Creating an API infrastructure to personalise the in-app experience for the customers and increasing revenue for the company - Automated Ad-hoc requests by reducing daily man hours from ~60 minutes to 0 minutes. - Generating meaningful insights to help the Growth and Strategy team to make informed decisions - Optimising Processes for the Analytics Team - Helping Marketing Team to run better targeted campaigns

Senior Data Engineer & Analyst at Stanza Living, Aug 2021 - Oct 2021 · 3 mos, Gurugram, Haryana, India, • Pioneered a lead management system (LMS) leveraging Python, Google Sheets, Twilio, and PostgreSQL decreasing lead leakage by 15% and saving the Business Development team 20+ hours weekly. • Developed automated reporting for daily metrics using Python and AWS leading to efficient planning for business objectives.

Data Engineer at Xtracap Fintech India Pvt Ltd, Sep 2020 - Aug 2021 · 1 yr, Gurugram, Haryana, India, • Architected and designed backend for an end-to-end internal analytics tool using Python (Django), Celery, AWS and PostgreSQL; saving at least $90 per month (compared to Power BI). • Engineered a Financial Health Check using Python, PostgreSQL and AWS reducing manual onboarding time by 2-3 days per user.

Associate at magicpin (Samast Technologies), Aug 2019 - Sep 2020 · 1 yr 2 mos, Gurgaon, India, • Created workflows using Python, Google Sheets & AWS for real-time data reporting reducing manual effort by 40+ hours per week. • Identified FMCG target audiences using Python, enabling 100% accurate client campaign targeting.

Education

Master of Science - MS, Computer Science, Liverpool John Moores University

Executive PGP, Computer Science, International Institute of Information Technology Bangalore