Headline

Data Engineer @ Lowe’s | AdTech & Marketing Data Platforms | GCP · BigQuery · Airflow · Python

About

I build data infrastructure that doesn't just move data — it moves needles. With 2+ years at Fortune 500 companies (Lowe's & Bosch), I've designed and shipped production-grade data pipelines, ETL workflows, and backend APIs that process millions of records daily across GCP, BigQuery, PostgreSQL, and Snowflake. A few things I've delivered: → Reduced data latency by 60% by orchestrating PostgreSQL-to-BigQuery pipelines using Airflow DAGs and GCS → Cut pipeline compute costs by $15K/year through BigQuery partitioning, materialized views, and query optimization → Saved $50K+/year by automating dormant report detection and cleanup workflows → Led a monolith-to-microservices migration (hexagonal architecture) that slashed deployment time by 70% → Achieved 99.9% uptime across 10+ services with Grafana dashboards and SLO tracking → Migrated SSAS to Snowflake at Bosch — 3x faster queries, 40% lower infrastructure costs My stack: Python · SQL · Apache Airflow · BigQuery · GCP · PostgreSQL · Snowflake · Kafka · Docker · PySpark · RESTful APIs · Grafana · CI/CD I care about pipelines being reliable, observable, and cost-efficient — not just functional. Currently a Software Engineer at Lowe's (Bengaluru). Open to senior Data Engineer or Backend Engineer roles where scale and impact matter. 📩 Reach me at jsrivastava.115@gmail.com or connect here on LinkedIn.

Location

Bengaluru

AI stack

antigravity

claude code

claude

gemini

opencode

windsurf

Work experience

Software Engineer at Lowe’s, Jun 2025 - Present · 1 yr 3 mos, Bengaluru, Karnataka, India, • Built and maintained scalable data pipelines for end-user data population using BigQuery, Python, and Airflow DAGs, improving data availability, reliability, and downstream usability. • Improved pipeline execution time by 50% through query tuning, workflow orchestration improvements, and optimized transformation design across pipeline systems. • Led migration of jobs from monolithic architecture to hexagonal architecture, improving modularity, maintainability, testability, and ease of future integrations. • Developed and enhanced APIs for data ingestion and downstream consumption, improving service performance, scalability, and maintainability across multiple workflows. • Used Kafka and Docker for integration testing and service validation, increasing reliability of distributed workflows and reducing testing friction during development. • Reduced custom reports service cost by more than 80% by building an automated system that identified and disabled reports with no usage or empty data. • Improved application security by moving sensitive certificates, tokens, and passwords from repository-hosted JSON files to a centralized Mono API with authorization-based access control.

Data Analyst at Bosch Digital, May 2024 - Jun 2025 · 1 yr 2 mos, Bengaluru, Karnataka, India

Associate Software Engineer at Bosch Digital, Feb 2024 - May 2024 · 4 mos, On-site

MS Automated Engineer at Ericsson, Mar 2023 - Oct 2023 · 8 mos, Noida, Uttar Pradesh, India

Data Analyst at Ericsson, Mar 2023 - Sep 2023 · 7 mos, • Designed, developed, and maintained scalable data pipelines for processing and transforming large volumes of data using Microsoft Azure. • Collaborated across teams to streamline workflows, improve operational efficiency, and support issue resolution through Ericsson ticketing systems. • Implemented automation and data analysis solutions to optimize processes and improve system performance.

Data Science and Business analytics at The Sparks Foundation, Jul 2021 - Dec 2021 · 6 mos

Education

Bachelor of Technology - BTech, ece, GL bajaj institute of technology and management

Bachelor of Technology, Electrical, Electronics and Communications Engineering, Dr. A.P.J. Abdul Kalam Technical University