Headline

Senior Data Engineer @ 7-Eleven | Building PrepNPlaced | Ex-Target | Data Engineering Mentor | Building AI Powered CareerOS for Resume, Jobs & Interviews

About

I am aSenior Data Engineer @ 7-Eleven | Founder of PrepNPlaced | Ex-Target | Data Engineering Mentor | Building AI CareerOS for Resume, Jobs & Interviews, specializing in building highly scalable, robust data pipelines and transforming complex datasets into actionable business intelligence. With a strong foundation in Computer Science, I thrive at the intersection of Big Data architecture and business strategy. 🛠️ What I Do Systematically: Currently, I leverage Azure Databricks, PySpark, and Airflow to optimize supply chain data workflows. By implementing the Medallion Architecture (Bronze, Silver, Gold), I've successfully reduced ETL latency and improved data processing speeds, directly impacting the bottom line. 👨‍🏫 Mentorship & Community: Beyond my corporate role, I am deeply passionate about education. As an instructor at Bosscoder Academy, GeeksforGeeks, and Preplaced, I have trained over 100,000+ professionals. I specialize in taking complex concepts across Data Engineering, Big Data, and Cloud Architecture, and breaking them down into digestible, real-world applications. ⚙️ Core Tech Stack: • Big Data & Processing: PySpark, Apache Spark, Kafka, Hadoop, Hive • Cloud Platforms: Azure (Databricks, Data Lake, Synapse), AWS, GCP • Orchestration & BI: Apache Airflow, Dash by Plotly, Power BI, SQL • Languages: Python, SQL 📩 Let's connect! I am always open to discussing Data Engineering architecture, speaking opportunities, or mentoring driven individuals transitioning into tech. 🔗 Book a 1:1 mentorship session with me: topmate.io/durgesh_yadav

Location

Bangalore Urban

AI stack

aistudio

claude code

codex

gemini

geminicli

claudecode

Work experience

Sr Data Engineer at 7-Eleven, Aug 2024 - Present · 2 yrs 1 mo, Bangalore Urban, Karnataka, India, ⚡ Optimized supply chain payment workflows by analyzing large-scale vendor-client datasets with PySpark on Databricks, directly reducing outstanding payments by 14% and reconciliation errors by 20%. 🛠️ Engineered scalable data pipelines using Databricks, Apache Spark, and Azure Data Lake Storage. Implemented Medallion Architecture (Bronze, Silver, Gold) to enhance data quality, boosting processing speed by 20% and significantly reducing ETL latency. 📊 Developed automated, real-time dashboards using Python (Dash), SQL, and Airflow, delivering up-to-the-minute insights that accelerated data-driven decision-making for key stakeholders. 🔄 Orchestrated end-to-end data ingestion across diverse cloud and on-premise systems, leveraging Hadoop-based connectors and Apache Airflow for robust scheduling and pipeline orchestration. 🤝 Partnered with product managers and cross-functional teams to deploy KPI-rich, interactive risk-monitoring reports that proactively identified supply chain bottlenecks and enabled targeted mitigation strategies. 💻 Core Tech Stack: PySpark, Databricks, Apache Airflow, Python (Dash), SQL, Azure Data Lake Storage, Hadoop, Medallion Architecture.

Product analyst at Target, Oct 2022 - Aug 2024 · 1 y 10 mo, Bangalore

Software Engineer at Coforge, Nov 2021 - Sep 2022 · 10 mo, Noida

Education

Bachelor's degree, Computer Science, GL bajaj institute of technology and management

Senior Secondary HighSchool, Science, Don Bosco High School - India

Public links

github: https://github.com/analyticsdurgesh

youtube.com: https://youtube.com/@prepnplaced