Headline

Senior Data Engineer | BigQuery, Snowflake, Airflow, dbt, Terraform | Cloud Data Platforms (GCP & Azure) & AI-Enabled Data Pipelines | Deloitte USI

About

Senior Data Engineer with 6+ years of experience building cloud data platforms and ELT pipelines on GCP (BigQuery), Snowflake and Azure for Fortune 500 clients. What I do: • Design Medallion (Bronze/Silver/Gold) data platforms and dimensional models (star schema, SCD Type 2) • Build Python-based Airflow (Astronomer) + dbt pipelines with built-in data quality, audit logging, monitoring and alerting • Automate deployments with Terraform and Tekton CI/CD • Build data pipelines for AI use cases, including an embedding pipeline for an AI Assistant chatbot (Gemini + BigQuery) and the ingestion layer for a sales forecasting solution live across 450+ restaurants Selected work: • A safety and recall analytics platform on BigQuery: 15 years of history, 150M+ rows, 500+ dbt tests, with client-estimated savings of millions of dollars • A Snowflake data platform for enterprise supply chain visibility: 100+ tables, 100K+ records ingested daily I also enjoy mentoring junior engineers and setting up data quality and CI/CD practices that make pipelines easier to run in production. Core stack: SQL, Python, BigQuery, Snowflake, Airflow (Astronomer), dbt, Azure Data Factory, GCP, Terraform, Tekton, Power BI Open to Senior Data Engineer and Data Platform Engineer roles. Reach me at vibhamsethi@gmail.com.

Location

Gurugram

AI stack

antigravity

claude code

claude

codex

gemini

github copilot

Work experience

Senior Data Engineer at Deloitte, May 2024 - Present · 2 yrs 6 mos, Gurugram, Safety and recall analytics platform for a Fortune 500 client (GCP, BigQuery, Airflow, dbt, Terraform). • Built a safety and recall analytics platform on Medallion (Bronze/Silver/Gold) architecture across Postgres and BigQuery: validated and ingested 10+ datasets into 25+ tables across 3 layers (15 years of history, 150M+ rows), with client-estimated savings of millions of dollars in operational and recall costs • Designed star-schema models serving 50+ metrics to Power BI; cut query latency by 50% through pre-aggregation and optimized metric design • Built the end-to-end data pipeline for an AI Assistant chatbot: processed 6,000 PDF and Word documents (plus 20 per week), generated vector embeddings with Gemini in Python, and stored them in BigQuery on a weekly refresh • Built 10+ Airflow (Astronomer) DAGs in Python orchestrating dbt and BigQuery, with failure-handling trigger rules, a custom metadata audit framework (latency, row counts), and a Pub/Sub + Cloud Functions alerting pipeline for real-time email and Teams notifications • Built a modular row-level data quality framework (500+ dbt tests, lineage tracking, audit logging) for downstream analytics and ML use cases; resolved 50+ code-quality issues with FOSSA and SonarQube • Authored Tekton CI/CD pipelines and Terraform (IaC) for automated table creation and ETL deployment; promoted DEV/QA releases to higher environments with 100% success and no downtime • Mentored a junior developer to independently build 10+ tables

Data Engineer at Deloitte, Oct 2021 - May 2024 · 2 yrs 8 mos, Gurugram, Enterprise supply chain data platform (Snowflake, Azure Data Factory, Azure Data Lake, Python). • Built the ingestion-to-warehouse pipeline: Python Azure Functions (ingestion, cleansing, processing, failed-data alerting) into Azure Data Lake, then the Snowflake raw layer via Snowpipe and Medallion layers • Designed 100+ Snowflake tables ingesting 100K+ records daily as the core data layer for enterprise supply chain visibility • Built Azure Data Factory pipelines integrating SOAP and REST APIs to load Oracle MDM data into master-data dimension tables with SCD Type 2 handling • Built the data ingestion architecture for an AI-enabled sales forecasting solution live across 450+ restaurants (client-projected benefit of $50–80M annually at scale) • Produced end-to-end data designs (ingestion, modeling, reporting layers) for 4 client projects across Healthcare, Life Sciences, Consumer and Automotive, including Accounting and Sales data models for Power BI

Business Analyst at Merilytics Inc., Aug 2020 - Oct 2021 · 1 yr 3 mos, Hyderabad, Telangana, India, Dedicated Business Intelligence Analyst with extensive experience in developing interactive analysis reports and dashboards using advanced DAX queries and Power BI. Skilled in translating complex business requirements into actionable insights across various domains. Key Responsibilities: - Imported data from sources like SQL Server, Azure SQL Database, SQL Server Analysis Services, and Excel into Power BI to generate KPI reports and key insights. - Created and modified SQL Stored Procedures to automate Power BI report generation. - Analyzed data from JDE, Salesforce, Magento, and GoToWebinar, developing Power BI dashboards. - Developed and maintained Power BI reports across Finance, Marketing, Supply Chain, Inventory Management, and Sales. - Gathered and documented business requirements for analytical reports, participating in requirements meetings and data mapping sessions. - Provided ongoing maintenance and bug fixes for Power BI reports. Achievements: - Developed over 10 Power BI reports across various domains, gaining comprehensive knowledge of key business metrics. - Maintained 30+ Power BI reports within a team, ensuring high-quality insights for stakeholders. - Migrated data to a Data Warehouse, optimizing report performance and efficiency.

Business Intern at Swiggy, Jul 2019 - Dec 2019 · 6 mos, Bengaluru Area, India, Improving customer and restaurant experiences by enhancing operational processes and supply-side efficiency for national partners. Proficient in data analysis and process optimization to drive impactful business solutions. Key Responsibilities: - Developed dashboards to identify factors affecting customer experience, enabling the revamping of process flaws to provide effective business solutions. - Led the Elite Fleet project from the supply team, collaborating closely with the operations team to redesign the operations system, significantly enhancing customer experience. - Analyzed operational processes and supply systems of various brands using SQL, Excel, and VBA, providing recommendations for process improvements. Achievements: - Achieved a 70% reduction in the company’s cost per delivery, substantially lowering operational expenses. - Successfully scaled the Elite Fleet Pilot model in tier 1 cities, building on successful experimentation in a single region. - Reduced customer complaint cases by 0.30% out of 50,000 cases, significantly improving overall customer satisfaction.

Summer Intern at Jaipur Development Authority, May 2018 - Jul 2018 · 3 mos, Jaipur Area, India

Education

Bachelor of Engineering, Civil Engineering, Birla Institute of Technology and Science, Pilani