Headline

Data Engineering Lead at FedEx || Ex- Infogain || Ex- Accenture || Ex- Infoscian || Ex- TCSer

About

Data Engineering Lead with 10+ years of experience designing and scaling enterprise data platforms across Telecom, Banking & Finance, Transportation, FMCG, E-commerce, and Logistics domains. Proven expertise in data architecture, dimensional modelling (Kimball), DBT (Core & Cloud), Apache Spark, and cloud-native analytics on Azure and GCP. Strong hands-on experience in Python and SQL, delivering high-performance data pipelines and analytics-ready data marts. Demonstrated ability to own data platform roadmaps and define platform strategy, leading end-to-end data mart and common data model implementations, establishing data quality and governance frameworks, and optimizing large-scale platforms for performance, reliability, and cost efficiency while partnering closely with business and analytics stakeholders. Recognised for driving 50% reduction in data warehousing costs by optimising data storage, query patterns, and pipeline architecture, while leading engineering teams to achieve 50%+ performance improvements across large-scale data platforms.

Location

Bengaluru

AI stack

antigravity

codex

opencode

Work experience

Data Engineering Lead I at FedEx, Aug 2024 - Present · 2 yrs 1 mo, Bengaluru

Senior Development Consultant at Infogain, May 2023 - Jul 2024 · 1 yr 3 mos, Bengaluru, Karnataka, India, Project (MTN Nigeria & MTN Cameroon): Tech Stacks: Visual Studio Code, Python, Spark, SQL, Hive, Azure, Presto, Shell script, JIRA, GIT, Jenkins. Description: As a Data Architect and Lead Data Engineer, I'm overseeing a project to size infrastructure, provision, and design the complete data mart in Azure Data Lake. I'm ensuring data validation, quality, and analysis for improved AI/ML analytics. Moreover, I've initiated a new data mart dedicated to reporting dashboards, expediting data transfer to the Power BI team for report creation. Project (MTN GHANA): Have been involved in architecting and developing the DATA mart on HDFS in Cloudera to deliver 36 weeks of telecom data for development for AI/ML use cases.

Application development senior analyst at Accenture, Sep 2021 - May 2023 · 1 yr 9 mos, Bangalore Urban, Karnataka, India, Client: Cargill India Ltd. Project (Global Inventory): Tech Stack: Visual studio, Python, Spark, SQL, API, Django, hive, impala, oozie, Kudu, Shell script, JIRA, GIT, docker, Vela. Description: Worked on Inventory project to identify the devices which are logged in to Cargill network and identifies as unknown devices. Project (SACM): Tech Stack: Visual studio, Python, Spark, SQL, API, Django, hive, impala, oozie, Kudu, Shell script, JIRA, GIT, docker, Vela. Description: Engaged in the SACM project, I contributed to developing an API that exposes Hive views, utilizing Python Fast API and the Django framework. To finalize deployment in the production environment, I employed Oozie, Impala, Kudu, and Power BI. Project (ADEPT): Tech Stack: Python, Notepad++, Jupyter, API Calls, Postman, Shell scripting. Description: The project encompasses the merging of two APIs via Python-based scripting within the Data Lake environment, with scheduling facilitated by OOZIE. I have constructed this project from inception, handling its design and modeling entirely on my own.

Senior Associate Consultant at Infosys Limited, Jan 2019 - Sep 2021 · 2 yrs 9 mos, Pune, Maharashtra, India, Client: Citi Bank Project (Netezza Migration to Cloudera): Tech Stack: Visual studio, Python, Spark, SQL, API, Django, hive, impala, oozie, Kudu, Shell script, JIRA, GIT, docker, Vela. Description: As a Senior SPARK/HADOOP developer, I've orchestrated the creation of a system dedicated to submitting SNC reports to the US Federal Government. My responsibilities encompass developing ETL processes for inbound data leveraging Spark, transferring the resulting reporting data into Hive, and generating JSON via DTS modules. Additionally, I'm actively involved in end-to-end system architecture establishment and validation, utilizing sample production data in the development environment.

Senior System Engineer at Tata Consultancy Services, Nov 2015 - Jan 2019 · 3 yrs 3 mos, Bengaluru Area, India, Client: Deutsche Bank AG. Project (FIM): Employed at TCS as a Hadoop Developer/Admin and Data Migration Consultant since November 2015, accumulating a total work tenure of 3 years within the organization. Responsibilities included: Creating Flume jobs via config files to extract Network log data into HDFS for network issue analysis. Handling Sqoop jobs for data importation and merge tasks. Setting up Hive databases, External tables for finance data storage in HDFS. Developing Hive queries, scripts, optimizing performance. Expertise in Hive concepts like Partitions, Bucketing, managing tables for FIM System in Hive. Extensive use of AVRO formats for managing substantial binary data.

Education

Master of Business Administration - MBA, Business Administration and Management, General, Indian Institute of Management, Kozhikode

Engineer's Degree, Computer Science and Engineering, New Horizon College of Engineering