Headline

Data Engineer | 5+ Years Experience | Snowflake Certified | Expert in Building Scalable Data Pipelines, ETL Solutions, and Cloud Data Architectures

About

Experienced Data Engineer | Snowflake Certified with 5+ years of expertise in Python, SQL, Kafka, Spark, PySpark, Airflow, PostgreSQL, ETL, AWS, Redshift, dbt, and Git/GitHub. Proven skills in problem-solving, data migration, data warehousing, and scalable pipeline development. Committed to growth and collaboration, with a strong focus on delivering efficient, high-impact data solutions. Seeking opportunities to leverage advanced technical skills while driving project success and innovation.

Location

Bangalore Urban

AI stack

claude code

claude

github copilot

mcp

ollama

OpenAI Agents SDK

Work experience

Lead Data Engineer at Persistent Systems, Nov 2024 - Jun 2026 · 1 yr 8 mos, Bengaluru, 🔆 Designed and implemented scalable ETL pipelines using PySpark, Airflow, SQL, and dbt, boosting data processing efficiency by 30%. 🔆 Building robust data architectures, ensuring timely delivery of complex data projects. 🔆 Optimized data storage and retrieval systems (e.g., Snowflake, Redshift), reducing query execution time by 32% and cutting costs by 20%. 🔆 Established data governance frameworks to enhance data quality, security, and compliance with industry standards. 🔆 Improved system reliability and performance, resulting in a 25% increase in data processing throughput.

Data Engineer at V2Solutions, Oct 2023 - Nov 2024 · 1 yr 2 mos, Bengaluru, Karnataka, India, 🔆 Collaborated with Solution Architects to design and implement robust data pipelines using AWS Services (S3, Lambda, Glue, Redshift), Python, and SQL. 🔆 Applied advanced data modeling techniques, achieving a 10% reduction in query execution times. 🔆 Managed and optimized data warehousing solutions with Redshift and PostgreSQL for multiple business applications and reporting dashboards. 🔆 Improved data processing efficiency by 20% through the implementation of optimized ETL processes. 🔆 Enhanced data quality and consistency by developing and enforcing data governance policies.

Data Engineer at Tata Consultancy Services, Dec 2021 - Oct 2023 · 1 yr 11 mos, Bengaluru, Karnataka, India, 🔆 Executed data extraction, transformation, and loading (ETL) processes, migrating data from Teradata to Amazon Redshift, reducing data processing time by over 50% and costs by more than 32%. 🔆 Successfully completed three data migration projects, converting Teradata code to Redshift, and developing complex queries and RSQL stored procedures. 🔆 Designed and implemented end-to-end data pipelines, integrating data from various vendor sources via Lambda API and processing with AWS Glue and Redshift, setting up reporting layers in QuickSight. 🔆 Collaborated closely with solution architects on projects involving large-scale data migration (reduced data latency by 40%), IoT sensor data processing (improved data accuracy by 25%), and financial data warehousing (enhanced data retrieval speed by 35%), ensuring high-quality data management and reporting solutions.

Junior Data Engineer at Tata Consultancy Services, Mar 2021 - Nov 2021 · 9 mos, Bengaluru, Karnataka, India, 🔆 Worked closely with Solution Architect to understand data ingestion requirements on AWS and implemented data manipulation processes using lambda functions and ingestion to S3 buckets 🔆 Utilized AWS Glue to transform data into Parquet and JSON formats, and loaded the formatted data into AWS Redshift 🔆 Scheduled and maintained Glue jobs to ensure timely and accurate data processing

VMS Administrator at 314e Corporation, Dec 2019 - Oct 2020 · 11 mos, Bangalore, 🔆 Automated vendor data processes, enhancing data validation and acceptance efficiency. 🔆 Developed and maintained data pipelines for vendor onboarding, ensuring seamless integration and data accuracy. 🔆 Utilized Bullhorn tracking sheets to monitor and analyze vendor performance metrics, improving data-driven decision-making. 🔆 Managed data-related aspects of job openings, candidate submissions, interviews, client coordination, and onboarding documentation. 🔆 Increased revenue by implementing data-driven programs to promote business and establish new contracts.

Education

Bachelor of Engineering - BE, Aerospace, Aeronautical and Astronautical/Space Engineering, Anna University Chennai

Intermediate, Mathematics and Computer Science, Human Resource Development Academy