Headline

Specialist Programmer @ Infosys | Azure Data Engineer | Building Scalable Data Pipelines

About

Data Engineer with ~2 years of experience at Infosys, specializing in building scalable data pipelines and distributed systems using Azure and Apache Spark. I work on designing end-to-end data solutions—from ingestion and transformation to data modeling and analytics—for large-scale enterprise datasets. I have hands-on experience with Azure Data Factory, Databricks, Synapse Analytics, and Delta Lake, along with strong expertise in PySpark and SQL. I focus on building high-performance pipelines, optimizing Spark workloads, and ensuring data quality, reliability, and scalability in production environments. At Infosys, I’ve worked on high-volume data systems processing millions of records daily, improving performance by up to 40% through optimization techniques like partitioning, caching, and query tuning. I’ve also built robust validation, logging, and monitoring frameworks to ensure reliable data delivery. Beyond data engineering, I’m exploring Generative AI and LLM-based applications, working on automation use cases and intelligent data workflows.

Location

Delhi

AI stack

github copilot

githubcopilot

Microsoft Copilot

Work experience

Specialist Programmer at Infosys, Apr 2024 - Present · 2 yrs 5 mos, Pune District, Maharashtra, India, Design and develop scalable data pipelines using Azure and Apache Spark Build and maintain ETL/ELT workflows for large-scale data processing Perform data ingestion, transformation, and loading into Delta Lake architectures Develop PySpark and SQL-based data processing logic for structured datasets Optimize Spark jobs using partitioning, caching, and query tuning techniques Implement data validation, logging, and monitoring frameworks Design modular and reusable pipeline components with error handling Work on data modeling and data warehousing for analytics use cases Ensure reliable pipeline orchestration and failure handling mechanisms Collaborate with cross-functional teams to deliver data solutions in Agile environments

Full Stack Web Developer at Business Web Solutions, Jun 2022 - Aug 2022 · 3 mos, Remote, -Collaborated with the development team to create responsive and visually appealing web pages using . -Assisted in the design and implementation of user interfaces for various projects, ensuring a seamless and intuitive user experience. -Gained hands-on experience with the ReactJS library, contributing to the development of dynamic and interactive components. -Worked closely with backend developers to integrate frontend components with server-side logic, ensuring seamless data flow and functionality.

Education

Bachelor of Technology - BTech, Electrical, Electronics and Communications Engineering, University School of Information, Communication & Technology (USICT)