Headline

Data Engineer @ Ipsos | Python, SQL , Databricks , Cloud Architect

About

I’m a Data Engineer with 3+ years of professional experience building data pipelines, backend services, analytics solutions, and scalable software applications. I have hands-on experience with Python, SQL, ETL/ELT, PySpark, AWS, Snowflake, Databricks, Airflow, and data warehousing, with a focus on data ingestion, transformation, validation, workflow orchestration, and building reliable analytics-ready datasets. In my current role at Ipsos, I work on data engineering and software engineering initiatives, including scalable ETL pipelines, SQL-based data transformations, Python automation, data validation workflows, and cloud-based data processing. I have also worked on DAG-based workflow orchestration, backend APIs, AWS Lambda, S3, Snowflake, PostgreSQL, and CI/CD workflows. Alongside my data engineering experience, I have a strong software engineering background with experience in React.js, JavaScript/TypeScript, REST APIs, state management, reusable components, and automated testing. I’m currently open to Data Engineer, Cloud Data Engineer, Big Data Engineer, and Data Engineering-focused Software Engineer opportunities. 🔧 Core Skills: Python | SQL | PySpark | ETL/ELT | AWS | Snowflake | Databricks | Airflow | Data Warehousing | React.js | REST APIs | CI/CD 📍 Open to: Bengaluru / Hybrid / Remote opportunities Let’s connect if you’re hiring for Data Engineering or related roles!

Location

Bengaluru

AI stack

claude code

glama

langgraph

notion

openai

Work experience

Data Engineer at Ipsos, Jan 2024 - Present · 2 yrs 10 mos, Bengaluru, Data Engineer (Aug 2025 – Present) Own end-to-end ETL/ELT pipelines for enterprise ingestion, transformation, validation, and delivery, cutting recurring manual processing effort by ~70% and freeing the team to take on new data sources. Design SQL transformations and dbt models that power analytics-ready datasets for reporting and KPI tracking, reducing report-generation time by ~30%. Build Python and PySpark workflows with automated cleansing, validation, and error handling across a cumulative ~30 TB of enterprise data, applying partitioning strategies for scalable batch processing. Optimize AWS Lambda and Redis-backed workflows to improve data-retrieval performance and reduce processing latency. Work across Snowflake, PostgreSQL, SQL Server, and DynamoDB for data integration; partner with analytics and engineering stakeholders on transformation logic and reusable validation patterns. Recognized with the Star Performer Award three times for pipeline reliability and delivery. Software Engineer I (Jan 2024 – Aug 2025) Built a DAG-based orchestration platform for ETL dependency management, SQL validation, and pipeline monitoring, reducing manual analysis time by ~87%. Developed 10+ Python APIs and data-processing services supporting ingestion, transformation, validation, and delivery of analytics-ready datasets. Built serverless AWS Lambda and S3 workflows for automated file processing and ETL validation, cutting manual intervention in data ingestion. Automated data-quality checks and reconciliation logic, reducing manual validation effort by ~97% while partnering with engineering and analytics teams to troubleshoot production issues.

Back End Developer at SAIRA IOT SOLUTIONS, Jun 2023 - Oct 2023 · 5 mos, Chennai, Built Python backend scripts to collect, process, and transform employee attendance records into structured datasets, forming the data layer behind an internal reporting dashboard. Developed backend logic to validate and prepare attendance data, improving the accuracy and reliability of downstream reporting. Implemented data transformation workflows in Python to power dashboard metrics and trend visualizations, making attendance patterns easier to monitor.

Education

Masters, Physics, The ICFAI University, Tripura

Public links

github: https://github.com/pujita789

medium: https://medium.com/@pujita