Headline

Senior Associate @ Lentra | Real-Time Data Engineering

About

As a Senior Associate at Lentra with over 6 years of experience, my focus lies in designing and optimizing real-time data engineering platforms using Apache Flink, Kafka, AWS, and distributed event-driven architectures. I have contributed to building real-time streaming applications by implementing event-time semantics, windowing, and stateful processing pipelines with checkpointing and fault tolerance for high-volume customer event processing. My expertise extends to developing scalable and efficient data solutions, leveraging tools like Docker and Kubernetes for containerization and CI/CD workflows. With a strong foundation in big data technologies, I aim to deliver robust, maintainable, and production-grade data pipelines that enable seamless real-time and batch data processing.

Location

Pune District

AI stack

anthropic apis

antigravity

claude code

gemini

OpenAI Agents SDK

OpenAI Playground

Work experience

Senior Associate at Lentra, Jun 2024 - Present · 2 yrs 5 mos, Working on real-time data engineering platforms using Apache Flink, Kafka, AWS, and distributed event-driven architectures. Nudge System — Real-Time Streaming Platform Engineered real-time applications using Apache Flink DataStream API for high-volume customer event processing. Implemented event-time semantics, windowing, and complex event-processing logic for real-time customer eligibility evaluation. Designed stateful processing pipelines with checkpointing and fault tolerance to support exactly-once processing. Tuned Flink jobs for low-latency processing and near-instant downstream delivery. Used Flink Table API and SQL API to implement maintainable eligibility and offer-matching logic. Integrated streaming pipelines with backend services for event-driven processing.

Data Engineer at Lentra, Jun 2023 - Jun 2024 · 1 yr 1 mo, Cadenz Dedupe — Real-Time Data Deduplication Platform Developed AWS Lambda functions for real-time customer-record processing and deduplication. Integrated Apache Kafka for real-time ingestion and streaming. Used DynamoDB for scalable low-latency storage and OpenSearch for record retrieval and matching. Containerized service components using Docker and Kubernetes. Supported automated build, test, and deployment workflows through CI/CD pipelines.

Big Data Developer at Zielotech infosolution India LLP, Apr 2020 - Jun 2023 · 3 yrs 3 mos, Pune District, Maharashtra, India, Worked on batch, delta, and near-real-time data-processing pipelines using Apache Spark, PySpark, Structured Streaming, Hadoop ecosystem technologies, and AWS. Developed batch and delta ETL pipelines using Spark Core and PySpark. Built Spark Structured Streaming jobs for incoming delta data feeds. Processed and transformed data across HDFS, HBase, and Hive. Performed data migration and integration involving PostgreSQL, HBase, and Hive. Applied data cleaning, validation, and performance-tuning practices. Optimized Hive scripts and Spark jobs for improved processing efficiency. Worked with Avro and Parquet data formats. Used AWS EMR, EC2, S3, and RDS for scalable data-processing workloads. Collaborated with QA teams on pipeline testing, defect resolution, data quality, and governance.

Electronic Engineer at Dixon Technologies India Limited, Apr 2018 - Jul 2018 · 4 mos, Tirupati, Andhra Pradesh, India

Assistant Engineer at Videocon Industries Limited. Ctv Division Aurangabad, Jun 2016 - Mar 2018 · 1 yr 10 mos, Aurangabad, Maharashtra, India

Education

Bachelor of Engineering, Electronics, Dr. Babasaheb Ambedkar Marathwada University

Diploma, Electronics and telecommunication engineering, msbte