SUBARNA KANTI SAMANTA profile photo 1 on Tal

SUBARNA KANTI SAMANTA

Data Engineer | Python | SQL | AWS | Scalable ETL & Data Pipelines | PostgreSQL | Elasticsearch | APIs & Automation | Docker | Geospatial Data

Bengaluru

5+ years of work experience

NAVANC
May 20242 yrs 4 mosPresent

Bengaluru, Karnataka, India

Needl.ai
Nov 20237 mosMay 2024

Bengaluru, Karnataka, India

• Designed and automated ETL pipelines integrating data from financial exchanges, regulatory APIs, and CRM platforms. • Built fault-tolerant ingestion python algorithms with retries, queue processing, and batch scheduling, ensuring reliability at scale. • Deployed real-time monitoring dashboards with anomaly detection for proactive pipeline issue resolution using Apache Superset. • Improved data quality and consistency via systematic validation across multiple sources saved in PostgreSQL.
Aditya Birla Management Corporation Pvt Ltd
Mar 20221 yr 9 mosNov 2023

Bengaluru, Karnataka, India

• Engineered real-time IoT pipelines with Flask APIs, InfluxDB, and Grafana for ingestion, querying, and visualization (ETL). • Designed anomaly detection ai algorithm using SUOD (Scalable Unsupervised Outlier Detection) on time-series voltage data; extracted features using various statistical parameters (kurtosis, skewness, variance, autocorrelation, peak-to-peak amplitude). Detected faulty Electrolyser connections, reducing power losses, costs, and safety risks. • Automated alerts & reporting with self-build Python scheduler jobs; containerized solutions with Docker for production deployment.
Siemens Technology India
Aug 20218 mosMar 2022

Bengaluru, Karnataka, India

• Built end-to-end ML pipelines with Flask, InfluxDB, and Docker for real-time inference on time-series data. • Integrated Kafka-based streaming workflows across in-house applications. • Deployed production-ready Dockerized applications with mlFlow, Grafana dashboards, Swagger APIs, and PyArmor for secure delivery. • Developed and Deployed Deep Neural Network Models for regression, classification, anomaly detection, LightGBM Model (ensemble ml algorithm) for classification and exponential smoothing for forecasting on top of IOT data.
Siemens Technology India
Dec 20208 mosJul 2021

Bengaluru, Karnataka, India

SUBARNA’s AI Stack

gemini
gemini

Education

International Institute of Information Technology Bangalore

Master of Technology - MTech, Electrical, Electronics and Communications Engineering

International Institute of Information Technology Bangalore

20192 yrs2021

Join SUBARNA and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

SUBARNA KANTI SAMANTA on Tal

Headline

Data Engineer | Python | SQL | AWS | Scalable ETL & Data Pipelines | PostgreSQL | Elasticsearch | APIs & Automation | Docker | Geospatial Data

About

Tech Professional with 4+ years of industrial experience building scalable systems, and automation frameworks across domains such as IoT, finance, real estate, and manufacturing. Proficient in creating production ready deployable ETL pipelines using Python, API, Database, cloud-native workflows. I also hold good idea in Docker (Containerized/Microservice Solutions), Web Technologies, AI/ML algorithms.

Location

Bengaluru

AI stack

gemini

Work experience

Data Engineer at NAVANC, May 2024 - Present · 2 yrs 4 mos, Bengaluru, Karnataka, India

Data Engineer at Needl.ai, Nov 2023 - May 2024 · 7 mos, Bengaluru, Karnataka, India, • Designed and automated ETL pipelines integrating data from financial exchanges, regulatory APIs, and CRM platforms. • Built fault-tolerant ingestion python algorithms with retries, queue processing, and batch scheduling, ensuring reliability at scale. • Deployed real-time monitoring dashboards with anomaly detection for proactive pipeline issue resolution using Apache Superset. • Improved data quality and consistency via systematic validation across multiple sources saved in PostgreSQL.

Associate Data Scientist at Aditya Birla Management Corporation Pvt Ltd, Mar 2022 - Nov 2023 · 1 yr 9 mos, Bengaluru, Karnataka, India, • Engineered real-time IoT pipelines with Flask APIs, InfluxDB, and Grafana for ingestion, querying, and visualization (ETL). • Designed anomaly detection ai algorithm using SUOD (Scalable Unsupervised Outlier Detection) on time-series voltage data; extracted features using various statistical parameters (kurtosis, skewness, variance, autocorrelation, peak-to-peak amplitude). Detected faulty Electrolyser connections, reducing power losses, costs, and safety risks. • Automated alerts & reporting with self-build Python scheduler jobs; containerized solutions with Docker for production deployment.

Research Engineer at Siemens Technology India, Aug 2021 - Mar 2022 · 8 mos, Bengaluru, Karnataka, India, • Built end-to-end ML pipelines with Flask, InfluxDB, and Docker for real-time inference on time-series data. • Integrated Kafka-based streaming workflows across in-house applications. • Deployed production-ready Dockerized applications with mlFlow, Grafana dashboards, Swagger APIs, and PyArmor for secure delivery. • Developed and Deployed Deep Neural Network Models for regression, classification, anomaly detection, LightGBM Model (ensemble ml algorithm) for classification and exponential smoothing for forecasting on top of IOT data.

Data Scientist at Siemens Technology India, Dec 2020 - Jul 2021 · 8 mos, Bengaluru, Karnataka, India

Education

Master of Technology - MTech, Electrical, Electronics and Communications Engineering, International Institute of Information Technology Bangalore