Keval Arora profile photo 1 on Tal

Keval Arora

Senior Data Engineer at TTEC Digital | Expert in Data Pipelines and Analytics

Hyderabad

9+ years of work experience

TTEC Digital
Feb 20233 yrs 6 mosPresent

Hyderabad, Telangana, India

• Designed and built multiple PySpark data pipelines to analyse credit card campaign performance, delivering actionable insights to marketing and risk teams. • Managed end-to-end release, build, and deployment of data pipelines on Azure DevOps and Databricks using Declarative Automation Bundles. • Orchestrated complex, multi-stage data workflows with Apache Airflow across on-premises servers, ensuring reliable scheduling of critical batch jobs. • Monitored pipeline performance and optimised resource allocation to improve cost efficiency and system throughput. • Partnered with data science and analytics teams to deliver clean, well-documented, analytics-ready datasets. • Engineered and tuned complex SQL queries to extract customer behaviour and service-performance KPIs, lifting data accuracy by 20% and improving reporting quality. • Built reusable PySpark templates to accelerate turnaround on ad hoc client data requests. • Standardised Git workflows for code and documentation management, streamlining version control across the team. • Conducted weekly data quality audits and refactored workflows using advanced SQL indexing, Spark data partitioning, and Databricks Z-Order tuning — cutting query execution time by 50% and batch processing time by 60%. • Mentored junior engineers in Spark optimisation, CI/CD best practice, and debugging, reducing onboarding time by 3 weeks and lifting code quality through structured peer review.
Calsoft
Oct 20224 mosJan 2023

Kolkata, West Bengal, India

• Developed Python-based WebSocket programs for SD-WAN network modules. • Built unit test coverage using Pytest to strengthen release reliability.
Optum
Jun 20193 yrs 4 mosSep 2022

Gurugram, Haryana, India

• Designed automation frameworks to parse and validate COBOL flat files using Python, Pandas, and Py3270. • Built data pipelines migrating data from IBM DB2 to MySQL using Python, Pandas, SQLAlchemy, Spark, and Kubernetes CronJobs. • Developed full and incremental reconciliation and reporting pipelines across multiple database systems using Python, Pandas, and Spark. • Implemented CI/CD deployment pipelines with Docker, Kubernetes, and Apache Airflow on on-premises infrastructure. • Integrated SonarQube into the pipeline for code compliance and security scanning. • Implemented centralised logging and monitoring using Splunk. • Authored unit tests for DataFrame transformations and database mocking to strengthen test coverage. • Led proof-of-concept initiatives to assess system performance and scalability under load.
Tata Consultancy Services
Nov 20162 yrs 8 mosJun 2019

Kolkata, West Bengal, India

• Authored Natural and COBOL programs and interfaces to integrate SAP subsystem data as part of a supply chain transformation project. • Performed data analysis against SQL/DB2 relational databases using QMF. • Reconciled data between SAP and Mainframe systems using Python and Pandas. • Tested and debugged mainframe applications using Xpeditor. • Managed package deployments using Endeavor. • Enhanced COBOL programs to implement core business logic changes. • Built JCL job scripts to automate flat file sorting and COBOL program execution.
Stellar Information Technology Pvt. Ltd.
Jun 20152 mosJul 2015

On-site

Software Test Engineer.

Education

chhattisgarh swami vivekanand technical university

Bachelor of Engineering - BE, Electrical, Electronics and Communications Engineering

chhattisgarh swami vivekanand technical university

20124 yrs2016

M.C.K.V

20092 yrs2011

Join Keval and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Keval Arora on Tal

Headline

Senior Data Engineer at TTEC Digital | Expert in Data Pipelines and Analytics

About

Senior Data Engineer with 9+ years designing, building, and optimising large-scale big data and cloud data platforms for global clients in the Healthcare and Banking sectors — industries where data governance and quality standards are closely regulated. Proven record delivering high-performance ETL/ELT pipelines on Azure and Databricks, modernising legacy IBM Mainframe systems, and driving measurable gains in data accuracy, processing speed, and cost efficiency within enterprise and GCC environments. Skilled in Apache Spark, PySpark, and Airflow-based workflow orchestration, with hands-on experience standardising CI/CD practices and mentoring engineering teams. Seeking a Senior Data Engineer role where this experience can drive scalable, high-impact data platforms.

Location

Hyderabad

Work experience

Senior Data Engineer at TTEC Digital, Feb 2023 - Present · 3 yrs 6 mos, Hyderabad, Telangana, India, • Designed and built multiple PySpark data pipelines to analyse credit card campaign performance, delivering actionable insights to marketing and risk teams. • Managed end-to-end release, build, and deployment of data pipelines on Azure DevOps and Databricks using Declarative Automation Bundles. • Orchestrated complex, multi-stage data workflows with Apache Airflow across on-premises servers, ensuring reliable scheduling of critical batch jobs. • Monitored pipeline performance and optimised resource allocation to improve cost efficiency and system throughput. • Partnered with data science and analytics teams to deliver clean, well-documented, analytics-ready datasets. • Engineered and tuned complex SQL queries to extract customer behaviour and service-performance KPIs, lifting data accuracy by 20% and improving reporting quality. • Built reusable PySpark templates to accelerate turnaround on ad hoc client data requests. • Standardised Git workflows for code and documentation management, streamlining version control across the team. • Conducted weekly data quality audits and refactored workflows using advanced SQL indexing, Spark data partitioning, and Databricks Z-Order tuning — cutting query execution time by 50% and batch processing time by 60%. • Mentored junior engineers in Spark optimisation, CI/CD best practice, and debugging, reducing onboarding time by 3 weeks and lifting code quality through structured peer review.

Senior Software Engineer at Calsoft, Oct 2022 - Jan 2023 · 4 mos, Kolkata, West Bengal, India, • Developed Python-based WebSocket programs for SD-WAN network modules. • Built unit test coverage using Pytest to strengthen release reliability.

Software Engineer at Optum, Jun 2019 - Sep 2022 · 3 yrs 4 mos, Gurugram, Haryana, India, • Designed automation frameworks to parse and validate COBOL flat files using Python, Pandas, and Py3270. • Built data pipelines migrating data from IBM DB2 to MySQL using Python, Pandas, SQLAlchemy, Spark, and Kubernetes CronJobs. • Developed full and incremental reconciliation and reporting pipelines across multiple database systems using Python, Pandas, and Spark. • Implemented CI/CD deployment pipelines with Docker, Kubernetes, and Apache Airflow on on-premises infrastructure. • Integrated SonarQube into the pipeline for code compliance and security scanning. • Implemented centralised logging and monitoring using Splunk. • Authored unit tests for DataFrame transformations and database mocking to strengthen test coverage. • Led proof-of-concept initiatives to assess system performance and scalability under load.

System Engineer at Tata Consultancy Services, Nov 2016 - Jun 2019 · 2 yrs 8 mos, Kolkata, West Bengal, India, • Authored Natural and COBOL programs and interfaces to integrate SAP subsystem data as part of a supply chain transformation project. • Performed data analysis against SQL/DB2 relational databases using QMF. • Reconciled data between SAP and Mainframe systems using Python and Pandas. • Tested and debugged mainframe applications using Xpeditor. • Managed package deployments using Endeavor. • Enhanced COBOL programs to implement core business logic changes. • Built JCL job scripts to automate flat file sorting and COBOL program execution.

Intern at Stellar Information Technology Pvt. Ltd., Jun 2015 - Jul 2015 · 2 mos, On-site, Software Test Engineer.

Education

Bachelor of Engineering - BE, Electrical, Electronics and Communications Engineering, chhattisgarh swami vivekanand technical university

M.C.K.V

Keval Arora - Senior Data Engineer in Hyderabad | Tal