Velidi venkata Ajay Raj profile photo 1 on Tal

Velidi venkata Ajay Raj

Immediate joiner | Ex - Genpact | Data Engineer | 3X DATABRICKS Certified | AWS Certified | Python | SQL | PySpark

Bengaluru

1+ year of work experience

GENPACT
Oct 20241 yr 3 mosDec 2025

Bengaluru, Karnataka, India

Migrated Source of Truth (SOT) tables from old systems like Greenplum and Talend to Databricks Delta Lake tables. This involved converting schemas from PostgreSQL to Spark SQL while keeping the business logic intact and improving query performance. • Designed and built reliable, scalable ETL pipelines using the Medallion Architecture (Bronze, Silver, Gold). These pipelines utilized batch processing and change data capture (CDC) for incremental loads on large datasets. • Played a key role in the full migration of over 350 complex tables from legacy databases to Databricks. This effort led to cost savings and better analytics downstream. • Optimized Databricks jobs, cluster settings, and Spark SQL queries to enhance performance, cut execution time, and manage compute costs. • Developed and added thorough data quality checks, including schema validation, null handling, and deduplication across all layers to ensure data accuracy. • Actively monitored production Airflow Directed Acyclic Graphs (DAGs) and workflows, conducting root cause analysis and resolving failures or performance problems to keep the pipeline reliable. • Provided fixes for defects and support during migration, system integration testing (SIT), user acceptance testing (UAT), and ongoing production tasks. • Managed and updated metadata for data outgestion queries, ensuring smooth data flow and better pipeline visibility.
GENPACT
Feb 20246 mosJul 2024

Bengaluru, Karnataka, India

GitHub
@ajayrajvelidi

Education

kalasalingam University

Bachelor of Engineering - BE, Computer Science

kalasalingam University

20204 yrs2024

Intermediate, Maths physics and chemistry

Sasi new gen junior college

20182 yrs2020

Join Velidi and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Velidi venkata Ajay Raj on Tal

Headline

Immediate joiner | Ex - Genpact | Data Engineer | 3X DATABRICKS Certified | AWS Certified | Python | SQL | PySpark

About

Business Analyst with a passion for AI and data-driven solutions. I thrive on leveraging artificial intelligence to optimize workflows, drive insights, and bridge the gap between business needs and technology. Always exploring innovative ways AI can transform decision-making and create impact.

Location

Bengaluru

Work experience

Data Engineer at GENPACT, Oct 2024 - Dec 2025 · 1 yr 3 mos, Bengaluru, Karnataka, India, Migrated Source of Truth (SOT) tables from old systems like Greenplum and Talend to Databricks Delta Lake tables. This involved converting schemas from PostgreSQL to Spark SQL while keeping the business logic intact and improving query performance. • Designed and built reliable, scalable ETL pipelines using the Medallion Architecture (Bronze, Silver, Gold). These pipelines utilized batch processing and change data capture (CDC) for incremental loads on large datasets. • Played a key role in the full migration of over 350 complex tables from legacy databases to Databricks. This effort led to cost savings and better analytics downstream. • Optimized Databricks jobs, cluster settings, and Spark SQL queries to enhance performance, cut execution time, and manage compute costs. • Developed and added thorough data quality checks, including schema validation, null handling, and deduplication across all layers to ensure data accuracy. • Actively monitored production Airflow Directed Acyclic Graphs (DAGs) and workflows, conducting root cause analysis and resolving failures or performance problems to keep the pipeline reliable. • Provided fixes for defects and support during migration, system integration testing (SIT), user acceptance testing (UAT), and ongoing production tasks. • Managed and updated metadata for data outgestion queries, ensuring smooth data flow and better pipeline visibility.

Intern at GENPACT, Feb 2024 - Jul 2024 · 6 mos, Bengaluru, Karnataka, India

Education

Bachelor of Engineering - BE, Computer Science, kalasalingam University

Intermediate, Maths physics and chemistry, Sasi new gen junior college

Public links

github: https://github.com/ajayrajvelidi

Velidi venkata Ajay Raj - Data Engineer in Bengaluru | Tal