Headline

GCP Data Engineer | BigQuery • DBT • Airflow • Terraform • Teradata | Google Cloud Certified (ACE) | Banking & Regulatory Reporting | Lloyds Banking Group

About

Data Engineer with hands-on experience in supporting end-to-end data pipelines within a banking and regulatory reporting environment. At Lloyds Technology Centre India, I work on ingesting data from multiple source systems into an Group data warehouse using Python-based scheduled ingestion pipelines, ensuring data accuracy, reliability, and timely availability. Post ingestion, I contribute to data transformation and business logic implementation, converting raw datasets into structured, analytics-ready tables that support regulatory and management information (MI) reporting. The transformed datasets are then utilized to generate scheduled regulatory and MI reports, supporting compliance with UK financial regulators and internal governance standards. My role involves extensive use of SQL (Teradata) for complex joins, CTEs, aggregations, and performance optimization, along with Python automation and data quality validation I enjoy working with large datasets, understanding data lineage, and building reliable data foundations that enable accurate reporting and informed decision-making. I am continuously strengthening my skills in data warehousing, cloud data platforms (GCP), and scalable data engineering practices.

Location

Hyderabad

Work experience

Data Engineer at Lloyds Technology Centre India, Dec 2023 - Present · 2 yrs 7 mos, Hyderabad, Telangana, India · Hybrid, GCP Data Engineer working on Open Banking and regulatory data infrastructure at Lloyds Technology Centre India — one of the largest banking tech hubs in the UK. Part of a team responsible for processing 3M–47M records every 2 hours across mission-critical financial pipelines. ▸MI Modernization •Consolidated ~90% of legacy pipelines and APS jobs onto a unified GCP platform using Cloud Composer, Dataflow, Cloud Run, and dbt •orchestrated pipelines replacing tightly-coupled legacy workflows — reducing code complexity by ~40% •Reduced end-to-end pipeline runtime by ~30% through incremental processing and query optimization in BigQuery •Implemented modular dbt transformations (incremental models, tests, snapshots) for analytics-ready datasets •Built Apache Airflow DAGs with dependency management, SLA monitoring and alerting ▸Teradata GDW → BigQuery Migration •Migrated large-scale enterprise datasets from Teradata to BigQuery, enabling cloud-based reporting •Engineered partitioned and clustered BigQuery tables, improving query performance and reducing processing cost •Built automated Python reconciliation framework, reducing manual validation effort by ~70% with 100% data consistency ▸Regulatory Reporting (FCA / CMA / OBIE) •Delivered v4 regulatory reporting via controlled dual-run strategy •Developed transformation logic for new Open Banking regulatory functionality (cVRP) •Led phased decommission of legacy v3.1, ensuring smooth transition to modernized workflows •Contributed to ~£50K annual cost savings •Maintained COBRA-based warehouse scheduling and APS (Automated Python Scheduler) orchestration jobs ▸Data Governance & Lineage •Created and maintained technical data dictionaries, column-level metadata, and end-to-end lineage in Collibra •Recognized by Product Owners for audit-ready documentation that improved governance standards across regulatory datasets 🔷 Awards: Game Changers - 'High Performance' | Game Changers - 'Thank You' | Game Changers - 'Grow-Strategy'

Associate Engineer at Lloyds Technology Centre India, Dec 2023 - Oct 2024 · 11 mos, Hyderabad, Telangana, India · Hybrid, Joined Lloyds as an Associate Engineer, embedded in data platform teams supporting enterprise data pipelines and production-grade reporting systems. • Supported ingestion and validation workflows for regulatory and operational reporting datasets • Worked on SQL-based data extraction and issue resolution, ensuring consistent data flows across source systems • Collaborated with senior data engineers to debug data inconsistencies and maintain pipeline reliability • Gained hands-on exposure to Teradata GDW, Python automation, and enterprise data warehouse architecture

Java Full Stack Developer Trainee Engineer at Palle Technologies, Nov 2022 - May 2023 · 7 mos, Bengaluru, Karnataka, India

Web Development Intern at LetsGrowMore, Nov 2021 - Dec 2021 · 2 mos

Education

B.tech, Computer Science and Engineering, Dr. Babasaheb Ambedkar Technological University

Batchelor in Technology Science and Engineering, Computer Engineering, Dr. Babasaheb Ambedkar Technological University