Tarun TEJA Y profile photo 1 on Tal

Tarun TEJA Y

Data & Ai Engineer | Databricks & PySpark | GenAI & LLM Integration | Medallion Architecture | Certified Databricks GenAI Associate | Power BI

Bengaluru

2+ years of work experience

Cognizant
Sep 20242 yPresent

Bengaluru

Designed and developed Databricks-based data pipelines, including a stateful PySpark Structured Streaming solution using Medallion Architecture for real-time data processing. Built a Generative AI-powered ETL pipeline leveraging LLM APIs to transform unstructured data into structured, analytics-ready datasets stored in Delta Lake. Orchestrated enterprise-scale workflows using Informatica Intelligent Cloud Services (IICS), implementing SCD Type 2 and incremental delta loads to ensure data accuracy and historical tracking. Implemented data governance and security controls, enforcing RBAC via SQL views for fine-grained row- and column-level access on sensitive healthcare datasets. Delivered interactive dashboards and business insights using Databricks SQL and Power BI, improving data-driven decision-making.
Cognizant
Nov 20236 moMay 2024

Coimbatore

I have successfully completed the Continuous Skill Development (CSD) program at Cognizant, which was designed to equip me with the essential skills for a successful career in data integration and management. This intensive program included in-depth sessions, hands-on exercises, and project work, allowing me to learn from experienced Cognizant professionals. Throughout the training, I gained proficiency in Informatica PowerCenter, mastering the design, development, and deployment of data integration solutions. My SQL skills were strengthened, enabling effective data querying, manipulation, and transformation within relational databases. Additionally, I acquired expertise in data cleansing, ensuring data quality and integrity throughout integration processes. Using Informatica tools, I can now perform data profiling to analyze quality, patterns, and characteristics, ensuring accurate and reliable business operations. Furthermore, I mastered task scheduling in the Informatica environment, automating and streamlining ETL workflows for efficient project execution. I am excited about the opportunities this program has provided and am confident that it has helped me achieve my career goals. I am dedicated, always eager to learn, and thrive in collaborative environments. Equipped with these skills, I am ready to contribute effectively to projects requiring advanced data management solutions, making a positive impact within the organization.

Tarun’s AI Stack

antigravity
antigravity
claude code
claude code
claude
claude
gemini
gemini
openai
openai
Microsoft Copilot
Microsoft Copilot

Education

SRKR Engineering College

Bachelor of Technology - BTech, cse

SRKR Engineering College

20194 yrs2023

Intermediate

tirumala junior college

20172 yrs2019

Join Tarun and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Tarun TEJA Y on Tal

Headline

Data & Ai Engineer | Databricks & PySpark | GenAI & LLM Integration | Medallion Architecture | Certified Databricks GenAI Associate | Power BI

About

Data Engineer & Analytics professional with a proven track record of designing real-time, scalable data pipelines and AI-powered ETL solutions. I specialize in Databricks, PySpark, Delta Lake, and Generative AI integrations. 💡 Core Expertise: • Building robust Medallion Architecture (Bronze → Silver → Gold) pipelines. • Integrating LLM APIs and RAG to process unstructured data. • Orchestrating enterprise workflows using Informatica (IICS & PowerCenter) and AWS S3. • Developing interactive dashboards using Databricks SQL & Power BI. 🏆 Certifications: Databricks Certified Generative AI Engineer Associate. I thrive at the intersection of data infrastructure and artificial intelligence, transforming complex data ecosystems into analytics-ready solutions.

Location

Bengaluru

AI stack

antigravity

claude code

claude

gemini

openai

Microsoft Copilot

Work experience

Data engineer at Cognizant, Sep 2024 - Present · 2 y, Bengaluru, Designed and developed Databricks-based data pipelines, including a stateful PySpark Structured Streaming solution using Medallion Architecture for real-time data processing. Built a Generative AI-powered ETL pipeline leveraging LLM APIs to transform unstructured data into structured, analytics-ready datasets stored in Delta Lake. Orchestrated enterprise-scale workflows using Informatica Intelligent Cloud Services (IICS), implementing SCD Type 2 and incremental delta loads to ensure data accuracy and historical tracking. Implemented data governance and security controls, enforcing RBAC via SQL views for fine-grained row- and column-level access on sensitive healthcare datasets. Delivered interactive dashboards and business insights using Databricks SQL and Power BI, improving data-driven decision-making.

Trainee at Cognizant, Nov 2023 - May 2024 · 6 mo, Coimbatore, I have successfully completed the Continuous Skill Development (CSD) program at Cognizant, which was designed to equip me with the essential skills for a successful career in data integration and management. This intensive program included in-depth sessions, hands-on exercises, and project work, allowing me to learn from experienced Cognizant professionals. Throughout the training, I gained proficiency in Informatica PowerCenter, mastering the design, development, and deployment of data integration solutions. My SQL skills were strengthened, enabling effective data querying, manipulation, and transformation within relational databases. Additionally, I acquired expertise in data cleansing, ensuring data quality and integrity throughout integration processes. Using Informatica tools, I can now perform data profiling to analyze quality, patterns, and characteristics, ensuring accurate and reliable business operations. Furthermore, I mastered task scheduling in the Informatica environment, automating and streamlining ETL workflows for efficient project execution. I am excited about the opportunities this program has provided and am confident that it has helped me achieve my career goals. I am dedicated, always eager to learn, and thrive in collaborative environments. Equipped with these skills, I am ready to contribute effectively to projects requiring advanced data management solutions, making a positive impact within the organization.

Education

Bachelor of Technology - BTech, cse, SRKR Engineering College

Intermediate, tirumala junior college