Data & Ai Engineer | Databricks & PySpark | GenAI & LLM Integration | Medallion Architecture | Certified Databricks GenAI Associate | Power BI

Bengaluru

Coimbatore







Bachelor of Technology - BTech, cse
SRKR Engineering College
Intermediate
tirumala junior college
Join Tarun and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossData & Ai Engineer | Databricks & PySpark | GenAI & LLM Integration | Medallion Architecture | Certified Databricks GenAI Associate | Power BI
Data Engineer & Analytics professional with a proven track record of designing real-time, scalable data pipelines and AI-powered ETL solutions. I specialize in Databricks, PySpark, Delta Lake, and Generative AI integrations. 💡 Core Expertise: • Building robust Medallion Architecture (Bronze → Silver → Gold) pipelines. • Integrating LLM APIs and RAG to process unstructured data. • Orchestrating enterprise workflows using Informatica (IICS & PowerCenter) and AWS S3. • Developing interactive dashboards using Databricks SQL & Power BI. 🏆 Certifications: Databricks Certified Generative AI Engineer Associate. I thrive at the intersection of data infrastructure and artificial intelligence, transforming complex data ecosystems into analytics-ready solutions.
Bengaluru
antigravity
claude code
claude
gemini
openai
Microsoft Copilot
Data engineer at Cognizant, Sep 2024 - Present · 2 y, Bengaluru, Designed and developed Databricks-based data pipelines, including a stateful PySpark Structured Streaming solution using Medallion Architecture for real-time data processing. Built a Generative AI-powered ETL pipeline leveraging LLM APIs to transform unstructured data into structured, analytics-ready datasets stored in Delta Lake. Orchestrated enterprise-scale workflows using Informatica Intelligent Cloud Services (IICS), implementing SCD Type 2 and incremental delta loads to ensure data accuracy and historical tracking. Implemented data governance and security controls, enforcing RBAC via SQL views for fine-grained row- and column-level access on sensitive healthcare datasets. Delivered interactive dashboards and business insights using Databricks SQL and Power BI, improving data-driven decision-making.
Trainee at Cognizant, Nov 2023 - May 2024 · 6 mo, Coimbatore, I have successfully completed the Continuous Skill Development (CSD) program at Cognizant, which was designed to equip me with the essential skills for a successful career in data integration and management. This intensive program included in-depth sessions, hands-on exercises, and project work, allowing me to learn from experienced Cognizant professionals. Throughout the training, I gained proficiency in Informatica PowerCenter, mastering the design, development, and deployment of data integration solutions. My SQL skills were strengthened, enabling effective data querying, manipulation, and transformation within relational databases. Additionally, I acquired expertise in data cleansing, ensuring data quality and integrity throughout integration processes. Using Informatica tools, I can now perform data profiling to analyze quality, patterns, and characteristics, ensuring accurate and reliable business operations. Furthermore, I mastered task scheduling in the Informatica environment, automating and streamlining ETL workflows for efficient project execution. I am excited about the opportunities this program has provided and am confident that it has helped me achieve my career goals. I am dedicated, always eager to learn, and thrive in collaborative environments. Equipped with these skills, I am ready to contribute effectively to projects requiring advanced data management solutions, making a positive impact within the organization.
Bachelor of Technology - BTech, cse, SRKR Engineering College
Intermediate, tirumala junior college