Data Engineer | Azure Databricks, PySpark, AWS, SQL | Medallion Architecture & Data Governance | Generative AI

Gurugram

Bengaluru

Bhilai, Chhattisgarh, India





Bachelor of Technology - BTech, Mechanical Engineering
Dayananda Sagar College of Engineering, BANGALORE
12th, PCM
Career Point Gurukul
Join Nikhil and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossData Engineer | Azure Databricks, PySpark, AWS, SQL | Medallion Architecture & Data Governance | Generative AI
Data Engineer and Governance Analyst with over 2 years of experience building enterprise-scale data platforms and analytics solutions. Strong expertise in implementing Medallion Architecture (Bronze/Silver/Gold) pipelines on Databricks, orchestrating complex ETL/ELT workflows, and enforcing strict data security through Row-Level and Column-Level Security (RLS/CLS). Beyond core data operations, I am a certified Generative AI Engineer with applied expertise in Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Agentic AI using MCPs. I am passionate about leveraging PySpark, Python and SQL to build scalable, reliable, and intelligent data solutions that drive actionable business decision-making. SKILLS: Data Engineering & Architecture: Databricks, Medallion Architecture (Bronze/Silver/Gold), Delta Lake, ETL/ELT Pipeline Design, AWS S3, Data Warehousing. Programming & Databases: Python, PySpark, SQL, Pandas, NumPy. AI & Emerging Tech: Generative AI, LLMs, RAG, Agentic AI with MCPs, Prompt Engineering, NLP concepts, LangChain. Data Governance & Security: Row-Level Security (RLS), Column-Level Security (CLS), Data Quality Validation, Root Cause Analysis. Analytics & Visualization: Power BI, Exploratory/Diagnostic Analytics, Dashboard Monitoring. CERTIFICATIONS: Databricks Certified Data Engineer Associate Databricks Certified Generative AI Engineer Associate Claude Certified Architect - Foundations Reinvention with Agentic AI Learning Program ADDITIONAL INFORMATION: Proven track record of managing enterprise incidents, performing root-cause analysis (RCA), and maintaining 100% SLA compliance. Strong cross-functional collaboration skills, independently leading client interactions to translate complex data findings into technical solutions. Committed to continuous learning and integrating cutting-edge AI architectures into traditional data engineering workflows.
Gurugram
claude code
claude
gemini
ChatGPT
Data Engineering & Governance Analyst at Accenture, Jun 2026 - Present · 5 mos, Gurugram, Designed and implemented Medallion Architecture data pipelines on Databricks, extracting raw data from AWS S3 buckets and transforming it through Bronze (raw ingestion) → Silver (DQ checks and cleansing) → Gold (business-ready aggregates) layers. Developed PySpark and Python code to automate data extraction from AWS S3, implement multi-stage transformations, and establish data quality validation checks between Bronze and Silver layers to ensure data consistency and integrity. Built end-to-end ETL/ELT workflows in Databricks, orchestrating data movement across Medallion Architecture layers and deploying cleansed, validated datasets for downstream analytics and business consumption. Independently implemented Row-Level Security (RLS) and Column-Level Security (CLS) using SQL on Databricks, securing sensitive data access across enterprise tables and views. Led 10-15 cross-functional client calls per month, translating complex data findings into actionable business decisions for stakeholders. Performed exploratory and diagnostic analytics on large-scale datasets using SQL-based transformations and statistical analysis to support data-driven decision-making. Managed 15-25 incidents, service requests, and CRQs monthly while maintaining 100% SLA compliance. Conducted root-cause analysis (RCA) on critical pipeline failures, identifying systemic issues and implementing corrective actions that reduced recurrence. Monitored operational Power BI dashboards daily, tracking key metrics and flagging data anomalies for timely escalation. Maintained comprehensive documentation of data pipelines, architecture, and governance frameworks for audit and compliance readiness.
Data Eng, Mgmt and Governance Associate at Accenture, Apr 2024 - May 2026 · 2 yrs 2 mos, Bengaluru, Completed structured onboarding on Databricks platform workflows, ETL pipeline design, and data governance frameworks within first 3 months. Supported implementation of RLS and CLS using SQL on Databricks, assisting senior engineers in securing sensitive data access across tables and views. Assisted in monitoring and triaging 10-20 incidents and service requests monthly, troubleshooting data-related issues and contributing to timely resolution. Collaborated with cross-functional teams to maintain data process documentation and supported knowledge transfer during project onboarding and transitions.
Internship Trainee at Steel Authority of India Limited, Sep 2022 - Oct 2022 · 2 mos, Bhilai, Chhattisgarh, India, Internship Trainee In Bar and Rod Mill, In Bhillai Steel Plant.
Bachelor of Technology - BTech, Mechanical Engineering, Dayananda Sagar College of Engineering, BANGALORE
12th, PCM, Career Point Gurukul