Data Engineer (Apprentice)| Python & PySpark | SQL | ETL/ELT Pipelines | Airflow | Databricks | AWS

Bengaluru, Karnataka, India

Remote


Remote

Remote






Bachelor of Technology, Computer Science And Engineering
Lingayas Institute Of Management And Technology
Join Grandhi and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossData Engineer (Apprentice)| Python & PySpark | SQL | ETL/ELT Pipelines | Airflow | Databricks | AWS
I am a Data Engineer with experience building scalable ETL/ELT pipelines using Apache Spark, Airflow, Databricks, and Snowflake. I specialize in Python, SQL, automation, and cloud‑native data engineering on AWS. At Nike, I have delivered end-to-end data workflows, integrated O9 with SAP for global supply chain visibility, optimized legacy pipelines for 40% faster execution, and built AI‑driven automation that reduced manual validation effort by 97%. My expertise includes data modeling, data quality frameworks, serverless architectures, and intelligent reporting dashboards using Databricks Genie and AI Copilot. I work across development, staging, and production environments with strong focus on reliability, monitoring, and RCA for Airflow DAGs. Skills: Apache Spark • Airflow • Databricks • PySpark • ETL/ELT • AWS • Snowflake • SQL • Data Modeling • Data Warehousing • Jenkins • GitHub • CI/CD • Python • Automation • Hive • MySQL
Bengaluru
anthropic apis
antigravity
claude
deepseek
gemini
github copilot
Apprentice Software Engineer at Nike, Feb 2025 - Present · 1 yr 8 mos, Bengaluru, Karnataka, India, • Developed AI-driven automation regression suite using Python, PySpark, and Apache Airflow, eliminating 97% of manual validation effort (reduced from 3 hours to 5 minutes). • Architected global inventory data workflows by integrating O9 platform with SAP, improving supply chain visibility and delivery performance. • Refactored legacy ETL pipelines on Hive and SQL, achieving 40% improvement in execution speed and system scalability. • Implemented Spark Expectations framework for data quality validation across development, staging, and production environments. • Built intelligent reporting dashboards using Databricks Genie and AI Copilot, cutting analyst workload by 30%. • Monitored production DAGs in Apache Airflow, performed root cause analysis, and resolved PagerDuty alerts to maintain 99% data availability. • Managed ServiceNow incident tickets for pipeline failures, delivering timely resolution and stakeholder communication. • Streamlined CI/CD deployment processes using Jenkins and GitHub, maintaining code quality and accelerating release cycles. • Collaborated with cross-functional teams to optimize data products, reducing processing runtime by 1–2 hours.
Website Developer at Codolog, Jun 2024 - Jul 2024 · 2 mos, Remote, CogologIntern is a PHP-based web application developed as part of an internship project. It uses HTML and CSS for frontend pages and PHP for server-side logic, likely involving dynamic content like forms, user interaction, and backend functions.
Cyber Security Analyst at International Institute of Digital Technologies, Feb 2024 - May 2024 · 4 mos, Conducted a detailed evaluation of MoD Security’s effectiveness in detecting and preventing SQL injection attacks. MoD Security demonstrated a commendable level of accuracy in identifying SQL injection attempts across various attack scenarios. It exhibited resilience against emerging and sophisticated SQL injection attack vectors. While MoD Security proved effective in mitigating SQL injection attacks, opportunities for optimization were identified
AI-ML at Edunet Foundation, Jun 2023 - Jul 2023 · 2 mos, Remote, Spearheaded the creation of a comprehensive dataset for employee burnout analysis, sourcing and integrating relevant data from various sources including employee surveys and performance metrics. · Applied machine learning algorithms and statistical techniques to analyze the dataset and identify patterns, trends, and potential predictors of employee burnout.
Python Developer at Codegnan, May 2023 - Jul 2023 · 3 mos, Remote, Developed a comprehensive Library Management System from scratch, utilizing a range of web development technologies including: HTML for structuring web pages. CSS for styling and layout. JavaScript for interactive elements and user experience enhancement. SQL for database management and querying. Collaborated closely with team members to brainstorm ideas, troubleshoot issues, and iterate on project improvements. Received positive feedback from supervisors for the quality of work, dedication, and proactive approach towards learning and development.
Bachelor of Technology, Computer Science And Engineering, Lingayas Institute Of Management And Technology