Deepak K. profile photo 1 on Tal

Deepak K.

Data Engineer || PySpark || Python || BigQuery || AWS || ETL/ELT || Data Pipelines

Bengaluru

3+ years of work experience

Vedantu
Sep 20242 yrs 2 mosPresent

Bengaluru, Karnataka, India

• Designed and maintained scalable real-time data pipelines using Python, SQL, PySpark, Kafka, Airflow, AWS S3, and BigQuery. • Developed event-driven ETL/ELT workflows to process customer activity and support business operations. • Built configurable business rule and data transformation pipelines for automated processing. • Created analytical data models and optimized SQL queries for business reporting and customer insights. • Partnered with cross-functional teams to deliver reliable, scalable, and high-performance data solutions.
Vedantu
Sep 20242 yrs 2 mosPresent

•Built a Real-Time Lead Distribution Platform, reducing lead assignment time from 2–3 hours to under 1 minute. •Built event-driven ETL pipelines using Python, PySpark, Kafka, SQL, REST APIs, and LeadSquared CRM, processing 100K+ events and 20K+ leads daily. •Developed a Lead Scoring & Qualification Engine with 20+ configurable business rules, automating lead validation, scoring, and assignment. •Designed scalable data models for lead distribution, customer activity, and lead history, processing 20–50 GB of data daily and storing datasets in AWS S3. •Orchestrated Apache Airflow workflows and built BigQuery datasets, enabling near real-time reporting for 200+ sales agents and reducing manual lead assignment effort by 85%.
Vedantu
Mar 20246 mosAug 2024

Bengaluru, Karnataka, India

• Optimized SQL queries on Amazon Redshift to improve reporting performance. • Automated business reports using Python, SQL, and PySpark, enabling data refresh every 2 hours. • Built ETL pipelines for lead, sales, and collection reporting. • Analyzed key business metrics including Lead Generation, Collection, RPL, CVR, and marketing performance. • Collaborated with Business Planning, CRM, and Marketing teams to deliver data-driven insights.
Vlippr
Oct 20236 mosMar 2024

Remote

Accelerated Data Extraction, Enhanced System Efficiency, Optimized Data Storage & Technical Proficiencies: Experienced with AWS S3, Azure, PySpark, SQL, data validation, and advanced algorithms (LSTM, RNNs, CNNs)

Deepak’s AI Stack

claude code
claude code
deepseek
deepseek
notebooklm
notebooklm
notion
notion
openai
openai

Education

Reva University

M.Sc, Data Science

Reva University

20212 yrs2023
magadh university

B.Sc, Mathematics

magadh university

20173 yrs2020

Join Deepak and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Deepak K. on Tal

Headline

Data Engineer || PySpark || Python || BigQuery || AWS || ETL/ELT || Data Pipelines

About

As strong self-motivated Data Engineer with over 2+ years of experience in building scalable data pipelines, backend systems, and data platforms. I specialize in designing and developing ETL/ELT pipelines, data migration, and large-scale data processing using technologies like PySpark, Snowflake, BigQuery, and Databricks. I have hands-on experience working across AWS environments, focusing on data modeling, workflow orchestration, and performance optimization. I am passionate about building reliable, scalable, and efficient data systems that enable business insights. Skills: Python, SQL, PySpark, Airflow, Snowflake, BigQuery, Databricks, AWS, MySql, DBT, Github ,Gitlab, Governance and Security

Location

Bengaluru

AI stack

claude code

deepseek

notebooklm

notion

openai

Work experience

Analytics Engineer at Vedantu, Sep 2024 - Present · 2 yrs 2 mos, Bengaluru, Karnataka, India, • Designed and maintained scalable real-time data pipelines using Python, SQL, PySpark, Kafka, Airflow, AWS S3, and BigQuery. • Developed event-driven ETL/ELT workflows to process customer activity and support business operations. • Built configurable business rule and data transformation pipelines for automated processing. • Created analytical data models and optimized SQL queries for business reporting and customer insights. • Partnered with cross-functional teams to deliver reliable, scalable, and high-performance data solutions.

Data Engineer at Vedantu, Sep 2024 - Present · 2 yrs 2 mos, •Built a Real-Time Lead Distribution Platform, reducing lead assignment time from 2–3 hours to under 1 minute. •Built event-driven ETL pipelines using Python, PySpark, Kafka, SQL, REST APIs, and LeadSquared CRM, processing 100K+ events and 20K+ leads daily. •Developed a Lead Scoring & Qualification Engine with 20+ configurable business rules, automating lead validation, scoring, and assignment. •Designed scalable data models for lead distribution, customer activity, and lead history, processing 20–50 GB of data daily and storing datasets in AWS S3. •Orchestrated Apache Airflow workflows and built BigQuery datasets, enabling near real-time reporting for 200+ sales agents and reducing manual lead assignment effort by 85%.

Data Analyst at Vedantu, Mar 2024 - Aug 2024 · 6 mos, Bengaluru, Karnataka, India, • Optimized SQL queries on Amazon Redshift to improve reporting performance. • Automated business reports using Python, SQL, and PySpark, enabling data refresh every 2 hours. • Built ETL pipelines for lead, sales, and collection reporting. • Analyzed key business metrics including Lead Generation, Collection, RPL, CVR, and marketing performance. • Collaborated with Business Planning, CRM, and Marketing teams to deliver data-driven insights.

Data Science Intern at Vlippr, Oct 2023 - Mar 2024 · 6 mos, Remote, Accelerated Data Extraction, Enhanced System Efficiency, Optimized Data Storage & Technical Proficiencies: Experienced with AWS S3, Azure, PySpark, SQL, data validation, and advanced algorithms (LSTM, RNNs, CNNs)

Education

M.Sc, Data Science, Reva University

B.Sc, Mathematics, magadh university