Headline

Software Engineer III@Walmart | Ex-BBI

About

🚀 Data Engineer | Building Scalable Data Solutions Hi, I’m Basudev Chhotaray, a Data Engineer with 5+ years of experience in designing, developing, and optimizing scalable data solutions. I enjoy working with data at scale and building reliable pipelines that transform complex data into meaningful, actionable insights. 🛠️ Technical Expertise My experience includes working with Python, Apache Spark, PySpark, SQL, Apache Airflow, AWS, GCP and Azure. I specialize in developing scalable ETL/ELT pipelines, optimizing data processing workflows, and building data infrastructure with a strong focus on performance, reliability, data quality, and maintainability. 💡 Continuous Learner Data engineering is a constantly evolving field, and I believe continuous learning is essential. I actively explore new technologies, tools, and engineering practices to strengthen my skills and stay current with the industry. I also enjoy sharing knowledge, solving technical challenges, and connecting with others in the technology community. 🤝 What I Enjoy I’m passionate about solving real-world data problems, improving existing data platforms, and collaborating with cross-functional teams to deliver impactful solutions. I’m always open to learning, discussing technology, and exploring new opportunities in the data and technology space.

Location

Bengaluru

AI stack

claude code

gemini

ChatGPT

Microsoft Copilot

Work experience

Software Engineer III at Walmart Global Tech, Jun 2024 - Present · 2 yrs 5 mos, Bengaluru, Karnataka, India

Data Engineer at BBI, Jan 2021 - Mar 2024 · 3 yrs 3 mos, Bengaluru, Karnataka, India, - Lead the creation, monitoring, and upkeep of complete data pipelines, ensuring smooth integration and processing of data. - Work closely with teams across different functions to grasp business needs and transform them into reliable data solutions. - Design and maintain an efficient structure for data pipelines, following the best standards for security, scalability, and performance. - Use Python and Apache Spark (PySpark) in a distributed setting to craft applications for processing data. - Effectively manage various data origins, such as CSV files with diverse structures, and import them into Amazon RDS for further examination. - Establish and oversee data workflows utilizing Apache Airflow, Git version control, and AWS services. - Apply Spark SQL for intricate queries on Spark DataFrames, speeding up data processing and facilitating quicker insights extraction. - Actively research and assess emerging technologies and frameworks to improve data engineering capabilities.

Education

Master's Degree, MCA, Utkal University

Bachelor's Degree, BCA, Berhampur University

Public links

linkedin.com: https://www.linkedin.com/in/basudev-chhotaray-a1757290