Headline

Associate Software Engineer, Data & AI, Red Hat.

About

Data and AI Engineer with a Master’s in Operational Research and a Bachelor’s in Statistics, combining a strong analytical foundation with hands-on expertise in building scalable data pipelines (Python, SQL), managing Snowflake infrastructure, and designing dimensional models using dbt. Proficient in workflow orchestration via Apache Airflow, CI/CD-integrated data validation frameworks, and end-to-end AI/ML deployments incorporating RAG architectures, LLMs, and VectorDB systems. A creative technologist and avid harmonica player, he leverages a commitment to continuous learning and innovation to deliver production-grade data products with automated quality monitoring, driving measurable improvements in data reliability and user satisfaction.

Location

Greater Bengaluru Area

AI stack

claude code

claude

gemini

langchain

mcp

githubcopilot

Work experience

Associate Software Engineer at Red Hat, Dec 2024 - Present · 1 yr 10 mos, Bengaluru, •Build and optimize scalable data pipelines using Python and SQL for enterprise data processing. •Maintain Snowflake data warehouse infrastructure, ingest enterprise sources via Fivetran, design and maintain dimensional data models using dbt, with documentation and tests for analytics and reporting. •Orchestrate complex workflows using Apache Airflow (Astro) with DAGs for automated data processing. •Built ValidX, a data validation framework (Python, YAML, Snowflake) with multi-env support, CI/CD integration (GitLab/GitHub), Slack alerts, and optional LLM-based failure summarization and root-cause hints. •Built an agentic on-call RCA system for data products: LangGraph agent + MCP tools that resolve Atlan assets, sync dbt manifests, and auto-trace column lineage through compiled SQL to root-cause data quality incidents.

Trainee at Red Hat, Jun 2024 - Dec 2024 · 7 mos, Bangalore Urban, -Developed an AI-powered Training Foundation Builder leveraging the Retrieval-Augmented Generation (RAG) approach to generate baseline training content, enabling training and enablement teams to kickstart their content creation process efficiently. -Integrated a chatbot with advanced conversation and session handling features, providing users with real-time assistance and a seamless interactive experience. -Designed the application with an intuitive user interface (UI) to simplify usage for non-technical users, enhancing accessibility and adoption.

Subject Matter Expert at Chegg India, Nov 2021 - Dec 2022 · 1 yr 2 mos, Submitted detailed solutions to queries from international students. Maintained Chegg’s honor code and consistently achieved high answer quality scores. Provided timely responses to student inquiries, ensuring customer satisfaction. Collaborated with a team of experts to address complex academic questions efficiently.

Education

Masters, Operational Research, Delhi University

Bachelor's degree, Statistics, University of Calcutta

Public links

github: https://github.com/aBiR1D

abir1d.github.io: https://abir1d.github.io/