Headline

Data & AI @ Microsoft

About

Senior Data & AI Platform Engineer with 12+ years of experience designing enterprise-scale data platforms, lakehouse architectures, ETL/ELT pipelines, cloud migrations, and AI-powered analytics solutions. Expertise in Azure Databricks, Apache Spark (PySpark/Scala), Python, SQL, Azure, AWS, GCP, Delta Lake, data modeling, performance optimization, distributed systems, and data governance. Proven experience delivering AI agents, LLM-powered applications, OpenAI integrations, ML model validation, and scalable analytics platforms that improve business outcomes. My core competencies include AI enabling data pipelines, agentic AI, agent development, Spark and Hadoop development, SQL writing and optimization, RCA and process improvement, and data analysis. I have successfully applied these skills to various projects for clients such as Goldman Sachs, American Express, ABN AMRO, Volvo Cars, and Renault Trucks, delivering high-quality results and earning recognition and awards for my performance and dedication. I am passionate about innovation, learning, and solving complex data challenges that create value and impact for the business and the society.

Location

Noida

AI stack

anthropic apis

antigravity

claude code

cursor

elevenlabs

langchain

Work experience

Senior Data Engineer at Microsoft, Mar 2026 - Present · 7 mos, Developed DashBot, an AI-based self-serve data analytics platform that automates the end-to-end pipeline from source systems to the reporting layer, cutting report delivery time from days to minutes. Won the Microsoft CampAIR Fix Hack Learn hackathon 2026 and adopted for a production use case. Driving migration of legacy Cosmos workloads to Azure Databricks, modernising Xbox data pipelines onto a Spark-based platform. Developing AI agents and agentic AI workflows to automate data operations, analytics and internal tooling. Owning data architecture decisions across Xbox data domains, covering data modelling, platform design and standards. Delivering reporting and observability through Power BI dashboards and Grafana monitoring, working across C#, Python and SQL.

Manager Data Engineering at Publicis Sapient, Mar 2025 - Present · 1 yr 7 mos, Project: Goldman Sachs, USA

Lead Consultant - Data Engineering at Xebia, Jan 2024 - Feb 2025 · 1 yr 2 mos, Project: Dunnhumby, UK

Senior Data Engineer at IBM, Oct 2021 - Jan 2024 · 2 yrs 4 mos, India, Project: American Express, USA

Big Data Specialist at HCL Technologies, Sep 2018 - Oct 2021 · 3 yrs 2 mos, Noida Area, India, Project: Volvo Cars & Renault Trucks, France

Education

Bachelor of Technology (BTech), Electrical and Electronics Engineering, BABU BANARASI DAS NORTHERN INDIA INSTITUTE OF TECHNOLOGY, LUCKNOW

Generative AI Nanodegree (Bertelsmann Next Generation Tech Booster Scholarship), Udacity

Public links

github: https://github.com/krishnakaanchan-png