How Amazon's Shopping Assistant Uses RAG: Query Planning, Retrieval, Generation

Bashiri Smith · Facebook reel · 2026-09-15 · 1:06 · 3,087 views · Open on Facebook

Topics: Retrieval-Augmented Generation (RAG), AI System Design & Architecture · Level: beginner

Summary

A real-world case study of how Amazon's shopping assistant answers product questions like "Are these shoes good for hiking in the rain?" using retrieval-augmented generation. The pipeline has three stages: query planning, gathering evidence from the product catalog, reviews and community Q&A, and generation. The main engineering lesson is that different questions need different evidence. Retrieving the right context is the most important step, because the model can still struggle when it gets the wrong context.

Key points

• RAG is needed because the model must know about specific products, and those details may not be in its training data.
• Step 1 – Query planning: a separate model interprets the shopper's question to improve retrieval.
• Step 2 – Retrieval/evidence gathering: pull relevant data from Amazon's product catalog, customer reviews, and community Q&A.
• Different sources answer different parts of a question: specs say whether shoes are advertised as waterproof, and reviews say whether customers' feet actually stayed dry.
• Step 3 – Generation: the retrieved information becomes context for the LLM, which then answers the question.
• Different questions need different evidence, so route retrieval to the sources that actually answer the user's question.
• Retrieving the right information is the most important step. Even a strong model struggles when given the wrong context.

Resources mentioned

• The Complete AI Engineer Roadmap for 2026 (Exact Courses + Step-by-Step) · video · youtube.com · free
  Bashiri Smith's free YouTube training on upgrading your skills and becoming competitive for AI engineering roles, with specific courses listed step by step.
  Also in: SWE-to-AI Engineer Plan for 2027: LLMs, RAG, Agents, Evals, Job Search (Bashiri Smith on Facebook · notes), Pointer to Bashiri Smith's Complete AI Engineer Roadmap for 2026 (Bashiri Smith on Facebook · notes), Step-by-Step Roadmap to a $200K+ AI Engineering Role (Bashiri Smith on Facebook · notes), Software Engineer to AI Engineer Before 2027: A 5-Step Career Plan (Bashiri Smith on Facebook · notes) and 19 more
• BASWE.Ai Engineer (Skool community) · community · skool.com · paid
  The creator's paid community and program, with an AI learning roadmap (including the full ops and evaluation track), daily calls with engineers and recruiters, resume and portfolio help, and a job-search pipeline.
  Also in: Basic RAG Pipeline in 60 Seconds: From Documents to Grounded Answers (Bashiri Smith on Facebook · notes), Pointer to Bashiri Smith's Complete AI Engineer Roadmap for 2026 (Bashiri Smith on Facebook · notes), Step-by-Step Roadmap to a $200K+ AI Engineering Role (Bashiri Smith on Facebook · notes), How to Evaluate a RAG Pipeline: Retrieval vs. Generation (Interview Answer) (Bashiri Smith on Facebook · notes) and 76 more
• Amazon Rufus (AI shopping assistant) · article · amazon.science · free
  Amazon Science's write-up of how Rufus, Amazon's AI shopping assistant, uses RAG over the catalog, reviews and community Q&A - a real-world RAG case study.

Try this

• When building a RAG system, check that the information you retrieve actually answers the user's question.
• Match each type of question to the evidence source that answers it (e.g., specs vs. reviews vs. Q&A).
• Watch the creator's full AI engineering roadmap video.
• Comment "shoes" on the video to receive the roadmap and community links.
• Build a product Q&A assistant that uses query planning, then retrieves from product specs, customer reviews and community Q&A before generating an answer.