2 Comments
Nov 22, 2023Liked by Sairam Sundaresan

This is a terrific explanation - thank you. When it comes to "non-parametric memory", is this typically prefetched and the LLM sees this as a local cache of recent information or is this a real time lookup based on the user's query?

Expand full comment