View preset
KV-cache memory
Step through decoding and see keys and values accumulate in separate banks for each layer.
Preparing the preview…
Made to be adapted.
Each layer retains the keys and values of earlier tokens. The violet bank stores keys; the green bank stores values. Columns are token positions and rows are three illustrative layers.
Interactive 3D on synthetic inputs. No benchmark results are implied.
- Export formats
- PNG / HTML
- Editable in Studio
- Explanation, appearance, and model inputs
- Access
- Free with attribution. No account needed.
- Reference
- Read the source