View preset
A lens on attention
Set your own scores and watch softmax redistribute the weight.
Preparing the preview…
Made to be adapted.
A query is compared with keys to produce scores. This example uses six fixed illustrative scores, not a trained model's attention map.
Interactive mathematical model. Use the controls to explore the mechanism; this is not a benchmark result.
- Export formats
- PNG / HTML
- Editable in Studio
- Explanation, appearance, and model inputs
- Access
- Free with attribution. No account needed.
- Reference
- Read the source