polyformer Feynman attention, a sum over diagrams

Sum over diagrams

Feynman attention rebuilds every token for several rounds from a sum of terms. On the left, every token at once; on the right, one token's sum expanded into its Feynman diagram. Click a row to expand that token.

Card 3's state must say whether it is in a SET. Ideal computation

Every token

  • reads one token
  • reads two at once
  • via a virtual mode
  • its own value
  • keeps its state
  • what the chosen token reads

Card 3, expanded

Table
0.3%