Where does “self-attention” come from?
self-attention (English) comes from English attention, from Middle English attencioun, from Latin attentio, from Latin -tiō, from Latin dissertātiō, from Latin dissertus, from Latin disserere, from Latin dis- — small stone, pebble; gravel, rubble.
self-attention (English): A form of attention machine learning method where input sequence is compared with itself, i.e. the keys and queries are the same
Definitions
- A form of attention machine learning method where input sequence is compared with itself, i.e. the keys and queries are the same
Ancestry of “self-attention”, step by step
self-attention traces back through two separate lines of ancestry.
via English attention
| Step | Language | Word | Meaning |
|---|---|---|---|
| 1 | English | attention | Mental focus; An action or remark expressing... |
| 2 | Middle English | attencioun | — |
| 3 | Latin | attentio | attention, attentiveness |
| 4 | Latin | -tiō | tion, -ation, -ing |
| 5 | Latin | dissertātiō | (spoken) dissertation, discourse, disquisition |
| 6 | Latin | dissertus | arranged, disposed; explained |
| 7 | Latin | disserere | second-person singular future passive indicative... |
| 8 | Latin | dis- | asunder, apart, in two; reversal, removal;... |
| 9 | Latin | calceus | shoe |
| 10 | Latin | calx | limestone; chalk; the finish line |
| 11 | Ancient Greek | χάλιξ | small stone, pebble; gravel, rubble |
via English Self
| Step | Language | Word | Meaning |
|---|---|---|---|
| 1 | English | Self | Himself, herself, itself, themself, themselves; that specific (person mentioned) |
| 2 | Middle English | salve | Alternative form of sauf |
| 3 | Old English | sealf | salve |
| 4 | Proto-West Germanic | salbu | salve, ointment |
| 5 | Proto-Germanic | salbō | salve, ointment |
| 6 | Proto-Indo-European | solp-éh₂ | — |
| 7 | Proto-Indo-European | selp- | fat, oil |