Where does “cross-attention” come from?
cross-attention (English) comes from English attention, from Middle English attencioun, from Latin attentio, from Latin -tiō, from Latin dissertātiō, from Latin dissertus, from Latin disserere, from Latin dis- — small stone, pebble; gravel, rubble.
cross-attention (English): A form of attention machine learning method where two different input sequences are compared, i.e. the keys and queries differ
Definitions
- A form of attention machine learning method where two different input sequences are compared, i.e. the keys and queries differ
Ancestry of “cross-attention”, step by step
| Step | Language | Word | Meaning |
|---|---|---|---|
| 1 | English | attention | Mental focus; An action or remark expressing... |
| 2 | Middle English | attencioun | — |
| 3 | Latin | attentio | attention, attentiveness |
| 4 | Latin | -tiō | tion, -ation, -ing |
| 5 | Latin | dissertātiō | (spoken) dissertation, discourse, disquisition |
| 6 | Latin | dissertus | arranged, disposed; explained |
| 7 | Latin | disserere | second-person singular future passive indicative... |
| 8 | Latin | dis- | asunder, apart, in two; reversal, removal;... |
| 9 | Latin | calceus | shoe |
| 10 | Latin | calx | limestone; chalk; the finish line |
| 11 | Ancient Greek | χάλιξ | small stone, pebble; gravel, rubble |