Attention is not all you need: pure attention loses rank doubly exponentially with depth.
Resource URI: https://dblp.l3s.de/d2r/resource/publications/conf/icml/DongCL21
Home
|
Example Publications
Property
Value
dcterms:
bibliographicCitation
<
http://dblp.uni-trier.de/rec/bibtex/conf/icml/DongCL21
>
dc:
creator
<
https://dblp.l3s.de/d2r/resource/authors/Andreas_Loukas
>
dc:
creator
<
https://dblp.l3s.de/d2r/resource/authors/Jean-Baptiste_Cordonnier
>
dc:
creator
<
https://dblp.l3s.de/d2r/resource/authors/Yihe_Dong
>
foaf:
homepage
<
http://proceedings.mlr.press/v139/dong21a.html
>
dc:
identifier
DBLP conf/icml/DongCL21
(xsd:string)
dcterms:
issued
2021
(xsd:gYear)
rdfs:
label
Attention is not all you need: pure attention loses rank doubly exponentially with depth.
(xsd:string)
foaf:
maker
<
https://dblp.l3s.de/d2r/resource/authors/Andreas_Loukas
>
foaf:
maker
<
https://dblp.l3s.de/d2r/resource/authors/Jean-Baptiste_Cordonnier
>
foaf:
maker
<
https://dblp.l3s.de/d2r/resource/authors/Yihe_Dong
>
swrc:
pages
2793-2803
(xsd:string)
dcterms:
partOf
<
https://dblp.l3s.de/d2r/resource/publications/conf/icml/2021
>
owl:
sameAs
<
http://bibsonomy.org/uri/bibtexkey/conf/icml/DongCL21/dblp
>
owl:
sameAs
<
http://dblp.rkbexplorer.com/id/conf/icml/DongCL21
>
rdfs:
seeAlso
<
http://dblp.uni-trier.de/db/conf/icml/icml2021.html#DongCL21
>
rdfs:
seeAlso
<
http://proceedings.mlr.press/v139/dong21a.html
>
swrc:
series
<
https://dblp.l3s.de/d2r/resource/conferences/icml
>
dc:
title
Attention is not all you need: pure attention loses rank doubly exponentially with depth.
(xsd:string)
dc:
type
<
http://purl.org/dc/dcmitype/Text
>
rdf:
type
swrc:InProceedings
rdf:
type
foaf:Document