Record
- Authors
- He, Z.; Wang, J.; Lin, R.; Ge, X.; Shu, W.; Tang, Q.; Zhang, J.
- Year
- 2025
- Title
- Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition
- Published in
- arXiv
- Type
- Preprint
- DOI
- 10.48550/arxiv.2504.20938
- arXiv
- arXiv:2504.20938
- Our note
- none yet
- Verification
- verified: its identifier resolves to a record with the same title and author (checked against OpenAlex, 2026-11-14).
Identifiers found: OpenAlex W4417172230 · DOI 10.48550/arxiv.2504.20938 · arXiv:2504.20938 - From the lookup
- doi (the pages' own wording is under "As cited" below)
- Id
he-2025-towards-understanding-nature-attention-low-rank
Cited on
- HeadVis: An Interactive Tool For Investigating Attention Heads read status: not stated
As cited
The pages cite this work in one form.
-
He, Z., Wang, J., Lin, R., Ge, X., Shu, W., Tang, Q., and Zhang, J. (2025). Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition. arXiv:2504.20938.
BibLaTeX
@misc{he-2025-towards-understanding-nature-attention-low-rank,
author = {He, Z. and Wang, J. and Lin, R. and Ge, X. and Shu, W. and Tang, Q. and Zhang, J.},
title = {{Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition}},
date = {2025},
doi = {10.48550/arxiv.2504.20938},
eprint = {2504.20938},
eprinttype = {arxiv}
}