Record
- Authors
- Wang, W.; Wei, F.; Dong, L.; Bao, H.; Yang, N.; Zhou, M.
- Year
- 2020
- Title
- MiniLM: Deep self-attention distillation for task-agnostic compression of pre-trained transformers
- Published in
- Advances in Neural Information Processing Systems 33 (NeurIPS 2020)
- Pages
- 5776–5788
- Type
- Conference paper
- arXiv
- arXiv:2002.10957
- Our note
- none yet
- Verification
- unverified: not yet checked against the source
- Id
wang-2020-minilm-deep-self-attention-distillation-task
Cited on
- Sentence and Passage Encoders read status: not stated
As cited
The pages cite this work in one form.
-
Wang, W., Wei, F., Dong, L., Bao, H., Yang, N., and Zhou, M. (2020). MiniLM: Deep self-attention distillation for task-agnostic compression of pre-trained transformers. In Advances in Neural Information Processing Systems 33 (NeurIPS 2020), 5776–5788. arXiv:2002.10957.
BibLaTeX
@inproceedings{wang-2020-minilm-deep-self-attention-distillation-task,
author = {Wang, W. and Wei, F. and Dong, L. and Bao, H. and Yang, N. and Zhou, M.},
title = {{MiniLM: Deep self-attention distillation for task-agnostic compression of pre-trained transformers}},
booktitle = {Advances in Neural Information Processing Systems 33 (NeurIPS 2020)},
date = {2020},
pages = {5776--5788},
eprint = {2002.10957},
eprinttype = {arxiv}
}