MiniLM: Deep self-attention distillation for task-agnostic compression of pre-trained transformers

Record

Authors
Wang, W.; Wei, F.; Dong, L.; Bao, H.; Yang, N.; Zhou, M.
Year
2020
Title
MiniLM: Deep self-attention distillation for task-agnostic compression of pre-trained transformers
Published in
Advances in Neural Information Processing Systems 33 (NeurIPS 2020)
Pages
5776–5788
Type
Conference paper
arXiv
arXiv:2002.10957
Our note
none yet
Verification
unverified: not yet checked against the source
Id
wang-2020-minilm-deep-self-attention-distillation-task

Cited on

As cited

The pages cite this work in one form.

  • Wang, W., Wei, F., Dong, L., Bao, H., Yang, N., and Zhou, M. (2020). MiniLM: Deep self-attention distillation for task-agnostic compression of pre-trained transformers. In Advances in Neural Information Processing Systems 33 (NeurIPS 2020), 5776–5788. arXiv:2002.10957.

BibLaTeX

@inproceedings{wang-2020-minilm-deep-self-attention-distillation-task,
  author = {Wang, W. and Wei, F. and Dong, L. and Bao, H. and Yang, N. and Zhou, M.},
  title = {{MiniLM: Deep self-attention distillation for task-agnostic compression of pre-trained transformers}},
  booktitle = {Advances in Neural Information Processing Systems 33 (NeurIPS 2020)},
  date = {2020},
  pages = {5776--5788},
  eprint = {2002.10957},
  eprinttype = {arxiv}
}

Download · JSON with CSL-JSON · the whole bibliography