Judging LLM-as-a-judge with MT-Bench and Chatbot Arena

Record

Authors
Zheng, L.; Chiang, W.-L.; Sheng, Y.; Zhuang, S.; Wu, Z.; Zhuang, Y.; Lin, Z.; Li, Z.; Li, D.; Xing, E. P.; Zhang, H.; Gonzalez, J. E.; Stoica, I.
Year
2023
Title
Judging LLM-as-a-judge with MT-Bench and Chatbot Arena
Published in
Advances in Neural Information Processing Systems 36, Datasets and Benchmarks Track
Type
Conference paper
arXiv
arXiv:2306.05685
Our note
none yet
Verification
unverified: not yet checked against the source
Id
zheng-2023-judging-llm-as-judge-mt-bench

Cited on

As cited

The pages cite this work in one form.

  • Zheng, L., Chiang, W.-L., Sheng, Y., Zhuang, S., Wu, Z., Zhuang, Y., Lin, Z., Li, Z., Li, D., Xing, E. P., Zhang, H., Gonzalez, J. E., and Stoica, I. (2023). Judging LLM-as-a-judge with MT-Bench and Chatbot Arena. Advances in Neural Information Processing Systems 36, Datasets and Benchmarks Track. arXiv:2306.05685. Data: Hugging Face dataset lmsys/mt_bench_human_judgments (CC BY 4.0), revision f7d2896d2cc5d80f8b55c2bbc722613555233c25.

BibLaTeX

@inproceedings{zheng-2023-judging-llm-as-judge-mt-bench,
  author = {Zheng, L. and Chiang, W.-L. and Sheng, Y. and Zhuang, S. and Wu, Z. and Zhuang, Y. and Lin, Z. and Li, Z. and Li, D. and Xing, E. P. and Zhang, H. and Gonzalez, J. E. and Stoica, I.},
  title = {{Judging LLM-as-a-judge with MT-Bench and Chatbot Arena}},
  booktitle = {Advances in Neural Information Processing Systems 36, Datasets and Benchmarks Track},
  date = {2023},
  eprint = {2306.05685},
  eprinttype = {arxiv}
}

Download · JSON with CSL-JSON · the whole bibliography