Bio

I’m a third year PhD student with Prof. Nigel Collier in Language Technology Lab, University of Cambridge. My research focus is in NLP and LLM, especially in LLM-as-judge (LLM evaluator), Controlled Text Generation, Generation with Discourse structure, Task-oriented Dialog, Data Synthesis for aligning LLM.

News!

• 26/09/2024: One paper got accepted by NIPS 2024. Great thanks to all the collaborators.
• 21/09/2024: One paper got accepted by EMNLP 2024.
• 10/07/2024: One paper got accepted by COLM 2024. See you in Philadelphia.
• 03/06/2024: I will be interning at Microsoft Research Cambridge.
• 16/05/2024: One paper got accepted by ACL 2024. See you in Bangkok!
• 13/03/2024: We deployed a research paper searching website deep-scholar. Havea try!
• 13/03/2024: One paper got accepted by NAACL 2024, main conference. See you in Maxico City!
• 09/12/2023: I received the [Best Reviewer Award] from EMNLP 2023 generation track.
• 01/06/2023: I am interning at Apple AI/ML this summer.
• 03/11/2022: Going to present the paper Learning Functional Distributional Semantics with Visual Data on Cambridge Language Sciences Annual Symposium 2022.
• 25/10/2022: One paper got accepted by GEM workshop in EMNLP 2022.
• 21/03/2022: One paper got accepted by ACL 2022, main conference. See you in Dublin.

Featured publications

• Aligning with Logic: Measuring, Evaluating and Improving Logical Consistency in Large Language Models
  Yinhong Liu, Zhijiang Guo, Tianya Liang, Ehsan Shareghi, Ivan Vuli´c and Nigel Collier.
  Under review.

• Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators
  Yinhong Liu*, Han Zhou*, Zhijiang Guo, Ehsan Shareghi, Ivan Vuli´c, Anna Korhonen and Nigel Collier. [code]
  COLM, 2024.

• Prompt Compression for Large Language Models: A Survey
  Zongqian Li*, Yinhong Liu*, Yixuan Su and Nigel Collier.
  Under review.

• TOAD: Task-Oriented Automatic Dialogs with Diverse Response Styles [Apple website] [Poster]
  Yinhong Liu, Yimai Fang, David Vandyke and Nigel Collier. [code]
  ACL, findings, 2024.

• Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments
  Han Zhou, Xingchen Wan, Yinhong Liu, Nigel Collier, Ivan Vulić, Anna Korhonen [code]
  EMNLP, main, 2024.

• MR-BEN: A Comprehensive Meta-Reasoning Benchmark for Large Language Models
  Zhongshen Zeng, Yinhong Liu, Yingjia Wan, Jingyao Li, et al. [code]
  NIPS, 2024.

• Unlocking Structure Measuring: Introducing PDD, an Automatic Metric for Positional Discourse Coherence
  Yinhong Liu, Yixuan Su, Ehsan Shareghi and Nigel Collier. [code]
  NAACL, main conference, 2024.

Other Publications

• Instruct-SCTG: Guiding Sequential Controlled Text Generation through Instructions
  Yinhong Liu, Yixuan Su, Ehsan Shareghi and Nigel Collier. [code]

• Plug-and-play Recipe Generation with Content Planning
  Yinhong Liu, Yixuan Su, Ehsan Shareghi and Nigel Collier. [code]
  EMNLP, Generation, Evaluation & Metrics (GEM) Workshop, 2022.

• Learning Functional Distributional Semantics with Visual Data[slides]
  Yinhong Liu and Guy Emerson. [code]
  ACL, main conference. 2022.

• Multi-channel audio statistical restoration
  Yinhong Liu and Simon Godsill.
  IEEE International Conference on Signal Processing, Communications and Computing (IEEE-ICSPCC), 2020.

Education

• University of Cambridge, 2021-present
  PhD in Computation, Cognition and Language. Supervisied by Prof. Nigel Collier and Prof. Ehsan Shareghi.
• University of Cambridge, 2020-2021
  Mphil in Advanced Computer Science. Supervisied by Dr. Guy Emerson.
• University of Cambridge, 2014-2018
  B.A and MEng in Information Engineering. Supervisied by Prof. Simon Godsill.

Professional Service

• Program Committee Member/ Reviewer:
  ACL Rolling Review (2022-2024), ACL (2023-2024), NAACL (2023-2024) EMNLP (2022-2024), Generation, Evaluation & Metrics (GEM) workshop (2022-2023), EACL (2023)
• Teaching:
  TA for Li18 Python for Computational Linguistics, 2021-2023.