Bio

I am a fourth-year PhD student in the Language Technology Lab at the University of Cambridge, working under the supervision of Prof. Nigel Collier. My research focuses on Natural Language Processing (NLP) and Large Language Models (LLMs), with a particular interest in post-training techniques (including preference modeling, alignment, and calibration), evaluation, and data synthesis.

If you are interested in discussing research or potential collaborations, feel free to reach out via email.

「人生到處知何似，應似飛鴻踏雪泥。」

News!

• 24/01/2025: One paper got accepted by NAACL 2025.
• 26/09/2024: One paper got accepted by NIPS 2024. Great thanks to all the collaborators.
• 21/09/2024: One paper got accepted by EMNLP 2024.
• 10/07/2024: One paper got accepted by COLM 2024. See you in Philadelphia.
• 03/06/2024: I will be interning at Microsoft Research Cambridge.
• 16/05/2024: One paper got accepted by ACL 2024. See you in Bangkok!
• 13/03/2024: We deployed a research paper searching website deep-scholar. Havea try!
• 13/03/2024: One paper got accepted by NAACL 2024, main conference. See you in Maxico City!
• 09/12/2023: I received the [Best Reviewer Award] from EMNLP 2023 generation track.
• 01/06/2023: I am interning at Apple AI/ML this summer.
• 03/11/2022: Going to present the paper Learning Functional Distributional Semantics with Visual Data on Cambridge Language Sciences Annual Symposium 2022.
• 25/10/2022: One paper got accepted by GEM workshop in EMNLP 2022.
• 21/03/2022: One paper got accepted by ACL 2022, main conference. See you in Dublin.

Featured publications

• Aligning with Logic: Measuring, Evaluating and Improving Logical Preference Consistency in Large Language Models
  Yinhong Liu, Zhijiang Guo, Tianya Liang, Ehsan Shareghi, Ivan Vuli´c and Nigel Collier.
  Under review.

• Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators
  Yinhong Liu*, Han Zhou*, Zhijiang Guo, Ehsan Shareghi, Ivan Vuli´c, Anna Korhonen and Nigel Collier. [code]
  COLM, 2024.

• Improving Preference Extraction In LLMs By Identifying Latent Knowledge Through Classifying Probes
  Sharan Maiya, Yinhong Liu, Ramit Debnath and Anna Korhonen
  Under review.

• GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Checking
  Yingjian Chen, Haoran Liu, Yinhong Liu, Rui Yang, Han Yuan, Yanran Fu, Pengyuan Zhou, Qingyu Chen, James Caverlee and Irene Li
  Under review.

• When Personalization Meets Reality: A Multi-Faceted Analysis of Personalized Preference Learning
  Yijiang River Dong, Tiancheng Hu, Yinhong Liu, Ahmet Üstün and Nigel Collier
  Under review.

• Prompt Compression for Large Language Models: A Survey
  Zongqian Li*, Yinhong Liu*, Yixuan Su and Nigel Collier.
  NAACL, main, 2025.

• TOAD: Task-Oriented Automatic Dialogs with Diverse Response Styles [Apple website] [Poster]
  Yinhong Liu, Yimai Fang, David Vandyke and Nigel Collier. [code]
  ACL, findings, 2024.

• Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments
  Han Zhou, Xingchen Wan, Yinhong Liu, Nigel Collier, Ivan Vulić, Anna Korhonen [code]
  EMNLP, main, 2024.

• MR-BEN: A Comprehensive Meta-Reasoning Benchmark for Large Language Models
  Zhongshen Zeng, Yinhong Liu, Yingjia Wan, Jingyao Li, et al. [code]
  NIPS, 2024.

• Unlocking Structure Measuring: Introducing PDD, an Automatic Metric for Positional Discourse Coherence
  Yinhong Liu, Yixuan Su, Ehsan Shareghi and Nigel Collier. [code]
  NAACL, main conference, 2024.

Other Publications

• Instruct-SCTG: Guiding Sequential Controlled Text Generation through Instructions
  Yinhong Liu, Yixuan Su, Ehsan Shareghi and Nigel Collier. [code]

• Plug-and-play Recipe Generation with Content Planning
  Yinhong Liu, Yixuan Su, Ehsan Shareghi and Nigel Collier. [code]
  EMNLP, Generation, Evaluation & Metrics (GEM) Workshop, 2022.

• Learning Functional Distributional Semantics with Visual Data[slides]
  Yinhong Liu and Guy Emerson. [code]
  ACL, main conference. 2022.

• Multi-channel audio statistical restoration
  Yinhong Liu and Simon Godsill.
  IEEE International Conference on Signal Processing, Communications and Computing (IEEE-ICSPCC), 2020.

Education

• University of Cambridge, 2021-present
  PhD in Computation, Cognition and Language. Supervisied by Prof. Nigel Collier and Prof. Ehsan Shareghi.
• University of Cambridge, 2020-2021
  Mphil in Advanced Computer Science. Supervisied by Dr. Guy Emerson.
• University of Cambridge, 2014-2018
  B.A and MEng in Information Engineering. Supervisied by Prof. Simon Godsill.

Professional Service

• Program Committee Member/ Reviewer: ICLR (2024-2025), ACL Rolling Review (2022-2024), ACL (2023-2024), NAACL (2023-2024), EMNLP (2022-2024), Generation, Evaluation & Metrics (GEM) workshop (2022-2023), EACL (2023)
• Teaching:
  TA for Li18 Python for Computational Linguistics, 2021-2023.