DERI Seminar with Dr Yali Du, Senior Lecturer in AI, Kings College London
When: Thursday, October 2, 2025, 11:00 AM - 12:00 PM
Where: Teams
Do join us online on Thursday 2nd October at 11am. We will be joined by Dr Yali Du who is a Senior Lecturer in AI, Kings College London
Title: From Human Knowledge to Cooperative AI: Leveraging LLM-based Reasoning
Abstract: When humans need to learn a new skill, we can acquire knowledge through written books, including textbooks, tutorials, etc. However, current research for decision-making, like reinforcement learning (RL), has primarily required numerous real interactions with the target environment to learn a skill, while failing to utilize the existing knowledge already summarized in the text. The success of Large Language Models (LLMs) sheds light on utilizing such knowledge behind the books. In this paper, we discuss a new policy learning problem called Policy Learning from tutorial Books (PLfB), which aims to leverage rich resources such as books and tutorials to derive a policy network. We Leverage LLM Reasoning to Transfer Human Expertise from language based instructions, tutorials and books into AI Policies.
We will discuss two works along this thread. Firstly we introduce Multi-agent Reinforcement Learning from Multi-phase Human Feedback of Mixed Quality (M3HF), a novel framework that integrates multi-phase human feedback of mixed quality into the MARL training process. By involving humans with diverse expertise levels to provide iterative guidance, M3HF leverages both expert and non-expert feedback to continuously refine agents' policies. Secondly, inspired by how humans learn from books, we discuss a new policy learning problem called Policy Learning from Tutorial Books (PLfB) upon the shoulders of LLMs’ systems, which aims to leverage rich resources such as tutorial books to derive a policy network. Experiments on Overcooked! and Google Research Football show the promise of LLM reasoning for transferring human knowledge to cooperative multiagent systems.
Bio: Dr Yali Du is a Senior Lecturer in AI at King’s College London, and a Turing Fellow at The Alan Turing Institute. She leads the Cooperative AI Lab. Her research aims to enable machines to demonstrate cooperative and safe behaviour in intelligent decision-making tasks, encompassing areas of multi-agent cooperation, Human-AI coordination, and value alignment. She received the AAAI New Faculty Highlights award in 2023 and was named a Rising Star in AI for the same year. She has also conducted tutorials on cooperative multi-agent learning at ACML 2022 and AAAI 2023. She serves as an associate editor for the Journal of AAMAS and IEEE Transactions on AI, Area Chairs for NeurIPS 2024, Senior PC for AAAI 2022, ECAI 2024. She also serves in the organisation committee for NeurIPS 2024 and AAMAS 2023. Her research receives support from the EPSRC and UK AI Security Institute.
________________________________________________________________________________
Microsoft Teams Need help?
Join the meeting now - with Dr Yali Du
Meeting ID: 317 072 432 124 3
Passcode: Uy3U9CP6
For organizers: Meeting options
________________________________________________________________________________