Apollonion: Profile-centric Dialog Agent

LLM Other LLM NLP PEDS Agent Agent Memory Agent Eval Benchmarks
2024年04月10日
大型语言模型(LLMs)的出现创新了对话代理的发展。特别地,经过良好训练的LLM作为中央处理单元,能够为用户的请求提供流畅和合理的响应。此外,还开发了辅助工具,如外部知识检索、个性化角色以实现生动的响应、短期/长期记忆以实现超长上下文管理,从而完善了基于LLM的对话代理的使用体验。然而,上述技术并没有解决“从用户角度进行个性化”的问题:代理以相同的方式响应不同的用户,而不考虑他们的特征,如习惯、兴趣和过去的经验。换句话说,当前的对话代理实现在“了解用户”方面失败了。对用户进行良好描述和表示的能力正在开发中。在这项工作中,我们提出了一个对话代理框架,以整合用户个人资料(初始化、更新):用户的查询和响应被分析和组织成一个结构化的用户资料,后者用于提供个人化和更精确的响应。此外,我们提出了一系列个性化评估协议:响应在多大程度上针对不同的用户个性化。该框架被命名为\method{},受古希腊阿波罗神庙(也称为\method{})中“了解自己”的铭文启发。目前很少有关于将个性化融入LLM的研究,\method{}是通过对话代理应用引导LLM响应满足个性化的先驱性工作,并提出了一套用于个性化测量的评估方法。
The emergence of Large Language Models (LLMs) has innovated the development of dialog agents. Specially, a well-trained LLM, as a central process unit, is capable of providing fluent and reasonable response for user's request. Besides, auxiliary tools such as external knowledge retrieval, personalized character for vivid response, short/long-term memory for ultra long context management are developed, completing the usage experience for LLM-based dialog agents. However, the above-mentioned techniques does not solve the issue of \textbf{personalization from user perspective}: agents response in a same fashion to different users, without consideration of their features, such as habits, interests and past experience. In another words, current implementation of dialog agents fail in ``knowing the user''. The capacity of well-description and representation of user is under development. In this work, we proposed a framework for dialog agent to incorporate user profiling (initialization, update): user's query and response is analyzed and organized into a structural user profile, which is latter served to provide personal and more precise response. Besides, we proposed a series of evaluation protocols for personalization: to what extend the response is personal to the different users. The framework is named as \method{}, inspired by inscription of ``Know Yourself'' in the temple of Apollo (also known as \method{}) in Ancient Greek. Few works have been conducted on incorporating personalization into LLM, \method{} is a pioneer work on guiding LLM's response to meet individuation via the application of dialog agents, with a set of evaluation methods for measurement in personalization.
许愿