Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4

LLM SFT NLP APGO
2023年12月26日
本文介绍了26个指导原则，旨在简化针对大型语言模型的查询和提示过程中的基本概念，检查它们的能力，并增强用户对不同规模的大型语言模型在不同提示下的行为的理解。对LLaMA-1/2（7B、13B和70B）、GPT-3.5/4进行了广泛的实验，以验证所提出的指导原则在指令和提示设计方面的有效性。我们希望这项工作为从事大型语言模型提示的研究人员提供更好的指导。项目页面可在https://github.com/VILA-Lab/ATLAS上找到。
This paper introduces 26 guiding principles designed to streamline the process of querying and prompting large language models. Our goal is to simplify the underlying concepts of formulating questions for various scales of large language models, examining their abilities, and enhancing user comprehension on the behaviors of different scales of large language models when feeding into different prompts. Extensive experiments are conducted on LLaMA-1/2 (7B, 13B and 70B), GPT-3.5/4 to verify the effectiveness of the proposed principles on instructions and prompts design. We hope that this work provides a better guide for researchers working on the prompting of large language models. Project page is available at https://github.com/VILA-Lab/ATLAS.
许愿