Must-read Papers on Multi-agents of large language models.
"Here are some other paper lists you might be interested in:
π‘ Prompt4ReasoningPapers: Reasoning with Language Model Prompting Papers.
π¬ Model Editing Papers : Must-read papers on with large language models.
We sincerely invite you to dive into these collections of papers and resources, each offering a distinct journey of exploration and discovery. π₯³β
- 2023-06-18 We create this repository to maintain a paper list on Multi-agents .
-
Interactive Natural Language Processing
Zekun Wang, Ge Zhang, Kexin Yang, Ning Shi, Wangchunshu Zhou, Shaochun Hao, Guangzheng Xiong, Yizhi Li, Mong Yuan Sim, Xiuying Chen, Qingqing Zhu, Zhenzhu Yang, Adam Nik, Qi Liu, Chenghua Lin, Shi Wang, Ruibo Liu, Wenhu Chen, Ke Xu, Dayiheng Liu, Yike Guo, Jie Fu. [abs], 2023.5
-
AgentBench: Evaluating LLMs as Agents
Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, Shudan Zhang, Xiang Deng, Aohan Zeng, Zhengxiao Du, Chenhui Zhang, Sheng Shen, Tianjun Zhang, Yu Su, Huan Sun, Minlie Huang, Yuxiao Dong, Jie Tang. [abs], 2023.8
-
ReAct: Synergizing Reasoning and Acting in Language Models
Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, Yuan Cao. [abs], 2022.10
-
Reflexion: Language Agents with Verbal Reinforcement Learning
Noah Shinn, Federico Cassano, Beck Labash, Ashwin Gopinath, Karthik Narasimhan, Shunyu Yao. [abs], 2023.3
-
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
Yongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li, Weiming Lu, Yueting Zhuang. [abs], 2023.3
-
Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models
Chenfei Wu, Shengming Yin, Weizhen Qi, Xiaodong Wang, Zecheng Tang, Nan Duan. [abs], 2023.3
-
ChemCrow: Augmenting large-language models with chemistry tools
Andres M Bran, Sam Cox, Andrew D White, Philippe Schwaller. [abs], 2023.4
-
ChatCoT: Tool-Augmented Chain-of-Thought Reasoning on Chat-based Large Language Models
Zhipeng Chen, Kun Zhou, Beichen Zhang, Zheng Gong, Wayne Xin Zhao, Ji-Rong Wen. [abs], 2023.5
-
RecurrentGPT: Interactive Generation of (Arbitrarily) Long Text
Wangchunshu Zhou, Yuchen Eleanor Jiang, Peng Cui, Tiannan Wang, Zhenxin Xiao, Yifan Hou, Ryan Cotterell, Mrinmaya Sachan. [abs], 2023.5
-
Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization
Weiran Yao, Shelby Heinecke, Juan Carlos Niebles, Zhiwei Liu, Yihao Feng, Le Xue, Rithesh Murthy, Zeyuan Chen, Jianguo Zhang, Devansh Arpit, Ran Xu, Phil Mui, Huan Wang, Caiming Xiong, Silvio Savarese. [abs], 2023.8
-
Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents
Wenlong Huang, Pieter Abbeel, Deepak Pathak, Igor Mordatch. [abs], 2022.1
-
Inner Monologue: Embodied Reasoning through Planning with Language Models
Wenlong Huang , Fei Xia , Ted Xiao , Harris Chan, Jacky Liang, Pete Florence, Andy Zeng, Jonathan Tompson, Igor Mordatch, Yevgen Chebotar, Pierre Sermanet, Noah Brown, Tomas Jackson, Linda Luu, Sergey Levine, Karol Hausman, Brian Ichter. [abs], 2022.7
-
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models
Chan Hee Song, Jiaman Wu, Clayton Washington, Brian M. Sadler, Wei-Lun Chao, Yu Su. [abs], 2022.12
-
Do Embodied Agents Dream of Pixelated Sheep?: Embodied Decision Making using Language Guided World Modelling
Kolby Nottingham, Prithviraj Ammanabrolu, Alane Suhr, Yejin Choi, Hannaneh Hajishirzi, Sameer Singh, Roy Fox. [abs], 2023.1
-
Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents
Zihao Wang, Shaofei Cai, Anji Liu, Xiaojian Ma, Yitao Liang. [abs], 2023.2
-
PaLM-E: An embodied multimodal language model
Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, Pete Florence. [abs], 2023.3
-
Chat with the Environment: Interactive Multimodal Perception using Large Language Models
Xufeng Zhao, Mengdi Li, Cornelius Weber, Muhammad Burhan Hafez, Stefan Wermter. [abs], 2023.3
-
Generative Agents: Interactive Simulacra of Human Behavior
Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein. [abs], 2023.4
-
Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents
Yue Wu, So Yeon Min, Yonatan Bisk, Ruslan Salakhutdinov, Amos Azaria, Yuanzhi Li, Tom Mitchell, Shrimai Prabhumoye. [abs], 2023.5
-
Voyager: An Open-Ended Embodied Agent with Large Language Models
Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, Anima Anandkumar. [abs], 2023.5
-
SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks
Bill Yuchen Lin, Yicheng Fu, Karina Yang, Prithviraj Ammanabrolu, Faeze Brahman, Shiyu Huang, Chandra Bhagavatula, Yejin Choi, Xiang Ren. [abs], 2023.5
-
Language Models Meet World Models: Embodied Experiences Enhance Language Models
Jiannan Xiang, Tianhua Tao, Yi Gu, Tianmin Shu, Zirui Wang, Zichao Yang, Zhiting Hu. [abs], 2023.5
-
Training Socially Aligned Language Models in Simulated Human Society.
Ruibo Liu, Ruixin Yang, Chenyan Jia, Ge Zhang, Denny Zhou, Andrew M. Dai, Diyi Yang, Soroush Vosoughi. [abs], 2023.5
-
Towards A Unified Agent with Foundation Models.
Norman Di Palo, Arunkumar Byravan, Leonard Hasenclever, Markus Wulfmeier, Nicolas Heess, Martin Riedmiller. [abs], 2023.7
-
AgentSims: An Open-Source Sandbox for Large Language Model Evaluation
Jiaju Lin, Haoran Zhao, Aochi Zhang, Yiting Wu, Huqiuyue Ping, Qin Chen. [abs], 2023.8
-
CAMEL: Communicative Agents for "Mind" Exploration of Large Scale Language Model Society
Guohao Li, Hasan Abed Al Kader Hammoud, Hani Itani, Dmitrii Khizbullin, Bernard Ghanem. [abs], 2023.3
-
ChatLLM Network: More brains, More intelligence
Rui Hao, Linmei Hu, Weijian Qi, Qingliu Wu, Yirui Zhang, Liqiang Nie. [abs], 2023.4
-
Self-collaboration Code Generation via ChatGPT
Yihong Dong, Xue Jiang, Zhi Jin, Ge Li. [abs], 2023.4
-
Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate
Tian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang, Yan Wang, Rui Wang, Yujiu Yang, Zhaopeng Tu, Shuming Shi. [abs], 2023.5
-
Improving Factuality and Reasoning in Language Models through Multiagent Debate
Yilun Du, Shuang Li, Antonio Torralba, Joshua B. Tenenbaum, Igor Mordatch. [abs], 2023.5
-
Playing repeated games with Large Language Models
Elif Akata, Lion Schulz, Julian Coda-Forno, Seong Joon Oh, Matthias Bethge, Eric Schulz. [abs], 2023.5
-
ChatGPT/GPT-4 for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities
Yuqi Zhu, Xiaohan Wang, Jing Chen, Shuofei Qiao, Yixin Ou, Yunzhi Yao, Shumin Deng, Huajun Chen, Ningyu Zhang. [abs], 2023.5
-
Emergent autonomous scientific research capabilities of large language models
Daniil A. Boiko, Robert MacKnight, Gabe Gomes. [abs], 2023.4
-
Large Language Models as Tool Makers
Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, Denny Zhou. [abs],2023.5
-
Collaborating with language models for embodied reasoning
Ishita Dasgupta, Christine Kaeser-Chen, Kenneth Marino, Arun Ahuja, Sheila Babayan, Felix Hill, Rob Fergus. [abs], 2023.2
-
Multi-Party Chat: Conversational Agents in Group Settings with Humans and Models
Jimmy Wei, Kurt Shuster, Arthur Szlam, Jason Weston, Jack Urbanek, Mojtaba Komeili. [abs], 2023.4
-
Unleashing Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration
Zhenhailong Wang, Shaoguang Mao, Wenshan Wu, Tao Ge, Furu Wei, Heng Ji. [abs], 2023.7
-
Communicative Agents for Software Development
Chen Qian, Xin Cong, Cheng Yang, Weize Chen, Yusheng Su, Juyuan Xu, Zhiyuan Liu, Maosong Sun. [abs], 2023.7
-
To Infinity and Beyond: SHOW-1 and Showrunner Agents in Multi-Agent Simulations
Philipp Maas, Frank Carey, Chris Wheeler, Edward Saatchi, Pete Billington, Jessica Yaffa Shamash. [abs], 2023.7
-
MetaGPT: Meta Programming For Multi-Agent Collaborative Framework
Sirui Hong, Xiawu Zheng, Jonathan Chen, Yuheng Cheng, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu. [abs], 2023.8
-
RestGPT: Connecting Large Language Models with Real-World Applications via RESTful APIs
Yifan Song, Weimin Xiong, Dawei Zhu, Cheng Li, Ke Wang, Ye Tian, Sujian Li. [abs], 2023.6
-
Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedback
Yao Fu, Hao Peng, Tushar Khot, Mirella Lapata. [abs], 2023.5
-
Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents
Yashar Talebirad, Amirhossein Nadiri. [abs], 2023.6
-
Building Cooperative Embodied Agents Modularly with Large Language Models
Hongxin Zhang, Weihua Du, Jiaming Shan, Qinhong Zhou, Yilun Du, Joshua B. Tenenbaum, Tianmin Shu, Chuang Gan. [abs], 2023.7
-
Gentopia: A Collaborative Platform for Tool-Augmented LLMs
Binfeng Xu, Xukun Liu, Hua Shen, Zeyu Han, Yuhan Li, Murong Yue, Zhiyuan Peng, Yuchen Liu, Ziyu Yao, Dongkuan Xu. [abs], 2023.8
Types | Tools |
---|---|
Agent with tool | AutoGPTγLangChainγTransformer AgentsγWorkGPTγAutoChain γLangroidγ WebArenaγGPT ResearcherγBMToolsγToolBench |
Multi-Agent | CAMELγGPTeamγAgentVerseγMetaGPTγLangroidγSocraticAI |
Others | AutoAgents γGPT Engineer |
-
Auto-GPT. An experimental open-source attempt to make GPT-4 fully autonomous.
-
LangChain. Building applications with LLMs through composability.
-
CAMEL. Communicative Agents for βMindβ Exploration of Large Scale Language Model Society.
-
GPTeam. GPTeam: An open-source multi-agent simulation.
-
Transformer Agents. In short, it provides a natural language API on top of transformers: we define a set of curated tools and design an agent to interpret natural language and to use these tools.
-
AgentVerse . A Framework for Multi-LLM Environment Simulation.
-
AutoAgents. Complex question answering in LLMs with enhanced reasoning and information-seeking capabilities.
-
GPT Engineer . Specify what you want it to build, the AI asks for clarification, and then builds it.
-
MetaGPT. The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo
-
WorkGPT. A GPT agent framework for invoking APIs.
-
AutoChain. Build lightweight, extensible, and testable LLM Agents.
-
Langroid. Harness LLMs with Multi-Agent Programming.
-
SocraticAI. Problem solving by engaging multiple AI agents in conversation with each other and the user.
-
WebArena. A Realistic Web Environment for Building Autonomous Agents.
-
GPT Researcher. GPT based autonomous agent that does online comprehensive research on any given topic.
-
BMTools. Tool Learning for Big Models, Open-Source Solutions of ChatGPT-Plugins
-
ToolBench. An open platform for training, serving, and evaluating large language model for tool learning.
β" Join us in improving this repository! If you know of any important works we've missed, please contribute. Your efforts are highly valued! "