Learning, Inference and Control of Multi-AgentSystems

NIPS 2015 Workshop, Montreal, Canada

Organizers:

Vicenc GomezGerhard NeumannJonathan Yedidia

Peter Stone

December 14, 2015

Learning, Inference and Control of Multi-Agent SystemsNIPS 2015 Workshop, Montreal, Canada

Multi-Agent System

A system composed of multiple interacting intelligent agentswithin a single environment

I Power networks

I Robotic swarms

I Software agents

I Traffic systems

I . . .

Learning, Inference and Control of Multi-Agent SystemsNIPS 2015 Workshop, Montreal, Canada

Motivation

I Many of the challenges addressed by the NIPS communityhave a strong multi-agent component

I This community is under-represented at NIPS

Goal

I Review the state-of-the-art multi-agent systems

I Fill the gap between NIPS and multi-agent communities

Major topics of this workshop

I Learning and Planning in multi-agent systems

I Game theory

I Complex systems

Learning, Inference and Control of Multi-Agent SystemsNIPS 2015 Workshop, Montreal, Canada

Learning and Planning in MAS

Challenges

I Multiple learners

I Stochastic optimal policies

I Curse of dimensionality

I Social agents

I Centralized vs Decentralized

Learning, Inference and Control of Multi-Agent SystemsNIPS 2015 Workshop, Montreal, Canada

Game Theory

Challenges

I Finding / Learning NashEquilibria and other solutionconcepts

I Imperfect information games

I Optimality againstsub-optimal opponents

I Opponent Modelling

Learning, Inference and Control of Multi-Agent SystemsNIPS 2015 Workshop, Montreal, Canada

Complex systems

Challenges

I Emergence

I Self-organization

I Bio-inspired systems

I Multi-Scale Control

I Coordination,Communication

I Decentralized decisionmaking

Learning, Inference and Control of Multi-Agent SystemsNIPS 2015 Workshop, Montreal, Canada

Roderich Gross(University of Sheffield)

8:40 - 9:20 “Less is more? New approaches for swarm controland inference”

swarm robotics, self-organized systems, natural computing,mathematical biology

Karl Tuyls(University ofLiverpool)

Peter Stone(University ofTexas)

9:20 - 10:00 “Towards a Unification of Paradigmatic Realizationsof Multi-Agent Learning”

Bio-inspired systems, evolutionary game theory, multi-agentdecision making

Learning, Inference and Control of Multi-Agent SystemsNIPS 2015 Workshop, Montreal, Canada

Michael L. Littman(Brown University)

10:30 – 11:10 “Coordination and Joint Intention”

Reinforcement learning, human-robot interaction

Michael Bowling(University of Alberta)

14:30 - 15:10 “von Neumann’s Dream”

Games, reinforcement learning, subjective representations ofknowledge, robotics

Learning, Inference and Control of Multi-Agent SystemsNIPS 2015 Workshop, Montreal, Canada

Frans Oliehoek(University of Amsterdam)

16:30 – 17:10 “Multiagent Learning, Planning & Influences”

Planning, probabilistic inference in graphical models, POMDPs

Vito Trianni(Italian National Research Council)

17:10 - 17:50 “Collective Decisions: Where Swarms Dare”

Swarm intelligence, relationship between collective behavior andcognition

Learning, Inference and Control of Multi-Agent SystemsNIPS 2015 Workshop, Montreal, Canada

12:00 Best Poster Award!

Learning, Inference and Control of Multi-Agent SystemsNIPS 2015 Workshop, Montreal, Canada

12:00 Best Poster Award!

Miao Liu“Policy Based Reinforcement Learning in DEC-POMDPs withBayesian Nonparametrics”