CCN meeting | Eric Schulz (Max Planck Institute for Biological Cybernetics, Germany)

When
04-02-2021 from 15:00 to 16:00
Where
https://ugent-be.zoom.us/j/96299238286?pwd=enlENzhON2JPbTNNc1c5eVRyVXR5UT09
Language
English
Add to my calendar

Using structure to explore efficiently


Many types of intelligent behavior can be framed as a search problem, where an individual must explore a vast set of possible actions, while carefully balancing the exploration-exploitation dilemma. Under finite search horizons, optimal solutions are normally unobtainable. Yet humans and other animals regularly manage to gracefully solve these problems. How do they accomplish this? We propose an explanation based on two principles: generalization over features and uncertainty-guided exploration. Together these form a model that learns from past observations to generalize to similar options and eagerly seeks out uncertainty to gain more information about the search space. This model can be used to predict participants' search behavior in a complex multi-armed bandit task. The model's parameter estimates can also be used to gain meaningful insights into developmental differences in generalization and exploration. Furthermore, we can use our model to describe customers' purchasing decisions in a large-scale data set of 1.6 million online food delivery purchases. Finally, I will map out ongoing work investigating the neural principles of generalization, where we find that people form mental structures that allow them to search for rewards more efficiently, a form of neural representation learning.