Biophysics and Soft Matter Seminar

An inference take on urgency in decision-making

Monday, 09 December 2019 01:30PM PST
Print

Biophysics and Soft Matter Seminar

Maximilian Puelma Touzel
Quebec Artificial Intelligence Institute

An inference take on urgency in decision-making

Dec 9, 2019 at 1:30pm in P8445.2

Synopsis

Artificial and biological agents are often tasked with making early decisions to maximize reward rate. Here, we provide a theory of time-constrained decision-making for a task in which subjects observe a random walk and must use prediction to capitalize on early decisions. We support the theory with (1) the construction of an optimal solution, (2) a qualitative match to neural recordings from non-human primates and human behavioral data, and (3) a neurally plausible reinforcement learning algorithm. The ‘urgency’ signal from urgency-gating models of neural decision-making, as measured in non-human primates performing this task, is qualitatively matched by this theory for a minimally-biased prior distribution of reward rate, which leads to the observed hyperbolic form of temporal discounting. Our work suggests that the urgency signal, rather than being an ad hoc bias for early decisions, is an online estimate of return-on-(time)investment.