经典多巴胺学习理论受到挑战,奖励预测误差(RPE)是否应该被淘汰?

2022-12-13 神经科学临床和基础 神经科学临床和基础 发表于安徽省

学会根据环境线索预测奖励对生存至关重要。人们认为,动物在结果偏离预期时通过更新预测来学习预测奖赏,而这种奖励预测误差(RPE)是由学习的关键操控者—中脑-边缘多巴胺系统发出的信号来表征的。

中文摘要

学会根据环境线索预测奖励对生存至关重要。人们认为,动物在结果偏离预期时通过更新预测来学习预测奖赏,而这种奖励预测误差(RPE)是由学习的关键操控者—中脑-边缘多巴胺系统发出的信号来表征的。然而,动物可以通过学习奖励的既往因果关系来推断预测,而不是从RPE中学习前瞻性预测。因此,中脑-边缘多巴胺是否会传递一种有时类似于RPE的因果关联信号仍然未知。科学家开发了一种用于回顾性因果学习的算法,并发现中脑-边缘多巴胺的释放传达了因果关联,而不是RPE,从而挑战了奖励学习的主导理论。他们的结果重塑了联想学习的概念和生物学框架。

英文摘要

Learning to predict rewards based on environmental cues is essential for survival. It is believed that animals learn to predict rewards by updating predictions whenever the outcome deviates from expectations, and that such reward prediction errors (RPEs) are signaled by the mesolimbic dopamine system-a key controller of learning. However, instead of learning prospective predictions from RPEs, animals can infer predictions by learning the retrospective cause of rewards. Hence, whether mesolimbic dopamine instead conveys a causal associative signal that sometimes resembles RPE remains unknown. We developed an algorithm for retrospective causal learning and found that mesolimbic dopamine release conveys causal associations but not RPE, thereby challenging the dominant theory of reward learning. Our results reshape the conceptual and biological framework for associative learning.

版权声明:
本网站所有内容来源注明为“梅斯医学”或“MedSci原创”的文字、图片和音视频资料,版权均属于梅斯医学所有。非经授权,任何媒体、网站或个人不得转载,授权转载时须注明来源为“梅斯医学”。其它来源的文章系转载文章,或“梅斯号”自媒体发布的文章,仅系出于传递更多信息之目的,本站仅负责审核内容合规,其内容不代表本站立场,本站不负责内容的准确性和版权。如果存在侵权、或不希望被转载的媒体或个人可与我们联系,我们将立即进行删除处理。
在此留言
评论区 (1)
#插入话题
  1. [GetPortalCommentsPageByObjectIdResponse(id=2105936, encodeId=f2f72105936a1, content=好专业, beContent=null, objectType=article, channel=null, level=null, likeNumber=54, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=null, createdBy=6f675599545, createdName=ms5000001724145886, createdTime=Wed Dec 14 00:01:37 CST 2022, time=2022-12-14, status=1, ipAttribution=江苏省)]
    2022-12-14 ms5000001724145886 来自江苏省

    好专业

    0