Motivation and emotion/Book/2024/Neuroscience of unexpected positive outcomes

Neuroscience of unexpected positive outcomes:
What is the neural response to unexpected positive outcomes?

Multimedia presentation (3 min)

Overview

Case Study: Sarah Sarah, a high school teacher, implemented a new strategy in her classroom to boost student engagement. She introduced an element of surprise by giving out unexpected rewards for exemplary work, such as gift cards or extra credit. This approach aimed to capitalise on the psychological impact of unexpected positive outcomes to enhance student motivation and performance. Sarah noticed that despite her best efforts, many students were disengaged and lacked motivation to excel. Traditional methods of rewards and punishments were not yielding significant improvements in student performance or enthusiasm. Sarah's strategy was based on psychological principles that emphasise the power of unexpected positive outcomes in shaping behavior. Research shows that such rewards trigger stronger emotional responses and enhance memory retention, which can lead to improved learning and behavior (Schultz, 2015). The brain’s reward system, including the ventral Tegmental area (VTA) and nucleus Accumbens (NAcc), plays a crucial role in processing these rewards and reinforcing desired behaviours (Kringelbach, 2004).

Imagine receiving an unexpected bonus at work or finding a $20 bill on the street. These surprising, positive outcomes can create a burst of happiness and excitement (See Figure 1), significantly influencing your future behaviour. This immediate emotional boost and reinforcement illustrate the profound impact of unexpected rewards on shaping our actions and decisions.

Unexpected positive outcomes are crucial because they trigger powerful emotional responses and enhance our ability to remember and repeat behaviours associated with these rewards. This phenomenon is central to psychological science, which explores how such rewards influence learning and emotional states. When we experience unexpected rewards, our brain’s reward system—comprising the ventral Tegmental area (VTA), nucleus Accumbens (NAcc), and prefrontal cortex (PFC)—becomes activated, processing these rewards and reinforcing behaviours that led to them (Schultz, 2015).

Figure 1. Children expressing excitement and happiness

Understanding this process is important for various real-world applications, from improving educational strategies and therapeutic interventions to optimising marketing approaches. Psychological science offers insights into how the release of neurotransmitters like dopamine, serotonin, and norepinephrine affects our responses to rewards, helping us design better reinforcement strategies (Cohen et al., 2002; Pizzagalli, 2014).

Focus questions - How do unexpected positive outcomes affect brain activity and emotional responses? - What role do key neural circuits, such as the ventral tegmental area and nucleus accumbens, play in processing unexpected rewards? - How does dopamine release influence our reaction to unexpected positive outcomes? - What are the implications of reward prediction error for learning and behavior in the context of unexpected rewards?

Understanding the significance of unexpected positive outcomes

• Why are unexpected positive outcomes important in shaping behaviour and decision-making?

Unexpected positive outcomes strongly influence behaviour by triggering a more intense emotional response compared to expected rewards. When something good happens unexpectedly, the brain generates a "reward prediction error"—the difference between what we expect and what actually occurs. This signals the brain to update its expectations and reinforces the behaviour that led to the positive outcome, making it more likely to be repeated in the future (Schultz, 2015).

• How do these outcomes influence our learning processes and emotional states?

Unexpected positive outcomes impact learning processes by enhancing reward-based learning through the release of dopamine, which reinforces the connection between behaviour and reward (Kakade & Dayan, 2002). Emotionally, these outcomes can lead to positive emotional states, such as happiness or satisfaction, which further reinforce the learned behaviour (Berridge & Robinson, 2003).

The brain's reward system: an overview of key neural circuits

• The key neural circuits involved in the brain's reward system include the ventral tegmental area (VTA), nucleus accumbens (NAcc), and the prefrontal cortex. These circuits are crucial in processing rewards and reinforcing behaviour (Kringelbach, 2004).

• The reward system processes expected outcomes by predicting rewards and reinforcing behaviour when the prediction is accurate. However, when an outcome is unexpected, the system generates a reward prediction error signal, leading to increased dopamine release and stronger reinforcement of the behaviour associated with the unexpected reward (Schultz, 2015).

The ventral tegmental area (VTA) and dopamine signalling

• What role does the VTA play in dopamine signalling, and how does this relate to reward processing? The ventral tegmental area (VTA) plays a critical role in dopamine signalling by releasing dopamine in response to rewarding stimuli. This process is essential for reward processing as the dopamine released from the VTA activates brain regions involved in motivation and reinforcement learning. The VTA's connection to other reward-processing areas, such as the nucleus accumbens and prefrontal cortex, allows it to reinforce behaviours that lead to rewards, making it fundamental to adaptive learning and decision-making processes (Wise, 2004).
• How does the release of dopamine from the VTA differ in response to expected versus unexpected rewards? Dopamine release from the VTA differs based on whether a reward is expected or unexpected. When a reward is anticipated, dopamine levels increase moderately, signalling that the brain's predictions align with reality. In contrast, during unexpected rewards, dopamine levels spike significantly, indicating a reward prediction error. This unexpected release reinforces the behaviours that led to the positive outcome, enhancing learning and memory related to the event (Schultz, 1998).

The nucleus accumbens (NAcc) and reward anticipation

• How does the NAcc contribute to the anticipation and processing of rewards? Knutson and Cooper (2005) note that the nucleus accumbens (NAcc) plays a vital role in reward anticipation by responding to cues that signal potential rewards. This area of the brain is heavily involved in processing the emotional and motivational aspects of reward-seeking behaviour. The NAcc becomes active when individuals anticipate a reward, helping to guide decision-making processes that prioritise actions leading to positive outcomes (Knutson & Cooper, 2005).
• What changes occur in the NAcc during unexpected positive outcomes? During unexpected positive outcomes, the activity in the NAcc significantly increases (Hollerman & Schultz, 1998). This heightened activity corresponds with the processing of reward prediction errors and reinforces the behaviour that led to the positive outcome (Hollerman & Schultz, 1998). The unexpected nature of the reward strengthens the emotional and motivational response, making the NAcc a crucial component of learning from unpredicted rewards (Hollerman & Schultz, 1998).

The role of the prefrontal cortex in reward processing

• How does the prefrontal cortex integrate information about rewards? Miller and Cohen (2001) highlight the prefrontal cortex's role in integrating information about rewards by evaluating the value of potential rewards and using this information to guide decision-making (see table 1). The prefrontal cortex synthesises data from various brain regions involved in reward anticipation and processing, ensuring that decisions are aligned with long-term goals and adaptive strategies (Miller & Cohen, 2001).
• What role does the prefrontal cortex play in modulating behaviour based on reward outcomes? The prefrontal cortex is as essential for modulating behaviour based on reward outcomes as it helps individuals adjust their actions by evaluating whether previous decisions led to positive or negative consequences (Moayedi et al., 2014). By continuously updating its strategies based on reward feedback, the prefrontal cortex ensures that behaviour remains flexible and responsive to changing environmental conditions (Moayedi et al., 2014).

Table 1. Key neural circuits involved in the brain's reward system

Brain Region	Function in Reward Processing	Role in Expected vs. Unexpected Outcomes
Ventral Tegmental Area (VTA)	Releases dopamine in response to rewarding stimuli, crucial for motivation and reinforcement learning.	Expected rewards cause moderate dopamine release, while unexpected rewards cause a dopamine spike, reinforcing adaptive behaviour (Schultz, 1998).
Nucleus Accumbens (NAcc)	Involved in reward anticipation, processing emotional and motivational aspects of rewards.	Heightened activity during unexpected rewards strengthens the emotional and motivational response, reinforcing the behaviour (Hollerman & Schultz, 1998).
Prefrontal Cortex (PFC)	Integrates reward information and guides decision-making aligned with long-term goals.	Modulates behaviour based on reward feedback, adjusting actions based on whether past decisions led to positive or negative outcomes (Moayedi et al., 2014).

Neurotransmitters involved in the processing of unexpected positive outcomes

• Dopamine is the primary neurotransmitter involved in processing unexpected positive outcomes. Serotonin and norepinephrine also play modulatory roles, influencing mood, arousal, and the overall emotional response to rewards (Cohen et al., 2002).
• Dopamine, serotonin, and norepinephrine work together to influence our response to rewards by modulating different aspects of the reward experience. Dopamine primarily drives the learning and reinforcement aspects, while serotonin and norepinephrine modulate mood and arousal, ensuring that the emotional response aligns with the reward's significance (Hollerman & Schultz, 1998).

Dopamine: the central player in reward prediction error

• Why is dopamine considered central to the concept of reward prediction error? Dopamine is central to the concept of reward prediction error because it signals discrepancies between expected and actual rewards. According to Schultz (1997), when an individual predicts a reward and it occurs as expected, dopamine neurons remain stable. However, when a reward is greater or occurs unexpectedly, dopamine levels spike, signalling a positive prediction error. This error highlights the gap between expectation and reality, allowing the brain to adjust its predictions and reinforce behaviours that lead to unexpected positive outcomes. Essentially, dopamine serves as the neurochemical basis for learning through reward prediction and adjusting future behaviour (Schultz, 1997).

• How does dopamine signalling change in response to unexpected positive outcomes? Schultz (2007) emphasises that dopamine signalling undergoes significant changes when an individual experiences an unexpected positive outcome. In such cases, dopamine neurons exhibit a burst of activity, far exceeding normal levels. This heightened release of dopamine acts as a learning signal, reinforcing the behaviours that led to the unexpected reward. Over time, the brain uses this spike in dopamine to fine-tune its predictions, improving decision-making and enhancing learning processes for future scenarios (Schultz, 2007).

The modulatory roles of serotonin and norepinephrine

• Serotonin and norepinephrine modulate the brain's response to rewards by influencing mood and arousal, especially in unexpected situations. Norepinephrine, as described by Aston-Jones and Cohen (2005), regulates attention and arousal, allowing the brain to focus on significant rewards. It enhances responsiveness for optimal reward-seeking behaviour. In contrast, serotonin plays a nuanced role in decision-making and mood regulation, particularly in uncertain contexts. Pizzagalli (2014) highlights that serotonin levels impact anhedonia and stress, key factors in reward processing. Thus, norepinephrine boosts arousal and focus, while serotonin shapes emotional and motivational responses in reward evaluation.

Dopamine: the central player in reward prediction error

• Why is dopamine considered central to the concept of reward prediction error?

Dopamine is central to the concept of reward prediction error because it signals discrepancies between expected and actual rewards. According to Schultz (1997), when an individual predicts a reward and it occurs as expected, dopamine neurons remain stable. However, when a reward is greater or occurs unexpectedly, dopamine levels spike, signalling a positive prediction error. This error highlights the gap between expectation and reality, allowing the brain to adjust its predictions and reinforce behaviours that lead to unexpected positive outcomes. Essentially, dopamine serves as the neurochemical basis for learning through reward prediction and adjusting future behaviour.

• How does dopamine signalling change in response to unexpected positive outcomes?

Schultz (2007) emphasises that dopamine signalling undergoes significant changes when an individual experiences an unexpected positive outcome. In such cases, dopamine neurons exhibit a burst of activity, far exceeding normal levels. This heightened release of dopamine acts as a learning signal, reinforcing the behaviours that led to the unexpected reward. Over time, the brain uses this spike in dopamine to fine-tune its predictions, improving decision-making and enhancing learning processes for future scenarios.

The modulatory roles of serotonin and norepinephrine

• How do serotonin and norepinephrine modulate the brain's response to rewards?

While dopamine plays a primary role in reward learning and prediction error, serotonin and norepinephrine modulate the brain's emotional and arousal responses to rewards (Pizzagalli, 2014). Serotonin helps regulate mood and emotional responses, influencing how individuals feel after receiving a reward. Norepinephrine, on the other hand, enhances attention and arousal, making the brain more sensitive to rewarding stimuli (Pizzagalli, 2014). Together, these neurotransmitters ensure that the brain's reaction to rewards is not just about learning but also involves a balanced emotional and arousal response (Pizzagalli, 2014).

• What are the distinct roles of these neurotransmitters in shaping mood and arousal during unexpected positive outcomes?

The distinct roles of serotonin and norepinephrine in shaping mood and arousal. Serotonin is primarily responsible for regulating emotional responses to unexpected positive outcomes, stabilising mood, and promoting a sense of well-being after a reward (Aston-Jones & Cohen, 2005). In contrast, norepinephrine enhances arousal and alertness, helping individuals stay focused on the positive outcome and increasing their readiness to engage with rewarding stimuli (Aston-Jones & Cohen, 2005). By modulating both mood and arousal, serotonin and norepinephrine ensure that the brain's response to unexpected rewards is both emotionally balanced and action-oriented (Aston-Jones & Cohen, 2005).

The concept of reward prediction error: mechanisms and neural correlates

• Reward prediction error is the difference between expected and actual outcomes. It is critical for learning and behaviour adjustment because it signals when outcomes differ from expectations, prompting the brain to update its predictions and modify behaviour to optimise future rewards (Pearce & Hall, 1980).
• Key brain regions involved in detecting and responding to reward prediction errors include the VTA, NAcc, and the anterior cingulate cortex (ACC). These regions work together to process the discrepancy between expected and actual rewards and to adjust behaviour accordingly (Schultz, 1998).

Defining reward prediction error

• How is reward prediction error defined within the context of cognitive neuroscience? In cognitive neuroscience, reward prediction error refers to the difference between expected and actual outcomes during a learning process. Schultz (1997) explains that when an outcome meets expectations, no prediction error occurs, and dopamine neurons remain stable. However, when the outcome deviates from expectations, particularly in the case of unexpected rewards, dopamine neurons exhibit increased activity (Schultz, 1997). This neural signal represents the reward prediction error and serves as a critical learning mechanism, helping the brain update its expectations and adjust future behaviours accordingly (Schultz, 1997).

• Why are positive prediction errors particularly important in the reinforcement of behaviour? Positive prediction errors are crucial for reinforcing behaviour because they signal that an unexpected reward has been obtained, thus making the behaviour that led to it more likely to be repeated in the future (Sutton & Barto, 2018). When the actual outcome exceeds expectations, dopamine levels spike, reinforcing the neural pathways associated with the behaviour (Sutton & Barto, 2018). This reinforcement mechanism strengthens the link between the action and the reward, increasing the likelihood of repeating the behaviour in pursuit of similar outcomes (Sutton & Barto, 2018).

Neural mechanisms: from prediction to surprise

• What neural mechanisms underlie the transition from expectation to surprise? Kakade and Dayan (2002) describe the neural mechanisms that govern the transition from expectation to surprise as involving the brain's reward system, specifically the ventral tegmental area (VTA) and the nucleus accumbens (NAcc). When an expected reward occurs, these regions maintain a steady dopamine signal. However, when an unexpected reward is received, dopamine activity spikes in the VTA, sending a signal to the NAcc and other regions, which leads to the experience of surprise. This neural response prompts the brain to reevaluate its predictions, ultimately aiding in the adjustment of future expectations and behaviours (Kakade & Dayan, 2002).
• How do these mechanisms contribute to updating our predictions and behaviours? The increased dopamine release in response to unexpected rewards acts as a signal for updating predictions and behaviours (Schultz, 2007). The brain uses this reward prediction error signal to adjust its expectations for future outcomes, improving decision-making and behaviour optimisation; by updating predictions based on unexpected outcomes, the brain refines its understanding of which actions lead to desirable rewards, thus enhancing learning and behaviour adaptation over time (Schultz, 2007).

Behavioural implications of unexpected positive outcomes

• Unexpected positive outcomes reinforce adaptive behaviours by strengthening the neural connections associated with those behaviours. The release of dopamine in response to these outcomes enhances the likelihood of repeating the behaviour that led to the reward (Bandura, 1997).
• The broader behavioural implications of experiencing unexpected rewards include increased motivation, improved decision-making, and enhanced learning. These outcomes can lead to more adaptive and flexible behaviour, as individuals become better at adjusting their actions based on new information (Hollerman & Schultz, 1998).

Learning and memory: reinforcement of adaptive behaviours

• How do unexpected positive outcomes reinforce learning and memory? Unexpected positive outcomes reinforce learning and memory by inducing a dopamine release, which signals a reward prediction error (Schultz, 1998). When the actual reward exceeds the expected reward, dopamine neurons in regions like the VTA and NAcc increase firing rates, which strengthens neural connections associated with the behaviour that led to the reward (Schultz, 1998). This process allows individuals to better encode successful behaviours in memory, making it more likely for them to repeat these actions in the future (Schultz, 1998). This reinforcement mechanism is central to adaptive learning, as it helps individuals adjust to dynamic environments (Schultz, 1998).

Figure 2. Visual representation of the impact level of different processes involved, from the initial unexpected reward to the resulting adaptive behaviour.

• In what ways can these outcomes lead to more adaptive behaviour? The experience of unexpected rewards promotes more adaptive behaviour by enhancing the brain's capacity to update its expectations and predictions based on new information (See Figure 2); the release of dopamine during these unexpected outcomes encourages individuals to explore different strategies and adjust their behaviour to maximise future rewards (Daw et al., 2006). This adaptability is critical for decision-making, as it allows for flexibility in response to changing conditions, helping individuals improve their problem-solving and exploration of optimal strategies (Daw et al., 2006).

Decision-making: the impact of surprises on risk-raking

• How do positive surprises influence risk-taking behaviour in decision-making? Positive surprises can significantly impact risk-taking behaviour, often prompting individuals to pursue more uncertain yet potentially rewarding actions. According to Kahneman and Tversky’s Prospect Theory, unexpected positive outcomes enhance the perceived value of potential rewards, leading individuals to take greater risks in anticipation of additional gains (Kahneman & Tversky, 1979). For example, stock traders who unexpectedly profit from volatile stocks may feel encouraged to invest in similarly high-risk assets, driven by the hope of further rewards. A case study in the gambling industry illustrates this phenomenon: unexpected jackpots on slot machines often lead players to increase their bets and play time, despite unchanged odds. The thrill of winning reinforces the belief in potential future rewards, resulting in riskier behaviours (Berridge & Robinson, 2003). Controlled experiments also support this; participants who received unexpected rewards in risk-taking tasks displayed a greater propensity for risk in subsequent trials. For instance, those who won unexpectedly after a low-probability bet were more likely to place riskier bets later (Tobler et al., 2003). This shift in behaviour demonstrates how unexpected rewards recalibrate the brain's reward systems, altering perceptions of future outcomes based on recent gains (Schultz, 2006).
• What neural processes are involved in adjusting decisions after an unexpected positive outcome? Following an unexpected positive outcome, the brain's dopamine system is crucial in adjusting future decisions. Tobler et al. (2003) explain that dopamine neurons signal both the occurrence of rewards and the absence of expected ones. This feedback mechanism enables individuals to refine their expectations and adjust decision-making strategies. By recalibrating expected outcomes and weighing future risks and rewards, individuals can optimize their behaviour to increase the likelihood of future positive results (Tobler et al., 2003).

Want to explore more about how positive surprises can shape your decision-making? Understanding the impact of unexpected rewards can help you optimise your choices and enhance your overall well-being. By learning how to harness the power of positive experiences, you can foster a mindset that encourages risk-taking and adaptability in various aspects of your life. Click on the link below and note how a positive surprise shapes your decision-making in the next 24 hours. Click here

Applications in real-world scenarios

• The principles of reward prediction error can be applied to real-world situations by using positive reinforcement to encourage desired behaviours, improve learning outcomes, and enhance overall motivation (Schultz, 2006).
• Understanding how the brain processes unexpected positive outcomes has practical implications for fields such as education, therapy, and marketing, where strategies can be developed to leverage reward mechanisms and improve outcomes (Mullainathan & Thaler, 2016).

Educational strategies: enhancing learning through positive reinforcement

• How can educators use unexpected positive outcomes to enhance student learning? Educators can enhance student learning by integrating positive reinforcement techniques into their teaching methods. Providing unexpected praise or rewards, such as bonus points for participation, motivates students to engage more actively in learning (Hattie & Timperley, 2007). This strategy boosts performance and fosters a positive attitude towards learning. Gamification is an effective approach, incorporating game-like elements such as badges and rewards to create frequent positive surprises, reinforcing learning behaviours (Schultz, 2007). For instance, a math teacher could implement a points system for assignments, offering unexpected rewards for milestones. This aligns with reward prediction error, helping students update their expectations and increasing motivation.
• What strategies can be developed based on the neuroscience of reward prediction error? Understanding the brain's response to unexpected positive outcomes can enhance treatment efficacy. Therapists can reinforce positive behaviours with surprise rewards. For example, in cognitive-behavioural therapy (CBT) for depression, unexpected rewards for achieving small goals can boost clients' motivation (Kazdin, 2008). Positive reinforcement also plays a critical role in addiction treatment. Therapists can use contingency management, offering tangible rewards (e.g., vouchers) for maintaining sobriety or achieving milestones. This capitalises on the brain's reward mechanisms, reinforcing adaptive behaviours and reshaping clients’ expectations positively (Vlaev & Dolan, 2015). For instance, clients who remain drug-free might receive gift cards, serving as powerful motivation for maintaining progress.

Clinical interventions: leveraging reward mechanisms in therapy

• How can therapeutic approaches benefit from understanding the brain's response to unexpected positive outcomes? Therapeutic approaches can benefit from understanding the brain's response to unexpected positive outcomes by incorporating strategies that enhance client engagement and motivation. Research shows that the brain's reward systems, especially dopamine pathways, activate in response to unexpected positive outcomes, creating feelings of pleasure and reinforcement (Kazdin, 2008). Therapists can leverage this by designing interventions that include surprise rewards or unexpected acknowledgments of progress. For instance, providing immediate positive feedback when clients achieve small goals can boost their motivation to engage in therapy, aligning with the principles of reward prediction error.
• What role do positive reinforcement and reward prediction error play in clinical settings? In clinical settings, positive reinforcement and reward prediction error are crucial for shaping behaviours and encouraging treatment adherence. Positive reinforcement, through tangible rewards or praise, helps clients associate their efforts with positive outcomes (Vlaev & Dolan, 2015). For example, in anxiety treatment, clients may receive rewards for facing fears, increasing the likelihood of repeating those behaviours. By understanding reward prediction error, therapists can optimize the timing and nature of rewards, ensuring clients experience meaningful positive outcomes. This enhances the therapeutic alliance and fosters resilience, promoting long-term behaviour change and improved mental health (Vlaev & Dolan, 2015). Overall, integrating neuroscience insights into clinical practice can lead to more effective and engaging interventions.

Case Study: Sarah After implementing the new strategy, Sarah observed a marked increase in student engagement and performance. The unexpected rewards not only motivated students to put in more effort but also improved their overall enthusiasm for learning. The positive emotional response to these rewards reinforced their commitment to academic excellence. Sarah's case demonstrates the effectiveness of using unexpected positive outcomes to enhance motivation and performance. By leveraging insights from psychological science, educators can design more effective strategies that capitalise on the brain's reward system to foster better learning environments.

Quizzes

Choose your answers and click "Submit":

1 The prefrontal cortex plays a role in integrating information about rewards:

	True
	False

2 The nucleus accumbens (NAcc) is not involved in reward processing:

	True
	False

Conclusion

The processing of unexpected positive outcomes plays a pivotal role in shaping behaviour, decision-making, and emotional states through the brain’s reward system. Central to this process is the neurotransmitter dopamine, which drives learning through reward prediction error. When an unanticipated reward is received, dopamine release spikes, reinforcing the behaviours that led to the reward. This mechanism allows the brain to adjust future predictions, thereby improving decision-making and promoting adaptive behaviour. Key neural circuits, including the ventral tegmental area (VTA) and the nucleus accumbens (NAcc), are critical in this reward processing. The VTA modulates dopamine signalling, while the NAcc is involved in the anticipation and processing of rewards, contributing to the reinforcement of successful behaviours and the strengthening of learning and memory.

Beyond dopamine, serotonin and norepinephrine also play crucial modulatory roles in response to unexpected rewards. Serotonin regulates mood and emotional responses, ensuring that the emotional experience aligns with the reward’s significance, while norepinephrine enhances arousal and attentional focus, helping individuals remain alert to rewarding stimuli. Together, these neurotransmitters work in concert to not only reinforce learning but also ensure that the brain’s response to rewards is balanced between emotional regulation and cognitive adaptation.

The understanding of these neurochemical processes has far-reaching implications for various fields, including clinical therapy, education, and decision-making strategies. In therapeutic settings, leveraging reward prediction errors and the brain’s reward system can enhance interventions for conditions like depression and addiction, where reinforcement of positive behaviours is crucial. In educational contexts, the application of reward mechanisms through positive reinforcement can enhance student motivation and learning outcomes. Overall, the integration of dopamine-driven learning, emotional modulation by serotonin, and attentional enhancement by norepinephrine provides a comprehensive framework for understanding how unexpected positive outcomes influence behaviour and cognition, offering pathways for improving therapeutic, educational, and real-world decision-making processes.

See also

• Reward system (Wikipedia)
• Fundamentals of Neuroscience/Emotion (Wikiversity)

References

Aston-Jones, G., & Cohen, J. D. (2005). An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annual Review of Neuroscience, 28(1), 403–450. https://doi.org/10.1146/annurev.neuro.28.061604.135709

Bandura, A. (1997). Self-efficacy: The exercise of control. W. H. Freeman. Berridge, K. C., & Robinson, T. E. (2003). Parsing reward. Trends in Neurosciences, 26(9), 507–513. https://doi.org/10.1016/s0166-2236(03)00233-9

Cohen, J. D., Braver, T. S., & Brown, J. W. (2002). Computational perspectives on dopamine function in prefrontal cortex. Current Opinion in Neurobiology, 12(2), 223–229. https://doi.org/10.1016/s0959-4388(02)00314-8

Daw, N. D., O’Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441(7095), 876–879. https://doi.org/10.1038/nature04766

Grossberg, J. M. (1964). Behavior therapy: A review. Psychological Bulletin, 62(2), 73–88. https://doi.org/10.1037/h0041033

Hattie, J., & Timperley, H. (2007). The Power of Feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487

Hollerman, J. R., & Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nature Neuroscience, 1(4), 304–309. https://doi.org/10.1038/1124

Homberg, J. R. (2012). Serotonin and decision making processes. Neuroscience & Biobehavioral Reviews, 36(1), 218–236. https://doi.org/10.1016/j.neubiorev.2011.06.001

Kahneman, D., & Tversky, A. (1979). Prospect Theory: An Analysis of Decision under Risk. Econometrica, 47(2), 263. https://doi.org/10.2307/1914185

Kakade, S., & Dayan, P. (2002). Dopamine: generalization and bonuses. Neural Networks, 15(4-6), 549–559. https://doi.org/10.1016/s0893-6080(02)00048-5

Kazdin, A. E. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist, 63(3), 146–159. https://doi.org/10.1037/0003-066x.63.3.146

Knutson, B., & Cooper, J. C. (2005). Functional magnetic resonance imaging of reward prediction. Current Opinion in Neurology, 18(4), 411–417. https://doi.org/10.1097/01.wco.0000173463.24758.f6

Kringerlbach, M. (2004). The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Progress in Neurobiology, 72(5), 341–372. https://doi.org/10.1016/j.pneurobio.2004.03.006

Miller, E. K., & Cohen, J. D. (2001). An Integrative Theory of Prefrontal Cortex Function. Annual Review of Neuroscience, 24(1), 167–202. https://doi.org/10.1146/annurev.neuro.24.1.167

Moayedi, M., Salomons, T. V., Dunlop, K. A. M., Downar, J., & Davis, K. D. (2014). Connectivity-based parcellation of the human frontal polar cortex. Brain Structure and Function, 220(5), 2603–2616. https://doi.org/10.1007/s00429-014-0809-6

Mullainathan, S., & Thaler, R. H. (2016). Behavioral Economics. NBER Working Paper Series. https://www.nber.org/papers/w7948

Pearce, J. M., & Hall, G. (1980). A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review, 87(6), 532–552. https://doi.org/10.1037//0033-295x.87.6.532

Pizzagalli, D. A. (2014). Depression, Stress, and Anhedonia: Toward a Synthesis and Integrated Model. Annual Review of Clinical Psychology, 10(1), 393–423. https://doi.org/10.1146/annurev-clinpsy-050212-185606

Schultz, W. (1997). Dopamine neurons and their role in reward mechanisms Electronic identifier: 0959-4388-007-00191 0 Current Biology Ltd ISSN 0959-4388 Abbreviations GABA y-aminobutyric acid NMDA N-methyl-o-aspartate TD models temporal difference models. Current Opinion in Neurobiology, 7, 191–197.

Schultz, W. (1998). Predictive Reward Signal of Dopamine Neurons. Journal of Neurophysiology, 80(1), 1–27. https://doi.org/10.1152/jn.1998.80.1.1

Schultz, W. (2000). Multiple reward signals in the brain. Nature Reviews Neuroscience, 1(3), 199–207. https://doi.org/10.1038/35044563

Schultz, W. (2006). Behavioral Theories and the Neurophysiology of Reward. Annual Review of Psychology, 57(1), 87–115. https://doi.org/10.1146/annurev.psych.56.091103.070229

Schultz, W. (2015). Neuronal Reward and Decision Signals: From Theories to Data. Physiological Reviews, 95(3), 853–951. https://doi.org/10.1152/physrev.00023.2014

Sutton, R. S., & Barto, A. G. (2018). Reinforcement Learning, second edition. Google Books. https://books.google.com.au/books?hl=en&lr=&id=uWV0DwAAQBAJ&oi=fnd&pg=PR7&dq=Reinforcement+Learning:+An+Introduction&ots=mjpHu2Z3h1&sig=DmRSFiMhDhJo_Em4kc7gjRqZa-k#v=onepage&q=Reinforcement%20Learning%3A%20An%20Introduction&f=false

Tobler, P. N., Dickinson, A., & Schultz, W. (2003). Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm. The Journal of Neuroscience, 23(32), 10402–10410. https://doi.org/10.1523/jneurosci.23-32-10402.2003

Vlaev, I., & Dolan, P. (2015). Action Change Theory: A Reinforcement Learning Perspective on Behavior Change. Review of General Psychology, 19(1), 69–95. https://doi.org/10.1037/gpr0000029

Wise, R. A. (2004). The neurotransmitter dopamine -particularly nigrostriatal dopamine (BOX 1) -has long been identi- fied with motor function. Nature Reviews | Neuroscience, 5. https://doi.org/10.1038/nrn1406