The Anterior Insula Processes a Time-Resolved Subjective Risk Prediction Error.

The insula processes errors in the prediction of risky, motivationally relevant outcomes and thereby is thought to respond similarly to better-than-predicted and worse-than-predicted outcomes. However, the nature of the encoded risk prediction error signals remained unclear. Moreover, the insula was proposed to preferentially process events and stimuli in the aversive domain, rather than in a domain-general fashion.

Neural Representation of Valenced and Generic Probability and Uncertainty.

Representing the probability and uncertainty of outcomes facilitates adaptive behavior by allowing organisms to prepare in advance and devote attention to relevant events. Probability and uncertainty are often studied only for valenced (appetitive or aversive) outcomes, raising the question of whether the identified neural machinery also processes the probability and uncertainty of motivationally neutral outcomes. Here, we aimed to dissociate valenced from valence-independent (i.

Characterizing Human Habits in the Lab.

Habits pose a fundamental puzzle for those aiming to understand human behavior. They pervade our everyday lives and dominate some forms of psychopathology but are extremely hard to elicit in the lab. In this Registered Report, we developed novel experimental paradigms grounded in computational models, which suggest that habit strength should be proportional to the frequency of behavior and, in contrast to previous research, independent of value.

Arbitration between model-free and model-based control is not affected by transient changes in tonic serotonin levels.

Background: Serotonin has been suggested to modulate decision-making by influencing the arbitration between model-based and model-free control. Disruptions in these control mechanisms are involved in mental disorders such as drug dependence or obsessive-compulsive disorder. While previous reports indicate that lower brain serotonin levels reduce model-based control, it remains unknown whether increases in serotonergic availability might thus increase model-based control.

Enhancing precision in human neuroscience.

Human neuroscience has always been pushing the boundary of what is measurable. During the last decade, concerns about statistical power and replicability - in science in general, but also specifically in human neuroscience - have fueled an extensive debate. One important insight from this discourse is the need for larger samples, which naturally increases statistical power.

Stronger Prejudices Are Associated With Decreased Model-Based Control.

Prejudices against minorities can be understood as habitually negative evaluations that are kept in spite of evidence to the contrary. Therefore, individuals with strong prejudices might be dominated by habitual or "automatic" reactions at the expense of more controlled reactions. Computational theories suggest individual differences in the balance between habitual/model-free and deliberative/model-based decision-making.

Testing models at the neural level reveals how the brain computes subjective value.

Decisions are based on the subjective values of choice options. However, subjective value is a theoretical construct and not directly observable. Strikingly, distinct theoretical models competing to explain how subjective values are assigned to choice options often make very similar behavioral predictions, which poses a major difficulty for establishing a mechanistic, biologically plausible explanation of decision-making based on behavior alone.

Model-Based and Model-Free Control Predicts Alcohol Consumption Developmental Trajectory in Young Adults: A 3-Year Prospective Study.

Background: A shift from goal-directed toward habitual control has been associated with alcohol dependence. Whether such a shift predisposes to risky drinking is not yet clear. We investigated how goal-directed and habitual control at age 18 predict alcohol use trajectories over the course of 3 years.

Association of the A118G polymorphism and Pavlovian-to-instrumental transfer: Clinical relevance for alcohol dependence.

Background: Pavlovian-to-instrumental transfer (PIT) quantifies the extent to which a stimulus that has been associated with reward or punishment alters operant behaviour. In alcohol dependence (AD), the PIT effect serves as a paradigmatic model of cue-induced relapse. Preclinical studies have suggested a critical role of the opioid system in modulating Pavlovian-instrumental interactions.

Working Memory, Fluid Reasoning, and Complex Problem Solving: Different Results Explained by the Brunswik Symmetry.

In order to investigate the nature of complex problem solving (CPS) within the nomological network of cognitive abilities, few studies have simultantiously considered working memory and intelligence, and results are inconsistent. The Brunswik symmetry principle was recently discussed as a possible explanation for the inconsistent findings because the operationalizations differed greatly between the studies. Following this assumption, 16 different combinations of operationalizations of working memory and fluid reasoning were examined in the present study (N=152).

Susceptibility to interference between Pavlovian and instrumental control is associated with early hazardous alcohol use.

Pavlovian-to-instrumental transfer (PIT) tasks examine the influence of Pavlovian stimuli on ongoing instrumental behaviour. Previous studies reported associations between a strong PIT effect, high-risk drinking and alcohol use disorder. This study investigated whether susceptibility to interference between Pavlovian and instrumental control is linked to risky alcohol use in a community sample of 18-year-old male adults.

Nucleus accumbens connectivity at rest is associated with alcohol consumption in young male adults.

Alcohol consumption during adolescence might impede normal brain development, while more excessive drinking during this period poses a risk for developing alcohol use disorder. Here it was tested whether nucleus accumbens (NAcc) resting-state functional connectivity could be associated with lifetime drinking behavior in young adults, and whether it could predict their alcohol consumption during a one-year follow-up period. The current investigation was part of the bicentric Learning and Alcohol Dependence (LeAD) population-based prospective cohort study.

Dissociating neural learning signals in human sign- and goal-trackers.

Individuals differ in how they learn from experience. In Pavlovian conditioning models, where cues predict reinforcer delivery at a different goal location, some animals-called sign-trackers-come to approach the cue, whereas others, called goal-trackers, approach the goal. In sign-trackers, model-free phasic dopaminergic reward-prediction errors underlie learning, which renders stimuli 'wanted'.

Pavlovian-To-Instrumental Transfer and Alcohol Consumption in Young Male Social Drinkers: Behavioral, Neural and Polygenic Correlates.

In animals and humans, behavior can be influenced by irrelevant stimuli, a phenomenon called Pavlovian-to-instrumental transfer (PIT). In subjects with substance use disorder, PIT is even enhanced with functional activation in the nucleus accumbens (NAcc) and amygdala. While we observed enhanced behavioral and neural PIT effects in alcohol-dependent subjects, we here aimed to determine whether behavioral PIT is enhanced in young men with high-risk compared to low-risk drinking and subsequently related functional activation in an a-priori region of interest encompassing the NAcc and amygdala and related to polygenic risk for alcohol consumption.

Acute alcohol effects on impulsive choice in adolescents.

Background: Neurodevelopmental and alcohol-induced changes in decision-making have been proposed to critically influence impulsive behaviour in adolescents.

Objective: This study tested the influence of acute alcohol administration on impulsive choice in adolescents.

Methods: Fifty-four males aged 18-19 years were tested in a single-blind placebo-controlled cross-over design.

Risk seeking for losses modulates the functional connectivity of the default mode and left frontoparietal networks in young males.

Value-based decision making (VBDM) is a principle that states that humans and other species adapt their behavior according to the dynamic subjective values of the chosen or unchosen options. The neural bases of this process have been extensively investigated using task-based fMRI and lesion studies. However, the growing field of resting-state functional connectivity (RSFC) may shed light on the organization and function of brain connections across different decision-making domains.

Identification of heavy drinking in the 10-item AUDIT: Results from a prospective study among 18-21years old non-dependent German males.

Background: Alcohol consumption is pivotal for the subsequent development of alcohol use disorders (AUD). The Alcohol Use Disorders Identification Test (AUDIT) is a recommended AUD screening tool for prevention and primary care settings. The objectives of this study were to test how many participants with heavy drinking are unidentified by the AUDIT, if proportions of unidentified participants vary over time, and whether this unidentified risk group (URG) was clinically relevant in terms of drinking behavior reports and AUD risk factors, as well as future adverse outcomes, such as craving, dependence symptoms, or depression.

Neural correlates of instrumental responding in the context of alcohol-related cues index disorder severity and relapse risk.

The influence of Pavlovian conditioned stimuli on ongoing behavior may contribute to explaining how alcohol cues stimulate drug seeking and intake. Using a Pavlovian-instrumental transfer task, we investigated the effects of alcohol-related cues on approach behavior (i.e.

Impulsive Decision Making in Young Adult Social Drinkers and Detoxified Alcohol-Dependent Patients: A Cross-Sectional and Longitudinal Study.

Background: Impulsive decision making relates to problematic substance use. Specifically, altered delay discounting (DD) has been suggested as a behavioral marker for addiction, while other relevant facets of choice impulsivity such as probability discounting (PD) or loss aversion are clearly understudied.

Methods: Two studies were performed collecting behavioral data on choice impulsivity with a value-based decision-making battery providing estimates of DD, PD for gains and losses, and loss aversion.

When Habits Are Dangerous: Alcohol Expectancies and Habitual Decision Making Predict Relapse in Alcohol Dependence.

Background: Addiction is supposedly characterized by a shift from goal-directed to habitual decision making, thus facilitating automatic drug intake. The two-step task allows distinguishing between these mechanisms by computationally modeling goal-directed and habitual behavior as model-based and model-free control. In addicted patients, decision making may also strongly depend upon drug-associated expectations.

How Accumulated Real Life Stress Experience and Cognitive Speed Interact on Decision-Making Processes.

Advances in neurocomputational modeling suggest that valuation systems for goal-directed (deliberative) on one side, and habitual (automatic) decision-making on the other side may rely on distinct computational strategies for reinforcement learning, namely model-free vs. model-based learning. As a key theoretical difference, the model-based system strongly demands cognitive functions to plan actions prospectively based on an internal cognitive model of the environment, whereas valuation in the model-free system relies on rather simple learning rules from operant conditioning to retrospectively associate actions with their outcomes and is thus cognitively less demanding.

No association of goal-directed and habitual control with alcohol consumption in young adults.

Alcohol dependence is a mental disorder that has been associated with an imbalance in behavioral control favoring model-free habitual over model-based goal-directed strategies. It is as yet unknown, however, whether such an imbalance reflects a predisposing vulnerability or results as a consequence of repeated and/or excessive alcohol exposure. We, therefore, examined the association of alcohol consumption with model-based goal-directed and model-free habitual control in 188 18-year-old social drinkers in a two-step sequential decision-making task while undergoing functional magnetic resonance imaging before prolonged alcohol misuse could have led to severe neurobiological adaptations.

Don't Think, Just Feel the Music: Individuals with Strong Pavlovian-to-Instrumental Transfer Effects Rely Less on Model-based Reinforcement Learning.

Behavioral choice can be characterized along two axes. One axis distinguishes reflexive, model-free systems that slowly accumulate values through experience and a model-based system that uses knowledge to reason prospectively. The second axis distinguishes Pavlovian valuation of stimuli from instrumental valuation of actions or stimulus-action pairs.

Pavlovian-to-instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependence.

In detoxified alcohol-dependent patients, alcohol-related stimuli can promote relapse. However, to date, the mechanisms by which contextual stimuli promote relapse have not been elucidated in detail. One hypothesis is that such contextual stimuli directly stimulate the motivation to drink via associated brain regions like the ventral striatum and thus promote alcohol seeking, intake and relapse.