Two-Step Task Reinforcement Learning fMRI (ds007474)
2-step task reinforcement learning fMRI dataset
Task fMRI and structural brain MRI of healthy adults performing a two-step decision task, collected to study how model-based and model-free reinforcement learning signals in the brain differ between individuals. 189 people from greater Los Angeles, in BIDS under CC0.
Overview
This release holds the imaging data of a Caltech and UCLA study by John O'Doherty's group on how people differ in the way they learn from rewards. Healthy adults played a variant of the two-step task, a sequential choice game that separates model-based planning from model-free habit-like learning, while their brains were scanned with fMRI. The imaging data sit on OpenNeuro as ds007474 under CC0. Event timings and behavioral responses are on OSF (doi:10.17605/OSF.IO/CTFZD), and task and analysis code on GitHub. The data suit work on reward learning, value signals in the striatum and prefrontal cortex, and brain-behavior links across individuals.
Composition
189 adults were scanned. Every subject has a T1-weighted and a T2-weighted structural image, two task fMRI runs with single-band reference images, and a pair of opposite phase-encoding field maps per run. One subject lacks the field maps of the first run. Participants were recruited in greater Los Angeles at ages 18 to 65 and screened by a psychiatrist; people reporting substance use, anxiety or depressive disorders, or psychiatric medication, were not included. The two-step task was paired with a second task on habits in the same session, and the subject id records whether the two-step task came first or second. Five subjects saw only state-contingent rewards. The paper analysed 179 of the 189 after excluding 10 for head motion; of those 179, 105 were female and the mean age was 30.4 years. Sex and age per subject are not part of the OpenNeuro release.
Acquisition
All scans come from one Siemens Prisma 3T with a 32-channel head coil at the Caltech Brain Imaging Center. Functional runs use multiband EPI (factor 4) with 2 mm isotropic voxels and TR 1.12 s. T1w and T2w images are 0.9 mm isotropic. Data are organized in BIDS.
Annotations
There are no image labels. The derivatives folder holds group-level SPM t-maps for model-based and model-free value and prediction error regressors.
Known limitations
- Single site and scanner, and a screened healthy sample, so results may not transfer to clinical populations.
- No participants.tsv, so demographics cannot be matched to subjects.
- Behavioral data needed to model the task are hosted separately on OSF.
Cohort
Aggregate numbers from the sources below. Bars are relative to the 189 subjects.
Contrast / sequence
Groups can overlap
- T1-weighted 189 100%
- T2-weighted 189 100%
- BOLD fMRI 189 100%
anat/*_T1w.nii.gz, anat/*_T2w.nii.gz, func/*_bold.nii.gz in File listing and JSON sidecars of the ds007474 BIDS repository (CC0), subjects counted per T1w, T2w and bold NIfTI file
Field strength
- 3 T 189 100%
STAR Methods: Functional MRI acquisition in Ding et al. 2026, Model-based and model-free valuation signals in the human brain vary markedly in relation to individual differences in behavioral control, Cell Reports (PMC full text)
Condition
Groups can overlap
- Healthy control 189 100%
README in OpenNeuro ds007474 snapshot 1.0.5 (dataset_description.json, README, CHANGES and snapshot size)
Scanner vendor
- Siemens Healthineers 189 100%
STAR Methods: Functional MRI acquisition in Ding et al. 2026, Model-based and model-free valuation signals in the human brain vary markedly in relation to individual differences in behavioral control, Cell Reports (PMC full text)
Country
- United States 189 100%
STAR Methods: Recruitment and inclusion in Ding et al. 2026, Model-based and model-free valuation signals in the human brain vary markedly in relation to individual differences in behavioral control, Cell Reports (PMC full text)
Contrast combinations
How many subjects have exactly each set of contrasts.
| T1w | T2w | bold | Subjects with exactly this set |
|---|---|---|---|
189 |
License and access
Our reading of the license, not legal advice. Before you use the data, read the original license and confirm that your use is allowed. We take no responsibility for how you use a dataset. Full disclaimer
Download without an account
Creative Commons Zero 1.0 Universal
Public domain dedication. Do anything with the data, including commercial use, without asking and without having to give credit.
dataset_description.json of snapshot 1.0.5 states "License" CC0. Event timing and behavioral data are on OSF (doi:10.17605/OSF.IO/CTFZD), outside this license statement.
What you can do
- Yes
- Yes
- Yes
- Yes
- Yes
What you can share
- Yes
- Yes
- Yes
What you must do
- No
- Share alike No
- No
- No
- Manuscript review No
- Release code No
- Return results No
- Delete after use No
Limits
- No
- Location limits No
Citation
Ding W, Cockburn J, Simon JP, Johri A, Cho SJ, Oh S, Feusner JD, Tadayonnejad R, O'Doherty JP. Model-based and model-free valuation signals in the human brain vary markedly in relation to individual differences in behavioral control. Cell Reports 45(6), 117454 (2026). doi:10.1016/j.celrep.2026.117454
Sources
Every number on this page comes from one of these documents. Each chart names the table or page it is taken from. The raw numbers are in stats.csv.
- Ding et al. 2026, Model-based and model-free valuation signals in the human brain vary markedly in relation to individual differences in behavioral control, Cell Reports (PMC full text) paper
- OpenNeuro ds007474 snapshot 1.0.5 (dataset_description.json, README, CHANGES and snapshot size) website
- File listing and JSON sidecars of the ds007474 BIDS repository (CC0), subjects counted per T1w, T2w and bold NIfTI file computed