Audiovisual narrative speech fMRI (LORAX)
Data from: Neural correlates of multisensory enhancement in audiovisual narrative speech perception: a fMRI investigation
Task fMRI and T1-weighted brain MRI of healthy young adults hearing and watching a narrated story in auditory, visual, synchronous and asynchronous audiovisual blocks, collected to map multisensory enhancement in speech perception.
Overview
This release holds the raw imaging behind a study of how seeing a speaker's mouth changes brain responses to continuous, natural speech. Healthy young adults lay in the scanner while a video of a speaker reading the Dr. Seuss story "The Lorax" was cut into short sections, and each section was shown as sound only, video only, sound and video in sync, or sound and video out of sync. The study looked for brain regions whose response to synchronous audiovisual speech exceeded the responses to the single senses. The data were deposited on Dryad by Lars Ross and are mirrored on Zenodo under CC0.
Composition
The release has 53 subject folders. The paper reports that 60 people were scanned and 7 were excluded for technical problems, head motion or lack of task compliance, leaving 53 native English speakers aged 20 to 35 (mean 25), 25 of them female, without neurological or psychiatric history. Each folder holds one T1-weighted scan, three functional runs and three BrainVoyager protocol files (.prt) that give the first and last volume of every condition block.
Acquisition
Scanning used a 3 T Philips Achieva TX with a 32-channel head coil. The anatomical scan is a 1 mm isotropic MP-RAGE. The functional runs are gradient-echo EPI with a TR of 2 s and 1.67 x 1.67 x 2.3 mm voxels, 50 slices, and 158, 172 and 146 volumes per run; coverage leaves out the lower cerebellum. Sound came through MR-compatible headphones and video through MR-compatible goggles with an eye tracker used to check that eyes were open.
Known limitations
The functional data are stored as one Analyze image and header per volume, not as 4D NIfTI or BIDS. The T1-weighted images were defaced in BrainVoyager after transformation to Talairach space, so they are not in native scanner space; a JSON sidecar keeps selected header fields. The release has no participants table, so age and sex per subject are not available, and the behavioural speech-in-noise task described in the paper is not part of the files. The participant figures here come from the bioRxiv preprint; the journal version could not be opened for this entry.
Cohort
Aggregate numbers from the sources below. Bars are relative to the 53 subjects.
Sex
- Female 25 100%
Covers 25 of 53 subjects.
Materials and Methods: Participants in Ross et al. 2022, Neural correlates of multisensory enhancement in audiovisual narrative speech perception: a fMRI investigation, bioRxiv preprint (version 1, 2022-02-15)
Contrast / sequence
Groups can overlap
- T1-weighted 53 100%
- BOLD fMRI 53 100%
README_(4).txt: Data & file overview in Zenodo record 7884627 (record metadata and README_(4).txt)
Scanner vendor
- Philips 53 100%
Materials and Methods: MRI acquisition in Ross et al. 2022, Neural correlates of multisensory enhancement in audiovisual narrative speech perception: a fMRI investigation, bioRxiv preprint (version 1, 2022-02-15)
Age
mean 25 ± 3.8, range 20 to 35
Materials and Methods: Participants in Ross et al. 2022, Neural correlates of multisensory enhancement in audiovisual narrative speech perception: a fMRI investigation, bioRxiv preprint (version 1, 2022-02-15)
Condition
Groups can overlap
- Healthy control 53 100%
Materials and Methods: Participants in Ross et al. 2022, Neural correlates of multisensory enhancement in audiovisual narrative speech perception: a fMRI investigation, bioRxiv preprint (version 1, 2022-02-15)
Field strength
- 3 T 53 100%
Materials and Methods: MRI acquisition in Ross et al. 2022, Neural correlates of multisensory enhancement in audiovisual narrative speech perception: a fMRI investigation, bioRxiv preprint (version 1, 2022-02-15)
Contrast combinations
How many subjects have exactly each set of contrasts.
| T1w | bold | Subjects with exactly this set |
|---|---|---|
53 |
README_(4).txt: Data & file overview in Zenodo record 7884627 (record metadata and README_(4).txt)
License and access
Our reading of the license, not legal advice. Before you use the data, read the original license and confirm that your use is allowed. We take no responsibility for how you use a dataset. Full disclaimer
Download without an account
Creative Commons Zero 1.0 Universal
Public domain dedication. Do anything with the data, including commercial use, without asking and without having to give credit.
What you can do
- Yes
- Yes
- Yes
- Yes
- Yes
What you can share
- Yes
- Yes
- Yes
What you must do
- No
- Share alike No
- No
- No
- Manuscript review No
- Release code No
- Return results No
- Delete after use No
Limits
- No
- Location limits No
Citation
Ross LA, Molholm S, Butler JS, Del Bene VA, Foxe JJ. Neural correlates of multisensory enhancement in audiovisual narrative speech perception: A fMRI investigation. NeuroImage 263, 119598 (2022). doi:10.1016/j.neuroimage.2022.119598
Sources
Every number on this page comes from one of these documents. Each chart names the table or page it is taken from. The raw numbers are in stats.csv.