A Large Video Set of Natural Human Actions for Visual and Cognitive Neuroscience Studies and Its Validation with FMRI

Overview

Journal Brain Sci

Publisher MDPI

Date 2023 Jan 21

PMID 36672043

Authors

Burcu A Urgen

Hilal Nizamoglu

Asli Eroglu

Guy A Orban

Affiliations

Soon will be listed here.

Abstract

The investigation of the perception of others' actions and underlying neural mechanisms has been hampered by the lack of a comprehensive stimulus set covering the human behavioral repertoire. To fill this void, we present a video set showing 100 human actions recorded in natural settings, covering the human repertoire except for emotion-driven (e.g., sexual) actions and those involving implements (e.g., tools). We validated the set using fMRI and showed that observation of the 100 actions activated the well-established action observation network. We also quantified the videos' low-level visual features (luminance, optic flow, and edges). Thus, this comprehensive video set is a valuable resource for perceptual and neuronal studies.

Citing Articles

An open-access database of video stimuli for action observation research in neuroimaging settings: psychometric evaluation and motion characterization.

Georgiev C, Legrand T, Mongold S, Fiedler-Valenta M, Guittard F, Bourguignon M Front Psychol. 2024; 15:1407458.

PMID: 39386138 PMC: 11461298. DOI: 10.3389/fpsyg.2024.1407458.

References

Kriegeskorte N, Mur M, Bandettini P . Representational similarity analysis - connecting the branches of systems neuroscience. Front Syst Neurosci. 2008; 2:4. PMC: 2605405. DOI: 10.3389/neuro.06.004.2008. View

Ferri S, Rizzolatti G, Orban G . The organization of the posterior parietal cortex devoted to upper limb actions: An fMRI study. Hum Brain Mapp. 2015; 36(10):3845-66. PMC: 5008173. DOI: 10.1002/hbm.22882. View

Abraham A, Pedregosa F, Eickenberg M, Gervais P, Mueller A, Kossaifi J . Machine learning for neuroimaging with scikit-learn. Front Neuroinform. 2014; 8:14. PMC: 3930868. DOI: 10.3389/fninf.2014.00014. View

Behzadi Y, Restom K, Liau J, Liu T . A component based noise correction method (CompCor) for BOLD and perfusion based fMRI. Neuroimage. 2007; 37(1):90-101. PMC: 2214855. DOI: 10.1016/j.neuroimage.2007.04.042. View

Zhang Y, Brady M, Smith S . Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans Med Imaging. 2001; 20(1):45-57. DOI: 10.1109/42.906424. View

Eickhoff S, Grefkes C, Zilles K, Fink G . The somatotopic organization of cytoarchitectonic areas on the human parietal operculum. Cereb Cortex. 2006; 17(8):1800-11. DOI: 10.1093/cercor/bhl090. View

Keefe B, Villing M, Racey C, Strong S, Wincenciak J, Barraclough N . A database of whole-body action videos for the study of action, emotion, and untrustworthiness. Behav Res Methods. 2014; 46(4):1042-51. PMC: 4237924. DOI: 10.3758/s13428-013-0439-6. View

Power J, Mitra A, Laumann T, Snyder A, Schlaggar B, Petersen S . Methods to detect, characterize, and remove motion artifact in resting state fMRI. Neuroimage. 2013; 84:320-41. PMC: 3849338. DOI: 10.1016/j.neuroimage.2013.08.048. View

Nelissen K, Borra E, Gerbella M, Rozzi S, Luppino G, Vanduffel W . Action observation circuits in the macaque monkey cortex. J Neurosci. 2011; 31(10):3743-56. PMC: 3099268. DOI: 10.1523/JNEUROSCI.4803-10.2011. View

10.

Satterthwaite T, Wolf D, Ruparel K, Erus G, Elliott M, Eickhoff S . Heterogeneous impact of motion on fundamental patterns of developmental changes in functional connectivity during youth. Neuroimage. 2013; 83:45-57. PMC: 3874413. DOI: 10.1016/j.neuroimage.2013.06.045. View

11.

Ferri S, Pauwels K, Rizzolatti G, Orban G . Stereoscopically Observing Manipulative Actions. Cereb Cortex. 2016; 26(8):3591-3610. PMC: 4961020. DOI: 10.1093/cercor/bhw133. View

12.

Sonkusare S, Breakspear M, Guo C . Naturalistic Stimuli in Neuroscience: Critically Acclaimed. Trends Cogn Sci. 2019; 23(8):699-714. DOI: 10.1016/j.tics.2019.05.004. View

13.

Abdollahi R, Kolster H, Glasser M, Robinson E, Coalson T, Dierker D . Correspondences between retinotopic areas and myelin maps in human visual cortex. Neuroimage. 2014; 99:509-24. PMC: 4121090. DOI: 10.1016/j.neuroimage.2014.06.042. View

14.

Huth A, Nishimoto S, Vu A, Gallant J . A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron. 2012; 76(6):1210-24. PMC: 3556488. DOI: 10.1016/j.neuron.2012.10.014. View

15.

Fleischer F, Caggiano V, Thier P, Giese M . Physiologically inspired model for the visual recognition of transitive hand actions. J Neurosci. 2013; 33(15):6563-80. PMC: 6619087. DOI: 10.1523/JNEUROSCI.4129-12.2013. View

16.

Choi H, Zilles K, Mohlberg H, Schleicher A, Fink G, Armstrong E . Cytoarchitectonic identification and probabilistic mapping of two distinct areas within the anterior ventral bank of the human intraparietal sulcus. J Comp Neurol. 2006; 495(1):53-69. PMC: 3429851. DOI: 10.1002/cne.20849. View

17.

Pitzalis S, Sereno M, Committeri G, Fattori P, Galati G, Patria F . Human v6: the medial motion area. Cereb Cortex. 2009; 20(2):411-24. PMC: 2803738. DOI: 10.1093/cercor/bhp112. View

18.

Kolster H, Peeters R, Orban G . The retinotopic organization of the human middle temporal area MT/V5 and its cortical neighbors. J Neurosci. 2010; 30(29):9801-20. PMC: 6632824. DOI: 10.1523/JNEUROSCI.2069-10.2010. View

19.

Klein A, Ghosh S, Bao F, Giard J, Hame Y, Stavsky E . Mindboggling morphometry of human brains. PLoS Comput Biol. 2017; 13(2):e1005350. PMC: 5322885. DOI: 10.1371/journal.pcbi.1005350. View

20.

Abdollahi R, Jastorff J, Orban G . Common and segregated processing of observed actions in human SPL. Cereb Cortex. 2012; 23(11):2734-53. DOI: 10.1093/cercor/bhs264. View