Motor processing modulates word comprehension
Corresponding Author
Giulia Togato
RGRLL Department, California State University Long Beach, California, USA
Correspondence should be addressed to Giulia Togato, RGRLL Department, California State University Long Beach, 1250 Bellflower Blvd. Office: AS-323, CA 90815, USA (email: [email protected]).
Search for more papers by this authorFilip Andras
Mind, Brain and Behavior Research Center (CIMCYC), Granada, Spain
University of Granada, Spain
Search for more papers by this authorElvira Miralles
Mind, Brain and Behavior Research Center (CIMCYC), Granada, Spain
Search for more papers by this authorPedro Macizo
Mind, Brain and Behavior Research Center (CIMCYC), Granada, Spain
University of Granada, Spain
Search for more papers by this authorCorresponding Author
Giulia Togato
RGRLL Department, California State University Long Beach, California, USA
Correspondence should be addressed to Giulia Togato, RGRLL Department, California State University Long Beach, 1250 Bellflower Blvd. Office: AS-323, CA 90815, USA (email: [email protected]).
Search for more papers by this authorFilip Andras
Mind, Brain and Behavior Research Center (CIMCYC), Granada, Spain
University of Granada, Spain
Search for more papers by this authorElvira Miralles
Mind, Brain and Behavior Research Center (CIMCYC), Granada, Spain
Search for more papers by this authorPedro Macizo
Mind, Brain and Behavior Research Center (CIMCYC), Granada, Spain
University of Granada, Spain
Search for more papers by this authorAbstract
We evaluated whether movement modulates the semantic processing of words. To this end, we used homograph words with two meanings, one associated with hand movements (e.g., ‘abanico’, ‘fan’ in Spanish) or foot movements (‘bota’, ‘boot’ in Spanish), and the other not associated with movement (‘abanico’, ‘range’ in Spanish; ‘bota’, ‘wineskin’ in Spanish). After the homograph, three words were presented, and participants were asked to choose the word related to one of the two homograph meanings. The words could be either related to the motor meaning of the homograph (‘fan-heat’), to the non-motor meaning of the homograph (‘range-possibility’) or unrelated (‘fan-phone’). The task was performed without movement (simple condition) or by performing hand (Experiment 1) and foot (Experiment 2) movements. Compared with the simple condition, the performance of movement oriented the preference towards the motor meaning of the homograph. This pattern of results confirms that movement modulates word comprehension.
Conflicts of interest
All authors declare no conflict of interest.
Open Research
Data availability statement
The data and materials for all experiments are available at: https://osf.io/ksw2g/?view_only=dba3c554c952414dab4e37443e0f1f06
Supporting Information
Filename | Description |
---|---|
bjop12507-sup-0001-Supinfo1.docxWord document, 29.5 KB | Supplementary Material 1 Homographs and Alternative Response Words Used in the Study. |
bjop12507-sup-0002-Supinfo2.docxWord document, 21.4 KB | Supplementary Material 2 Selection of non-homograph filler words. |
bjop12507-sup-0003-Supinfo3.docxWord document, 26.5 KB | Supplementary Material 3 Filler Words and Alternative Response Words Used in the Study |
bjop12507-sup-0004-Supinfo4.docxWord document, 19.7 KB | Supplementary Material 4 Experiment 1. Results obtained with filler words |
bjop12507-sup-0005-Supinfo5.docxWord document, 22.2 KB | Supplementary Material 5 Experiment 2. Results obtained with filler words |
bjop12507-sup-0006-Supinfo6.docxWord document, 50 KB | Supplementary Material 6 Data Analyses with Mixed Effect Models |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
References
- Aravena, P., Hurtado, E., Riveros, R., Cardona, J. F., Manes, F., & Ibáñez, A. (2010). Applauding with closed hands: Neural signature of action-sentence compatibility effects. PLoS One, 5, e11751. https://doi.org/10.1371/journal.pone.0011751
- Aziz-Zadeh, L., Wilson, S. M., Rizzolatti, G., & Iacoboni, M. (2006). Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Current Biology, 16, 1818–1823. https://doi.org/10.1016/j.cub.2006.07.060
- Bak, T. H., & Chandran, S. (2012). What wires together dies together: Verbs, actions and neurodegeneration in motor neuron disease. Cortex, 48, 936–944. https://doi.org/10.1016/j.cortex.2011.07.008
- Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral Brain Sciences, 22, 577–660. https://doi.org/10.1017/S0140525X99532147
- Barsalou, L. W. (2003). Abstraction in perceptual symbol systems. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 358, 1177–1187. https://doi.org/10.1098/rstb.2003.1319
- Barsalou, L. W. (2010). Grounded cognition: Past, present, and future. Topics in Cognitive Science, 2, 716–724. https://doi.org/10.1111/j.1756-8765.2010.01115.x
- Bergen, B., Lau, T.T., Narayan, S., Stojanovic, D., & Wheeler, K. (2010). Body partrepresentations in verbal semantics. Memory & Cognition, 38, 969–981. https://doi.org/10.3758/MC.38.7.969
- Bergen, B., & Wheeler, K. (2010). Grammatical aspect and mental simulation. Brain and Language, 112, 150–158. https://doi.org/10.1016/j.bandl.2009.07.002
- Binder, J. R., & Desai, R. H. (2011). The neurobiology of semantic memory. Trends in Cognitive Sciences, 15, 527–536. https://doi.org/10.1016/j.tics.2011.10.001
- Boulenger, V., Roy, A. C., Paulignan, Y., Deprez, V., Jeannerod, M., & Nazir, T. A. (2006). Cross-talk between language processes and overt motor behavior in the first 200 msec of processing. Journal of Cognitive Neuroscience, 18, 1607–1615. https://doi.org/10.1162/jocn.2006.18.10.1607
- Boulenger, V., Shtyrov, Y., & Pulvermüller, F. (2012). When do you grasp the idea? MEG evidence for instantaneous idiom understanding. NeuroImage, 59, 3502–3513. https://doi.org/10.1016/j.neuroimage.2011.11.011
- Boulenger, V., Silber, B. Y., Roy, A. C., Paulignan, Y., Jeannerod, M., & Nazir, T. A. (2008). Subliminal display of action words interferes with motor planning: A combined EEG and kinematic study. Journal of Physiology-Paris, 102, 130–136. https://doi.org/10.1016/j.jphysparis.2008.03.015
- Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, V., & Rizzolatti, G. (2005). Listening to action-related sentences modulates the activity of the motor system: A combined TMS and behavioral study. Cognitive Brain Research, 24, 355–363. https://doi.org/10.1016/j.cogbrainres.2005.02.020
- Cuetos, F., Glez-Nosti, M., Barbón, A., & Brysbaert, M. (2011). SUBTLEX-ESP: Spanish word frequencies based on film subtitles. Psicológica, 32, 133–143.
- Dalla Volta, R., Fabbri-Destro, M., Gentilucci, M., & Avanzini, P. (2014). Spatiotemporal dynamics during processing of abstract and concrete verbs: An ERP study. Neuropsychologia, 61, 163–174. https://doi.org/10.1016/j.neuropsychologia.2014.06.019
- de Lafuente, V., & Romo, R. (2004). Language abilities of motor cortex. Neuron, 41, 178–180. https://doi.org/10.1016/S0896-6273(04)00004-2
- de Vega, M., León, I., Hernández, J. A., Valdés, M., Padrón, I., & Ferstl, E. C. (2014). Action sentences activate sensory motor regions in the brain independently of their status of reality. Journal of Cognitive Neuroscience, 26, 1363–1376. https://doi.org/10.1162/jocn_a_00559
- Desai, R. H., Binder, J. R., Conant, L. L., & Seidenberg, M. S. (2010). Activation of sensory–motor areas in sentence comprehension. Cerebral Cortex, 20, 468–478. https://doi.org/10.1093/cercor/bhp115
- Dutriaux, L., Dahiez, X., & Gyselinck, V. (2019). How to change your memory of an object with a posture and a verb. Quarterly Journal of Experimental Psychology, 72(5), 1112–1118. https://doi.org/10.1177/1747021818785096
- Dutriaux, L., & Gyselinck, V. (2016). Learning is better with the hands free: The role of posture in the memory of manipulable objects. PLoS One, 11, e0159108. https://doi.org/10.1371/journal.pone.0159108
- Ellis, A. W., & Young, A. W. (2013). Human cognitive neuropsychology: A textbook with readings. London, UK: Psychology Press. https://doi.org/10.4324/9780203727041
10.4324/9780203727041 Google Scholar
- Fadiga, L., Craighero, L., Buccino, G., & Rizzolatti, G. (2002). Speech listening specifically modulates the excitability of tongue muscles: A TMS study. European Journal of Neuroscience, 15, 399–402. https://doi.org/10.1046/j.0953-816x.2001.01874.x
- Fargier, R., Ménoret, M., Boulenger, V., Nazir, T. A., & Paulignan, Y. (2012). Grasp it loudly! Supporting actions with semantically congruent spoken action words. PLoS One, 7(1), e30663. https://doi.org/10.1371/journal.pone.0030663
- Fernández, A., Díez, E., & Alonso, M. A. (2010). Normas de Asociación libre en castellano de la Universidad de Salamanca. Retrieved from www.usal.es/gimc/nalc
- Fuster, J. (2015). The prefrontal cortex. London, UK: Academic Press. https://doi.org/10.1016/B978-0-12-407815-4.00002-7
10.1016/B978-0-12-407815-4.00002-7 Google Scholar
- Gallese, V., & Lakoff, G. (2005). The brain's concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology, 22, 455–479. https://doi.org/10.1080/02643290442000310
- García, A. M., & Ibáñez, A. (2016). A touch with words: Dynamic synergies between manual actions and language. Neuroscience & Biobehavioral Reviews, 68, 59–95. https://doi.org/10.1016/j.neubiorev.2016.04.022
- Gentilucci, M. (2003). Object motor representation and language. Experimental Brain Research, 153, 260–265. https://doi.org/10.1007/s00221-003-1600-8
- Gianelli, C., & Dalla Volta, R. (2015). Does listening to action-related sentences modulate the activity of the motor system? Replication of a combined TMS and behavioral study. Frontiers in Psychology, 5, 1511. https://doi.org/10.3389/fpsyg.2014.01511
- Glenberg, A. M., Sato, M., & Cattaneo, L. (2008). Use-induced motor plasticity affects the processing of abstract and concrete language. Current Biology, 18, R290–R291. https://doi.org/10.1016/j.cub.2008.02.036
- Hauk, O., Johnsrude, I., & Pulvermüller, F. (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41, 301–307. https://doi.org/10.1016/S0896-6273(03)00838-9
- Hauk, O., & Pulvermüller, F. (2004). Effects of word length and frequency on the human event-related potential. Clinical Neurophysiology, 115, 1090–1103. https://doi.org/10.1016/j.clinph.2003.12.020
- Hauk, O., & Tschentscher, N. (2013). The body of evidence: What can neuroscience tell us about embodied semantics? Frontiers in Psychology, 4, 50. https://doi.org/10.3389/fpsyg.2013.00050
- Hazeltine, E., Ruthruff, E., & Remington, R. W. (2006). The role of input and output modality pairings in dual-task performance: Evidence for content-dependent central interference. Cognitive Psychology, 52, 291–345. https://doi.org/10.1016/j.cogpsych.2005.11.001
- Hoenig, K., Sim, E. J., Bochev, V., Herrnberger, B., & Kiefer, M. (2008). Conceptual flexibility in the human brain: Dynamic recruitment of semantic maps from visual, motor, and motion-related areas. Journal of Cognitive Neuroscience, 20(10), 1799–1814. https://doi.org/10.1162/jocn.2008.20123
- Horoufchin, H., Bzdok, D., Buccino, G., Borghi, A. M., & Binkofski, F. (2018). Action and object words are differentially anchored in the sensory motor system – A perspective on cognitive embodiment. Scientific Reports, 8(1), 1–11. https://doi.org/10.1038/s41598-018-24475-z
- Ibáñez, A., Cardona, J. F., Dos Santos, Y. V., Blenkmann, A., Aravena, P., Roca, M., … Bekinschtein, T. (2013). Motor-language coupling: Direct evidence from early Parkinson’s disease and intracranial cortical recordings. Cortex, 49, 968–984. https://doi.org/10.1016/j.cortex.2012.02.014
- Juárez, F. P. G., Labrecque, D., & Frak, V. (2019). Assessing language-induced motor activity through Event Related Potentials and the Grip Force Sensor, an exploratory study. Brain and Cognition, 135, 103572. https://doi.org/10.1016/j.bandc.2019.05.010
- Kaschak, M. P., Madden, C. J., Therriault, D. J., Yaxley, R. H., Aveyard, M., Blanchard, A. A., & Zwaan, R. A. (2005). Perception of motion affects language processing. Cognition, 94, B79–B89. https://doi.org/10.1016/j.cognition.2004.06.005
- Kiefer, M. (2005). Repetition priming modulates category-related effects on event-related potentials: Further evidence for multiple cortical semantic systems. Journal of Cognitive Neuroscience, 17, 199–211. https://doi.org/10.1162/0898929053124938
- Kiefer, M., Sim, E. J., Liebich, S., Hauk, O., & Tanaka, J. (2007). Experience-dependent plasticity of conceptual representations in human sensory-motor areas. Journal of Cognitive Neuroscience, 19, 525–542. https://doi.org/10.1162/jocn.2007.19.3.525
- Liepelt, R., Dolk, T., & Prinz, W. (2012). Bidirectional semantic interference between action and speech. Psychological Research Psychologische Forschung, 76, 446–455. https://doi.org/10.1007/s00426-011-0390-z
- Lindemann, O., Stenneken, P., Van Schie, H. T., & Bekkering, H. (2006). Semantic activation in action planning. Journal of Experimental Psychology: Human Perception and Performance, 32, 633–643. https://doi.org/10.1037/0096-1523.32.3.633
- Linell, P. (2009). Rethinking language, mind, and world dialogically. Charlotte, NC: IAP. https://doi.org/10.1037/0033-295X.108.2.393
- Matheson, H. E. (2018). Embodiment and grounding in cognitive neuroscience. In J. Wixted (Ed.), The Stevens’ Handbook of Experimental Psychology and Cognitive Neuroscience ( 4th ed.). Wiley. https://doi.org/10.1002/9781119170174.epcn310
10.1002/9781119170174.epcn310 Google Scholar
- Melloni, M., Sedeño, L., Hesse, E., García-Cordero, I., Mikulan, E., Plastino, A., … Ibáñez, A. (2015). Cortical dynamics and subcortical signatures of motor-language coupling in Parkinson’s disease. Scientific Reports, 5, 11899. https://doi.org/10.1038/srep11899
- Mollo, G., Pulvermüller, F., & Hauk, O. (2016). Movement priming of EEG/MEG brain responses for action-words characterizes the link between language and action. Cortex, 74, 262–276. https://doi.org/10.1016/j.cortex.2015.10.021
- Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9, 97–113. https://doi.org/10.1016/0028-3932(71)90067-4
- Pashler, H. (1994). Dual-task interference in simple tasks: Data and theory. Psychological Bulletin, 116, 220–244. https://doi.org/10.1037/0033-2909.116.2.220
- Patterson, K., Nestor, P. J., & Rogers, T. T. (2007). Where do you know what you know? The representation of semantic knowledge in the human brain. Nature Reviews Neuroscience, 8, 976–987. https://doi.org/10.1038/nrn2277
- Pecher, D., & Zwaan, R. A. (Eds.). (2005). Grounding cognition: The role of perception and action in memory, language, and thinking. Cambridge, UK: Cambridge University Press. https://doi.org/10.1017/CBO9780511499968
10.1017/CBO9780511499968 Google Scholar
- Pirog Revill, K. P., Aslin, R. N., Tanenhaus, M. K., & Bavelier, D. (2008). Neural correlates of partial lexical activation. Proceedings of the National Academy of Sciences, 105, 13111–13115. https://doi.org/10.1073/pnas.0807054105
- Postle, N., McMahon, K. L., Ashton, R., Meredith, M., & de Zubicaray, G. I. (2008). Action word meaning representations in cytoarchitectonically defined primary and premotor cortices. NeuroImage, 43, 634–644. https://doi.org/10.1016/j.neuroimage.2008.08.006
- Pulvermüller, F. (1999). Words in the brain's language. Behavioral and Brain Sciences, 22, 253–279. https://doi.org/10.1017/S0140525X9900182X
- Pulvermüller, F. (2005). Brain mechanisms linking language y action. Nature Reviews Neuroscience, 6, 576–582. https://doi.org/10.1038/nrn1706
- Pulvermüller, F. (2013). How neurons make meaning: Brain mechanisms for embodied and abstract-symbolic semantics. Trends in Cognitive Sciences, 17, 458–470. https://doi.org/10.1016/j.tics.2013.06.004
- Pulvermüller, F. (2018). Neural reuse of action perception circuits for language, concepts and communication. Progress in Neurobiology, 160, 1–44. https://doi.org/10.1016/j.pneurobio.2017.07.001
- Pulvermüller, F., Härle, M., & Hummel, F. (2001). Walking or talking?: Behavioral and neurophysiological correlates of action verb processing. Brain and Language, 78, 143–168. https://doi.org/10.1006/brln.2000.2390
- Pulvermüller, F., Hauk, O., Nikulin, V. V., & Ilmoniemi, R. J. (2005). Functional links between motor and language systems. European Journal of Neuroscience, 21, 793–797. https://doi.org/10.1111/j.1460-9568.2005.03900.x
- Pulvermüller, F., Moseley, R. L., Egorova, N., Shebani, Z., & Boulenger, V. (2014). Motor cognition–motor semantics: Action perception theory of cognition and communication. Neuropsychologia, 55, 71–84. https://doi.org/10.1016/j.neuropsychologia.2013.12.002
- Real Academia Española. (2017). Diccionario de la lengua española [Dictionary of the Spanish Language] ( 23rd ed.). Madrid, Spain: Author.
- RStudio Team. (2016). RStudio: Integrated Development for R. Boston, MA: RStudio Inc. http://www.rstudio.com/
- Sato, M., Mengarelli, M., Riggio, L., Gallese, V., & Buccino, G. (2008). Task related modulation of the motor system during language processing. Brain & Language, 105, 83–90. https://doi.org/10.1016/j.bandl.2007.10.001
- Schneider, W. (1995). Micro experimental laboratory. Pittsburgh, PA: Psychology Software Tools.
- Schneider, W., Eschman, A., & Zuccolotto, A. (2002). E-Prime user’s guide (Version 1.1). Pittsburg: Psychology Software Tools.
- Shebani, Z., & Pulvermüller, F. (2013). Moving the hands and feet specifically impairs working memory for arm- and leg-related action words. Cortex, 49, 222–231. https://doi.org/10.1016/j.cortex.2011.10.005
- Shebani, Z., & Pulvermüller, F. (2018). Flexibility in language action interaction: The influence of movement type. Frontiers in Human Neuroscience, 12, 252. https://doi.org/10.3389/fnhum.2018.00252
- Spadacenta, S., Gallese, V., Fragola, M., & Mirabella, G. (2014). Modulation of arm reaching movements during processing of arm/hand-related action verbs with and without emotional connotation. PLoS One, 9, e104349. https://doi.org/10.1371/journal.pone.0104349
- Sprouse, J., & Almeida, D. (2012). Power in acceptability judgment experiments and the reliability of data in syntax (unpublished manuscript). University of California, Irvine & Michigan State University.
- Tremblay, P., & Small, S. L. (2011). On the context-dependent nature of the contribution of the ventral premotor cortex to speech perception. NeuroImage, 57, 1561–1571. https://doi.org/10.1016/j.neuroimage.2011.05.067
- Tyler, L. K., & Moss, H. E. (2001). Towards a distributed account of conceptual knowledge. Trends in Cognitive Sciences, 5, 244–252. https://doi.org/10.1016/S1364-6613(00)01651-X
- Vukovic, N., Feurra, M., Shpektor, A., Myachykov, A., & Shtyrov, Y. (2017). Primary motor cortex functionally contributes to language comprehension: An online rTMS study. Neuropsychologia, 96, 222–229. https://doi.org/10.1016/j.neuropsychologia.2017.01.025
- Westfall, J. (2016). PANGEA: Power analysis for general anova designs. Unpublished manuscript. Available at http://jakewestfall.org/publications/pangea.pdf
- Wickens, C., Kramer, A., Vanasse, L., & Donchin, E. (1983). Performance of concurrent tasks: A psychophysiological analysis of the reciprocity of information-processing resources. Science, 221(4615), 1080–1082. https://doi.org/10.1126/science.6879207
- Wickens, C. D., & Liu, Y. (1988). Codes and modalities in multiple resources: A success and a qualification. Human Factors, 30, 599–616. https://doi.org/10.1177/001872088803000505
- Willems, R. M., Labruna, L., D’Esposito, M., Ivry, R., & Casasanto, D. (2011). A functional role for the motor system in language understanding: Evidence from theta-burst transcranial magnetic stimulation. Psychological Science, 22, 849–854. https://doi.org/10.1177/0956797611412387
- Zwaan, R. A., Van Der Stoep, N., Guadalupe, T., & Bouwmeester, S. (2012). Language comprehension in the balance: The robustness of the action-compatibility effect (ACE). PLoS One, 7, e31204. https://doi.org/10.1371/journal.pone.0031204