Is Metamemory Judgements Reactivity a Topic Worth Investigating? An Overview of Literature and Future Directions

Ngoc Diep Le

doi:10.18290/rpsych2024.0017

Published : 2025-05-14

Vol. 27 No. 4 (2024)

Is Metamemory Judgements Reactivity a Topic Worth Investigating? An Overview of Literature and Future Directions

Ngoc Diep Le

https://orcid.org/0009-0008-0838-9520

DOI: https://doi.org/10.18290/rpsych2024.0017

Abstract

Judgements of learning (JOLs) are commonly used in metacognitive research to assess a person’s ability to monitor their learning. However, despite the widespread use of this type of self-reported measure, only recently have metacognitive researchers become interested in investigating its potential reactive effects in a proper empirical manner, via directly addressing the question whether the sole act of systematically monitoring memory influences memory performance. The issue of possible reactive JOL effects has been raised since the early days of metamemory monitoring research, but has taken a completely new direction in the lately emerging studies—from issuing warnings about JOL reactivity as a potential limitation, to dedicating entire series of experiments to uncover the principles behind certain reactivity patterns, and its potential moderators. More research is needed on educationally relevant materials to determine whether JOL reactivity can be utilised in educational contexts. Finally, this phenomenon, as shown in the performed literature overview, leads to important theoretical implications reflected in the four hypotheses explaining the reactivity effect.

Keywords:

metamemory, learning, reactivity, judgements of learning, JOL reactivity

Details

References

Statistics

Authors

Download files

pdf

Altmetric indicators

Cited by / Share

Licence

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

References

Ackerman, B. P. (1986). The use of item-specific and relational episodic information in the recall of children and adults. Journal of Experimental Child Psychology, 42(1), 115–143. https://doi.org/10.1016/0022-0965(86)90019-6

Ariel, R., Karpicke, J. D., Witherby, A. E., & Tauber, S. K. (2021). Do judgments of learning directly enhance learning of educational materials? Educational Psychology Review, 33(2), 693–712. https://doi.org/10.1007/s10648-020-09556-8

Benjamin, A. S., Bjork, R. A., & Schwartz, B. L. (1998). The mismeasure of memory: When retrieval fluency is misleading as a metamnemonic index. Journal of Experimental Psychology: General, 127(1), 55–68. https://doi.org/10.1037/0096-3445.127.1.55

Chang, M., & Brainerd, C. J. (2022). Association and dissociation between judgments of learning and memory: A meta-analysis of the font size effect. Metacognition and Learning, 17(2), 443–476. https://doi.org/10.1007/s11409-021-09287-3

Chang, M., & Brainerd, C. J. (2023). Changed-goal or cue-strengthening? Examining the reactivity of judgments of learning with the dual-retrieval model. Metacognition and Learning, 18, 183–217. https://doi.org/10.1007/s11409-022-09321-y

Chang, M., & Brainerd, C. J. (2024). Judgments of learning reactivity on item-specific and relational processing. Journal of Intelligence, 12(1), Article 4. https://doi.org/10.3390/jintelligence12010004

de Winstanley, P. A., Bjork, E. L., & Bjork, R. A. (1996). Generation effects and the lack thereof: The role of transfer-appropriate processing. Memory, 4(1), 31–48. https://doi.org/10.1080/741940667

Double, K. S. (2023). Do judgments of learning impair recall when uninformative cues are salient? Journal of Intelligence, 11(10), Article 203. https://doi.org/10.3390/jintelligence11100203

Double, K. S., & Birney, D. P. (2019). Reactivity to measures of metacognition. Frontiers in Psychology, 10, Article 2755. https://doi.org/10.3389/fpsyg.2019.02755

Double, K. S., Birney, D. P., & Walker, S. A. (2018). A meta-analysis and systematic review of reactivity to judgements of learning. Memory, 26(6), 741–750. https://doi.org/10.1080/09658211.2017.1404111

Dougherty, M. R., Robey, A. M., & Buttaccio, D. (2018). Do metacognitive judgments alter memory performance beyond the benefits of retrieval practice? A comment on and replication attempt of Dougherty, Scheck, Nelson, and Narens (2005). Memory & Cognition, 46(4), 558–565. https://doi.org/10.3758/s13421-018-0791-y

Dunlosky, J., & Hertzog, C. (1998). Training programs to improve learning in later adulthood: Helping older adults educate themselves. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 249–275). Lawrence Erlbaum Associates Publishers.

Dunlosky, J., & Tauber, S. K. (Eds.). (2016). The Oxford handbook of metamemory.Oxford University Press.

Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003). Why people fail to recognize their own incompetence. Current Directions in Psychological Science, 12(3), 83–87. https://doi.org/10.1111/1467-8721.01235

Einstein, G. O., & Hunt, R. R. (1980). Levels of processing and organization: Additive effects of individual-item and relational processing. Journal of Experimental Psychology: Human Learning and Memory, 6(5), 588–598. https://doi.org/10.1037/0278-7393.6.5.588

Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87(3), 215–251. https://doi.org/10.1037/0033-295x.87.3.215

Fox, M. C., Ericsson, K. A., & Best, R. (2011). Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods. Psychological Bulletin, 137(2), 316–344. https://doi.org/10.1037/a0021663

Halamish, V., & Undorf, M. (2023). Why do judgments of learning modify memory? Evidence from identical pairs and relatedness judgments. Journal of Experimental Psychology: Learning, Memory, and Cognition, 49(4), 547–556. https://doi.org/10.1037/xlm0001174

Hausman, H., & Kubik, V. (2023). Delayed metacomprehension judgments do not directly improve learning from texts. Journal of Intelligence, 11(7), Article 150. https://doi.org/10.3390/jintelligence11070150

Hunt, R. R. (2006). The concept of distinctiveness in memory research. In R. R. Hunt & J. B. Worthen (Eds.), Distinctiveness and memory (pp. 3–25). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195169669.003.0001

Hunt, R. R., & Einstein, G. O. (1981). Relational and item-specific information in memory. Journal of Verbal Learning & Verbal Behavior, 20(5), 497–514. https://doi.org/10.1016/s0022-5371(81)90138-9

Janes, J. L., Rivers, M. L., & Dunlosky, J. (2018). The influence of making judgments of learning on memory performance: Positive, negative, or both? Psychonomic Bulletin & Review, 25(6), 2356–2364. https://doi.org/10.3758/s13423-018-1463-4

Jenkins, J. J. (1979). Four points to remember: A tetrahedral model of memory experiments. In L. S. Cermak & F. I. M. Craik (Eds.), Levels of processing in human memory (pp. 429–446). Lawrence Erlbaum Associates.

Kimball, D. R., & Metcalfe, J. (2003). Delaying judgments of learning affects memory, not metamemory. Memory & Cognition, 31(6), 918–929. https://doi.org/10.3758/bf03196445

Koriat, A. (1997). Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning. Journal of Experimental Psychology: General, 126(4), 349–370. https://doi.org/10.1037/0096-3445.126.4.349

Koriat, A., & Bjork, R. A. (2005). Illusions of competence in monitoring one’s knowledge during study. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(2), 187–194. https://doi.org/10.1037/0278-7393.31.2.187

Kraus, S., Breier, M., Lim, W. M., Dabić, M., Kumar, S., Kanbach, D. K., Mukherjee, D., Corvello, V., Piñeiro-Chousa, J., Liguori, E., Marqués, D. P., Schiavone, F., Ferraris, A., Fernandes, C. I., & Ferreira, J. J. (2022). Literature reviews as independent studies: Guidelines for academic practice. Review of Managerial Science, 16(8), 2577–2595. https://doi.org/10.1007/s11846-022-00588-8

Kubik, V., Koslowski, K., Schubert, T., & Aslan, A. (2022). Metacognitive judgments can potentiate new learning: The role of covert retrieval. Metacognition and Learning, 17(3), 1057–1077. https://doi.org/10.1007/s11409-022-09307-w

Li, B., Shanks, D. R., Zhao, W., Hu, X., Luo, L., & Yang, C. (2024). Do changed learning goals explain why metamemory judgments reactively affect memory? Journal of Memory and Language, 136, Article 104506. https://doi.org/10.1016/j.jml.2024.104506

Maxwell, N. P., & Huff, M. J. (2022). Reactivity from judgments of learning is not only due to memory forecasting: Evidence from associative memory and frequency judgments. Metacognition and Learning, 17(2), 589–625. https://doi.org/10.1007/s11409-022-09301-2

Maxwell, N. P., & Huff, M. J. (2023). Is discriminability a requirement for reactivity? Comparing the effects of mixed vs. pure list presentations on judgment of learning reactivity. Memory & Cognition, 51(5), 1198–1213. https://doi.org/10.3758/s13421-022-01381-4

Maxwell, N. P., & Huff, M. J. (2024). Judgment of learning reactivity reflects enhanced relational encoding on cued-recall but not recognition tests. Metacognition and Learning, 19(1), 189–213. https://doi.org/10.1007/s11409-023-09369-4

Metcalfe, J., & Kornell, N. (2005). A region of proximal learning model of study time allocation. Journal of Memory and Language, 52(4), 463–477. https://doi.org/10.1016/j.jml.2004.12.001

Mitchum, A. L., Kelley, C. M., & Fox, M. C. (2016). When asking the question changes the ultimate answer: Metamemory judgments change memory. Journal of Experimental Psychology: General, 145(2), 200–219. https://doi.org/10.1037/a0039923

Myers, S. J., Rhodes, M. G., & Hausman, H. E. (2020). Judgments of learning (JOLs) selectively improve memory depending on the type of test. Memory & Cognition, 48(5), 745–758. https://doi.org/10.3758/s13421-020-01025-5

Naveh-Benjamin, M., Brav, T. K., & Levy, O. (2007). The associative memory deficit of older adults: The role of strategy utilization. Psychology and Aging, 22(1), 202–208. https://doi.org/10.1037/0882-7974.22.1.202

Nelson, T. O., & Dunlosky, J. (1991). When people’s judgments of learning (JOLs) are extremely accurate at predicting subsequent recall: The “delayed-JOL effect”. Psychological Science, 2(4), 267–270. https://doi.org/10.1111/j.1467-9280.1991.tb00147.x

Nelson, T. O., & Narens, O. (1990). Metamemory: A theoretical framework and new findings. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 26, pp. 125–173). Academic Press. https://doi.org/10.1016/S0079-7421(08)60053-5

Rhodes, M. G. (2016). Judgments of learning: Methods, data, and theory. In J. Dunlosky & S. K. Tauber (Eds.), The Oxford handbook of metamemory (pp. 65–80). Oxford University Press.

Rhodes, M. G., & Tauber, S. K. (2011). The influence of delaying judgments of learning on meta¬cognitive accuracy: A meta-analytic review. Psychological Bulletin, 137(1), 131–148. https://doi.org/10.1037/a0021705

Rivers, M. L., Dunlosky, J., Janes, J. L., Witherby, A. E., & Tauber, S. K. (2023). Judgments of learning enhance recall for category-cued but not letter-cued items. Memory & Cognition, 51(7), 1547–1561. https://doi.org/10.3758/s13421-023-01417-3

Rivers, M. L., Janes, J. L., & Dunlosky, J. (2021). Investigating memory reactivity with a within-participant manipulation of judgments of learning: Support for the cue-strengthening hy¬pothesis. Memory, 29(10), 1342–1353. https://doi.org/10.1080/09658211.2021.1985143

Rivers, M. L., Janes, J. L., Dunlosky, J., Witherby, A. E., & Tauber, S. K. (2023). Exploring the role of attentional reorienting in the reactive effects of judgments of learning on memory performance. Journal of Intelligence, 11(8), Article 164. https://doi.org/10.3390/jintelligence11080164

Schäfer, F., & Undorf, M. (2024). On the educational relevance of immediate judgment of learning reactivity: No effects of predicting one’s memory for general knowledge facts. Journal of Applied Research in Memory and Cognition, 13(1), 113–123. https://doi.org/10.1037/mac0000113

Seli, P., Beaty, R. E., Cheyne, J. A., Smilek, D., Oakman, J., & Schacter, D. L. (2018). How perva¬sive is mind wandering, really? Consciousness and Cognition, 66, 74–78. https://doi.org/10.1016/j.concog.2018.10.002

Senkova, O., & Otani, H. (2021). Making judgments of learning enhances memory by inducing item-specific processing. Memory & Cognition, 49(5), 955–967. https://doi.org/10.3758/s13421-020-01133-2

Shi, A., Xu, C., Zhao, W., Shanks, D. R., Hu, X., Luo, L., & Yang, C. (2023). Judgments of learning reactively facilitate visual memory by enhancing learning engagement. Psychonomic Bul¬letin & Review, 30(2), 676–687. https://doi.org/10.3758/s13423-022-02174-1

Soderstrom, N. C., Clark, C. T., Halamish, V., & Bjork, E. L. (2015). Judgments of learning as memory modifiers. Journal of Experimental Psychology: Learning, Memory, and Cogni¬tion, 41(2), 553–558. https://doi.org/10.1037/a0038388

Spellman, B. A., & Bjork, R. A. (1992). When predictions create reality: Judgments of learning may alter what they are intended to assess. Psychological Science, 3(5), 315–316. https://doi.org/10.1111/j.1467-9280.1992.tb00680.x

Stevens, A. R., & Pierce, B. H. (2019, November 14–17). Do reactive effects of judgments of learn¬ing extend to words lists? [Poster session]. 2019 Annual Meeting of the Psychonomic So¬ciety, Montreal, QC, Canada.

Tauber, S. K., & Witherby, A. E. (2019). Do judgments of learning modify older adults’ actual learning? Psychology and Aging, 34(6), 836–847. https://doi.org/10.1037/pag0000376

Tekin, E., & Roediger, H. L. III. (2020). Reactivity of judgments of learning in a levels-of-pro¬cessing paradigm. Zeitschrift Für Psychologie, 228(4), 278–290. https://doi.org/10.1027/2151-2604/a000425

Thompson, W. B. (1999). Individual differences in memory-monitoring accuracy. Learning and Individual Differences, 11(4), 365–376. https://doi.org/10.1016/s1041-6080(99)80009-0

Undorf, M., Schäfer, F., & Halamish, V. (2024). Making judgments of learning either enhances or impairs memory: Evidence from 17 experiments with related and unrelated word pairs. Collabra: Psychology, 10(1), Article 117108. https://doi.org/10.1525/collabra.117108

Veenman, M. V., Van Hout-Wolters, B. H., & Afflerbach, P. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1, 3–14. https://doi.org/10.1007/s11409-006-6893-0

Witherby, A. E., Babineau, A. L., & Tauber, S. K. (2023). Does interactive imagery influence the reactive effect of judgments of learning on memory? Journal of Intelligence, 11(7), Article 139. https://doi.org/10.3390/jintelligence11070139

Witherby, A. E., & Tauber, S. K. (2017). The influence of judgments of learning on long-term learn¬ing and short-term performance. Journal of Applied Research in Memory and Cognition, 6(4), 496–503. https://doi.org/10.1016/j.jarmac.2017.08.004

Zhao, W., Li, B., Shanks, D. R., Zhao, W., Zheng, J., Hu, X., Su, N., Fan, T., Yin, Y., Luo, L., & Yang, C. (2022). When judging what you know changes what you really know: Soliciting metamemory judgments reactively enhances children’s learning. Child Development, 93(2), 405–417. https://doi.org/10.1111/cdev.13689

Zhao, W., Li, J., Shanks, D. R., Li, B., Hu, X., Yang, C., & Luo, L. (2023). Metamemory judgments have dissociable reactivity effects on item and interitem relational memory. Journal of Ex¬perimental Psychology: Learning, Memory, and Cognition, 49(4), 557–574. https://doi.org/10.1037/xlm0001160

Zhao, W., Xu, M., Xu, C., Li, B., Hu, X., Yang, C., & Luo, L. (2023). Judgments of learning fol¬lowing retrieval practice produce minimal reactivity effect on learning of education-related materials. Journal of Intelligence, 11(10), Article 190. https://doi.org/10.3390/jintelligence11100190