Item Analysis of Sociocultural Influences in Verbal Ability Testing Using the Woodcock-Johnson IV COG

Tomáš Mrhálek; Alena Hricová; Stanislav Ondrášek

doi:10.18290/rpsych2024.0006

Published : 2024-05-09

Vol. 27 No. 2 (2024)

Item Analysis of Sociocultural Influences in Verbal Ability Testing Using the Woodcock-Johnson IV COG

Tomáš Mrhálek

https://orcid.org/0000-0003-3872-930X

Alena Hricová

https://orcid.org/0000-0003-0549-4962

Stanislav Ondrášek

https://orcid.org/0000-0003-4716-3600

DOI: https://doi.org/10.18290/rpsych2024.0006

Abstract

The article presents the results of a study that examines the impact of sociocultural environment on the development of verbal skills in Romani children aged 7–11 years, with a particular emphasis on children from socially excluded localities. The results are based on a verbal test derived from the Woodcock-Johnson Cognitive Ability Test (WJ IV COG), which was processed using item analysis according to the Rasch model. The main results are based on analysing the differential function of individual items within the verbal tests within the research group (N = 399) compared to the normative sample of the Czech population (N = 936). A secondary goal is to compare Romani children originating from socially excluded areas (N = 204) with those from non-excluded areas (N = 195). Regarding item comparisons between the majority and sample groups, they reveal significant disparities in 14 items (70%) of the Synonyms subtest and 9 items (45%) of the Antonyms subtest. The results highlight the crucial role of a more limited vocabulary, particularly in formal linguistic expressions by Romani children. The presented words representing differently functioning items can also serve as a basis for linguistic analysis and can be applied in assessing educational needs. When comparing the group of children based on their residence in a socially excluded locality, significant differences in the DIF were identified for one item from the Synonyms subtest and three items from the Antonyms subtest.

Keywords:

verbal ability, Woodcock-Johnson IV COG, sociocultural influence, intelligence testing, Romani children

Details

References

Statistics

Authors

Download files

pdf

Altmetric indicators

Cited by / Share

Licence

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

References

Abu-Hamour, B., Al Hmouz, H., Mattar, J., & Muhaidat, M. (2012). The use of Woodcock-Johnson test for identifying students with special needs – a comprehensive literature review. Procedia – Social and Behavioral Sciences, 47, 665–673. https://doi.org/10.1016/j.sbspro.2012.06.714

Bond, T. G., Yan, Z., & Heene, M. (2020). Applying the Rasch Model: Fundamental Measurement in the Human Sciences. Routledge.

Cakirpaloglu, P., & Kořínek, R. (2014). Preschool education and school maturity of children from socially disadvantaged backgrounds. Psychology and its Contexts, 5, 3–16.

Čada, K., Büchlerová, D., Kopecká, Z., Samec, T., Ouředníček, M., Sporková, J. B., Tinlová, J., Gabal, I., & Bělinová, E. (2015). Analysis of Socially Excluded Localities in the Czech Republic. GAC.

Dolean, D., Melby-Lervag, M., Tincas, I., Damsa, C., & Lervag, A. (2019). Achievement gap: Socioeconomic status affects reading development beyond language and cognition in children facing poverty. Learning and Instruction, 63, 101–218. https://doi.org/10.1016/j.learninstruc. 2019.101218

Dutton, E. (2014). Cognitive abilities among the Sami: A comment. Intelligence, 46, 188–191. https://doi.org/10.1016/j.intell.2015.04.009

Engelhardt, L. E., Church, J. A., Harden, K. P., & Tucker-Drob, E. M. (2019). Accounting for the shared environment in cognitive abilities and academic achievement with measured socioecological context. Wiley Developmental Science, 22(1), e12699. https://doi.org/10.1111/desc.12699

Ferjenčík, J. (2018). Diagnostika rómskych detí zo sociálne Znevýhodňujúceho prostredia [Diagnosis of Roma children from socially disadvantaged backgrounds]. Psychológia a patopsychológia dieťaťa, 52(2), 127–139.

Ferjenčík, J., Slavkovská, M., & Kresila, J. (2015). Executive functioning in three groups of pupils in D-KEFS: Selected issues in adapting the test battery for Slovakia. Journal of Pedagogy, 6(1), 73–92. https://doi.org/10.1515/jped-2015-0005

Furman, A., Krejčová, L., Laciga, J., Urbánek, T., & Víchová, M. (2019). Woodcock-Johnson IV: Testy kognitivních schopností [Woodcock-Johnson IV: Tests of cognitive abilities]. Propsyco.

Graves, S., ParkeE., Etcoff, L., San Miguel, L., & Allen, D. (2016). The relationship between the Woodcock-Johnson-III and the Batteria-III in children with attention deficit/ hyperactivity disorder (ADHD) and learning disorders. Archives of Clinical Neuropsychology, 31, 584–673.

Holland, P. W., & Wainer, H. E. (1993). Differential Item Functioning. Lawrence Erlbaum.

Kassis, D. (2020). Underachievement of Roma Children in Greece. In E. Skourtou, V. Kourtis-Kazoullis, T. Aravossitas & P. Trifonas (Eds.), Language diversity in Greece: Local challenges with international implications (pp. 183–192). Language Diversity.

Linacre, J. M. (2012). WINSTEPS (Version 3.74.0). Chicago, IL. https://www.winsteps.com.

Mendoza, C. F., Ardila, R., Gallegos, M., & Reategui-Colareta, N. (2021). General intelligence and socioeconomic status as strong predictors of student performance in Latin American schools: Evidence from PISA items. Frontiers in Education, 6. https://doi.org/10.3389/feduc.2021.632289

Michell, J. (1997). Quantitative science and definition of measurement in psychology. British Journal of Psychology, 88, 355–383. https://doi.org/10.1111/j.2044-8295.1997.tb02641.x

Nisbett, R. E., Aronson J., Blair, C., Dickens, W., Flynn, J., Halpern, D. F., & Turkheimer, E. (2012). Intelligence: New findings and theoretical developments. American Psychologist, 67(2), 130–159. https://doi.org/10.1037/a0026699

Reynolds, C. R. (1982). The problem of bias in psychological assessment. In C. R. Reynolds & T. B. Gutkin (Eds.), The Handbook of School Psychology (pp.178–209). Wiley.

Rushton, J. P., Čvorović, J., & Bons, T. A. (2007). General mental ability in South Asians: Data from three Roma (Gypsy) communities in Serbia. Intelligence, 35(1), 1–12. https://doi.org/10.1016/ j.intell.2012.10.006

Thaler, N. S., Thames, A. D., Cagigas, X., & Norman, M. A. (2015). IQ Testing and the African American client. In L. T. Benuto & B. D. Leany (Eds.), Guide to Psychological Assessment with African Americans (pp. 79–80). Springer.

Weiss, L. G., & Saklofske, D. H. (2020). Mediators of IQ test score differences across racial and ethnic groups: The case for environmental and social justice. Personality and Individual Differences, 161, 109–962. https://doi.org/10.1016/j.paid.2020.109962