Developing a Narrative Test and Determining Its Psychometric Properties for Persian-Speaking Children Aged 4 to 5 Years
Abstract
Introduction: Between the ages of 2 and 7, children develop the ability to narrate stories with improved detail and organization, including main characters, events, responses, efforts, and settings. Narrative assessment, a tool for evaluating language development, allows speech pathologists to examine syntax, vocabulary, and complexity. This study aimed to develop a tool for assessing storytelling skills in children aged 4-5 years.
Materials and Methods: This study was conducted in two stages. In the first stage, the story was created, images were designed, and speech therapists assessed face validity. In the second stage, a descriptive-analytical study was conducted in kindergartens in Tehran City, Iran, in 2023. Children were asked to narrate stories based on the provided images, and their narratives were scored using story grammar analysis. Psychometric evaluations included construct validity (assessed via paired t-test), inter-rater reliability (measured using Cohen’s kappa), test-re-test reliability (analyzed with the Pearson correlation), and internal consistency (evaluated using the Cronbach α).
Results: The speech therapists evaluated and confirmed the face validity of the story and images, implementing necessary adjustments. In this regard, construct validity was significant (P=0.000), indicating alignment with typical development. Inter-evaluator reliability (κ=0.712) and test-re-test reliability (r=0.591) were moderate to good. Internal consistency varied, with α>0.5 in one story and α<0.5 in others.
Conclusion: The test demonstrates validity and moderate reliability, suggesting its suitability for practical applications.
Nakhshab M, Arabpour M, Kazemi Y. [Narrative assessment methods in children: A systematic review (Persian)]. Journal of Research in Rehabilitation Sciences. 2015; 10(5):704-19. [DOI:10.22122/jrrs.v10i5.2090]
Beytollahi S, Soleymani Z, Jalaie S. The development of a new test for consecutive assessment of narrative skills in Iranian school-age children. Iranian Journal of Medical Sciences. 2020; 45(6):425-33. [PMID]
Isbell R, Sobol J, Lindauer L, Lowrance A. The effects of storytelling and story reading on the oral language complexity and story comprehension of young children. Early Childhood Education Journal. 2004; 32(3):157-63. [DOI:10.1023/B:ECEJ.0000048967.94189.a3]
Wellman RL. Narrative ability of children with speech and language deficits and its potential to predict later literacy skills [master thesis]. Cleveland: Case Western Reserve University; 2009. [Link]
Safwat RF, EL-Dessouky HM, Shohdi SS, Hussien IA. Assessment of narrative skills in preschool children. The Egyptian Journal of Otolaryngology. 2013; 29(2):130-5. [DOI:10.7123/01.EJO.0000426472.83521.26]
Justice LM, Bowles R, Pence K, Gosse C. A scalable tool for assessing children’s language abilities within a narrative context: The nap (narrative assessment protocol). Early Childhood Research Quarterly. 2010; 25(2):218-34. [DOI:10.1016/j.ecresq.2009.11.002]
Applebee AN. The child’s concept of story: Ages two to seventeen. Chicago: University of Chicago Press; 1978. [Link]
Silva M, Strasser K, Cain K. Early narrative skills in chilean preschool: Questions scaffold the production of coherent narratives. Early Childhood Research Quarterly. 2014; 29(2):205-13. [DOI:10.1016/j.ecresq.2014.02.002]
Reese E, Leyva D, Sparks A, Grolnick W. Maternal elaborative reminiscing increases low-income children’s narrative skills relative to dialogic reading. Early Education and Development. 2010; 21(3):318-42. [DOI:10.1080/10409289.2010.481552]
Hutchison, D., Gender differences in the macrostructural narrative language of second-grade African American children. [research thesis]. Columbus: Ohio State University; 2012. [Link]
Melzi G, Schick A, Bostwick E. Latino children’s narrative competencies over the preschool years. Actualidades en Psicología. 2013; 27(115):1-4. [DOI:10.15517/ap.v27i115.9276]
Nielsen DC, Friesen LD, Fink J. The effectiveness of a model of language-focused classroom instruction on the vocabulary and narrative development of kindergarten children. Journal of Education. 2012; 192(2-3):63-77. [DOI:10.1177/0022057412192002-309]
Vernon-Feagans L, Hammer CS, Miccio AD, Manlove E. Early language and literacy skills in low-income african american and hispanic children. In: Neuman SB, Dickinson DK, editors. Handbook of early literacy research. New York: The Guilford Press; 2003. [Link]
Bowles RP, Justice LM, Khan KS, Piasta SB, Skibbe LE, Foster TD. Development of the Narrative Assessment Protocol-2: A tool for examining young children’s narrative skill. Language, Speech, and Hearing Services in Schools. 2020; 51(2):390-404. [DOI:10.1044/2019_LSHSS-19-00038] [PMID]
Reilly J, Losh M, Bellugi U, Wulfeck B. “Frog, where are you?” Narratives in children with specific language impairment, early focal brain injury, and Williams syndrome. Brain and Language. 2004; 88(2):229-47. [DOI:10.1016/S0093-934X(03)00101-9] [PMID]
Hipfner-Boucher K, Milburn T, Weitzman E, Greenberg J, Pelletier J, Girolametto L. Relationships between preschoolers’ oral language and phonological awareness. First Language. 2014; 34(2):178-97. [DOI:10.1177/0142723714525945]
Norbury CF, Bishop DV. Narrative skills of children with communication impairments. International Journal of Language & Communication Disorders. 2003; 38(3):287-313. [DOI:10.1080/136820310000108133] [PMID]
Pankratz ME, Plante E, Vance R, Insalaco DM. The diagnostic and predictive validity of the renfrew bus story. Language, Speech, and Hearing Services in Schools. 2007; 38(4):390-9. [DOI:10.1044/0161-1461(2007/040)] [PMID]
Sebina B, Setter J, Daller M. The Setswana speech rhythm of 6–7 year-old Setswana–English bilingual children. International Journal of Bilingualism. 2021; 25(3):592-605. [DOI:10.1177/1367006920960799]
Mercer M. Frog, where are you? New York: Dial Press; 1969. [Link]
Renfrew C. At-a-glance test review: The renfrew bus story (RBS). New Hanover: The Centerville School Delaware; 1969. [Link]
Westerveld MF, Gillon GT. Oral narrative context effects on poor readers’ spoken language performance: Story retelling, story generation, and personal narratives. International Journal of Speech-Language Pathology. 2010; 12(2):132-41. [DOI:10.3109/17549500903414440] [PMID]
Gagarina NV, Klop D, Kunnari S, Tantele K, Välimaa T, Balčiūnienė I, et al. MAIN: Multilingual assessment instrument for narratives. ZAS Papers in Linguistics. 2012; 56:155. [DOI:10.21248/zaspil.56.2019.414]
Soleymani Z, Nematzadeh S, Tehrani LG, Rahgozar M, Schneider P. Language sample analysis: Development of a valid language assessment tool and determining the reliability of outcome measures for Farsi-speaking children. European Journal of Developmental Psychology. 2016; 13(2):275-91. [DOI:10.1080/17405629.2016.1152175]
Jafari S, Agharasouli Z, Modaresi Y, Kamali M. Developing a story retelling test for the assessment of language structure in Persian-speaking children. Bimonthly Audiology-Tehran University of Medical Sciences. 2012; 21(3):51-61. [Link]
Kline P. Handbook of psychological testing. London: Routledge; 2013. [DOI:10.4324/9781315812274]
Paul R, Norbury C. language disorders from infancy through adolescence-E-book: Language disorders from infancy through adolescence-E-book. Edinburgh: Elsevier Health Sciences; 2012. [Link]
Mohamadi R, Ahmadi A, Kazemi MD, Minaei A, Damarchi Z. Development of the Persian syntax comprehension test. International Journal of Pediatric Otorhinolaryngology. 2019; 124:22-29. [DOI:10.1016/j.ijporl.2019.05.032] [PMID]
Demir ÖE, Levine SC, Goldin‐Meadow S. Narrative skill in children with early unilateral brain injury: A possible limit to functional plasticity. Developmental Science. 2010; 13(4):636-47. [DOI: 10.1111/j.1467-7687.2009.00920.x]
| Issue | Vol 20 No 1 (2026) | |
| Section | Research Article(s) | |
| DOI | https://doi.org/10.18502/jmr.v20i1.21027 | |
| Keywords | ||
| Narration Preschool age Psychometric properties Persian | ||
| Rights and permissions | |
|
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |
