Rasch Analysis of the Student Mental Health Scale (ISKM-R-2)
Abstract
Adolescent mental health is a critical issue, as this developmental stage is often marked by vulnerability to psychological problems, yet standardized measurement tools remain limited. This study aimed to evaluate the psychometric properties of the Student Mental Health Scale (ISKM-R-2) using the Rasch model. A methodological study design was adopted with a cross-sectional method, including 1,045 adolescents aged 15–19 years. The results suggested that the instrument had a multidimensional structure, with a two-factor model showing a better fit than the unidimensional model. Rasch analysis showed acceptable item fit and high reliability across dimensions. However, the instrument items were relatively difficult for the sample, as shown by the Wright Map analysis. The results of this study supported the importance of a multidimensional method in measuring student mental health and provided evidence for further refinement of the instrument.
Keywords
Full Text:
PDFReferences
Ackerman, T. (1996). Graphical representation of multidimensional item response theory analyses. Applied Psychological Measurement, 20(4), 311–329. https://doi.org/10.1177/014662169602000402
Andriyani, J. (2020). Peran Lingkungan Keluarga dalam Mengatasi Kenakalan Remaja. At-Taujih : Bimbingan Dan Konseling Islam, 3(1), 86–98. https://doi.org/10.22373/taujih.v3i1.7235
Aziz, R., & Mangestuti, R. (2025). Validating psychometric properties of dual-continua models for university student mental health assessment. International Journal of Public Health Science (IJPHS), 14(1), 425–433. https://doi.org/10.11591/ijphs.v14i1.24601
Beck, M. F., Albano, A. D., & Smith, W. M. (2019). Person-Fit as an Index of Inattentive Responding: A Comparison of Methods Using Polytomous Survey Data. Applied Psychological Measurement, 43(5), 374–387. https://doi.org/10.1177/0146621618798666
Bhugra, D., Till, A., & Sartorius, N. (2013). What is mental health? International Journal of Social Psychiatry, 59(1), 3–4. https://doi.org/10.1177/0020764012463315
Bonifay, W. E., Reise, S. P., Scheines, R., & Meijer, R. R. (2015). When Are Multidimensional Data Unidimensional Enough for Structural Equation Modeling? An Evaluation of the DETECT
Multidimensionality Index. Structural Equation Modeling: A Multidisciplinary Journal, 22(4), 504–516. https://doi.org/10.1080/10705511.2014.938596
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Wright Maps: First Steps. Rasch Analysis in the Human Sciences, 111–136. https://doi.org/10.1007/978-94-007-6857-4_6
Bornovalova, M. A., Choate, A. M., Fatimah, H., Petersen, K. J., & Wiernik, B. M. (2020). Appropriate Use of Bifactor Analysis in Psychopathology Research: Appreciating Benefits and Limitations. Biological Psychiatry, 88(1), 18–27. https://doi.org/10.1016/j.biopsych.2020.01.013
Cai, L., Yang, J. S., & Hansen, M. (2011). Generalized Full-Information Item Bifactor Analysis. Psychological Methods, 16(3), 221–248. https://doi.org/10.1037/A0023350
Chalmers, R. P. (2012). mirt: A Multidimensional Item Response Theory Package for the R Environment. Journal of Statistical Software, 48, 1–29. https://doi.org/10.18637/jss.v048.i06
Chotidjah, S., Ihsan, H., Zakariyya, F., Damaianti, L. F., & Mukminin, G. U. (2024). Penyusunan Instrumen Status Kesehatan Mental Pelajar. Jurnal Ilmu Kesehatan Masyarakat, 13(03), 254–262. https://doi.org/10.33221/jikm.v13i03.2278
Costello, E. J. (2016). Early Detection and Prevention of Mental Health Problems: Developmental Epidemiology and Systems of Support. Journal of Clinical Child & Adolescent Psychology, 45(6), 710–717. https://doi.org/10.1080/15374416.2016.1236728
Cronau, H., & Brown, R. T. (1998). Growth And Development: Physical, Mental, And Social Aspects. Primary Care: Clinics in Office Practice, 25(1), 23–45. https://doi.org/10.1016/S0095-4543(05)70324-9
Dubbeldeman, Eveline. M., Boelens, M., Gurp, E. J. B., Dierx, J., Spreeuwenberg, M. D., & Jong, J. C. K. (2025). A Longitudinal Psychometric Evaluation of a Context-Sensitive Positive Health Questionnaire for Measuring Broad Health in Dutch Adults. MedRxiv, 2025.08.23.25334290. https://doi.org/10.1101/2025.08.23.25334290
Fave, A. D., Brdar, I., Wissing, M. P., Araujo, U., Solano, A. C., Freire, T., Hernández-Pozo, M. D. R., Jose, P., Martos, T., Nafstad, H. E., Nakamura, J., Singh, K., & Soosai-Nathan, L. (2016). Lay definitions of happiness across nations: The primacy of inner harmony and relational connectedness. Frontiers in Psychology, 7(JAN), 159794. https://doi.org/10.3389/fpsyg.2016.00030
Gagné, T., Henderson, C., & McMunn, A. (2022). Is the self-reporting of mental health problems sensitive to public stigma towards mental illness? A comparison of time trends across English regions (2009–19). Social Psychiatry and Psychiatric Epidemiology 2022 58:4, 58(4), 671–680. https://doi.org/10.1007/S00127-022-02388-7
Hanlbleton, R. K., Swaminathan, H., Rogers, D. J., & Hambleton, R. K. (1991). Fundamentals of Item Response Theory Library of Congress Cataloging-in-Publication Data.
Hidayati, H. N., Hayat, B., & Rahayu, W. (2021). Assessment of the Validity and Reliability of Mental Health Instruments of High School Student in Indonesia. European Journal of Educational Research, 10(2), 729–742. https://doi.org/10.12973/eu-jer.10.2.729
Iasiello, M., Ali, K., Agteren, J. van, Kolovos, E., Kyrios, M., Kashdan, T. B., & Fassnacht, D. B. (2024). What’s the difference between measures of wellbeing, quality of life, resilience, and coping? An umbrella review and concept map of 155 measures of positive mental health. International Journal of Weel Being, 14(2), 1–25. https://doi.org/10.5502/ijw.v14i2.3621
Indonesia-National Adolescent Mental Health Survey (I-NAMHS) Report. (n.d.).
Jones, E. A. K., Mitra, A. K., & Bhuiyan, A. R. (2021). Impact of COVID-19 on Mental Health in Adolescents: A Systematic Review. International Journal of Environmental Research and Public Health 2021, Vol. 18, Page 2470, 18(5), 2470. https://doi.org/10.3390/ijerph18052470
Keyes, C. L. M. (2005). Mental illness and/or mental health? Investigating axioms of the complete state model of health. Journal of Consulting and Clinical Psychology, 73(3), 539–548. https://doi.org/10.1037/0022-006x.73.3.539
Keyes, C. L. M., Wissing, M., Potgieter, J. P., Temane, M., Kruger, A., & van Rooy, S. (2008). Evaluation of the mental health continuum-short form (MHC-SF) in Setswana-speaking South Africans. Clinical Psychology and Psychotherapy, 15(3), 181–192. https://doi.org/10.1002/cpp.572
Kline, R. B. (2015). TXTBK Principles and practices of structural equation modelling Ed. 4. In Methodology in the social sciences.
Lai, K., & Green, S. B. (2016). The Problem with Having Two Watches: Assessment of Fit When RMSEA and CFI Disagree. Multivariate Behavioral Research, 51(2–3), 220–239. https://doi.org/10.1080/00273171.2015.1134306
Lamblin, M., Murawski, C., Whittle, S., & Fornito, A. (2017). Social connectedness, mental health and the adolescent brain. Neuroscience & Biobehavioral Reviews, 80, 57–68. https://doi.org/10.1016/j.neubiorev.2017.05.010
MacIntyre, P. D., Gregersen, T., & Mercer, S. (2020). Language teachers’ coping strategies during the Covid-19 conversion to online teaching: Correlations with stress, wellbeing and negative emotions. System, 94, 102352. https://doi.org/10.1016/j.system.2020.102352
Mansfield, R., Patalay, P., & Humphrey, N. (2020). A systematic literature review of existing conceptualisation and measurement of mental health literacy in adolescent research: current challenges and inconsistencies. BMC Public Health 2020 20:1, 20(1), 607-. https://doi.org/10.1186/S12889-020-08734-1
Markon, K. E. (2019). Bifactor and Hierarchical Models: Specification, Inference, and Interpretation. Annual Review of Clinical Psychology, 15(Volume 15, 2019), 51–69. https://doi.org/10.1146/annurev-clinpsy-050718-095522
Meggiolaro, S., & Ongaro, F. (2014). Family contexts and adolescents’ emotional status. Journal of Youth Studies, 17(10), 1306–1329. https://doi.org/10.1080/13676261.2014.918246
Montagni, I., Schwartz, A., Grové, C., & Marinucci, A. (2026). Exploration of factors associated with mental health literacy in French students: a dimension-specific approach. Global Health Promotion. https://doi.org/10.1177/17579759261419118
Mukminin, G. U., Zakariyya, F., Ihsan, H., Damaianti, L. F., Chotidjah, S., Fitria, A. C., Izzatulhaq, A. A., Naomi, D. P., Hayuningtyas, K., & Putri, W. W. (2024). Development of student mental health scale. Inovasi Kurikulum, 21(1), 443–454. https://doi.org/10.17509/jik.v21i1.64298
Narmandakh, A., Roest, A. M., de Jonge, P., & Oldehinkel, A. J. (2020). Psychosocial and biological risk factors of anxiety disorders in adolescents: a TRAILS report. European Child & Adolescent Psychiatry 2020 30:12, 30(12), 1969–1982. https://doi.org/10.1007/S00787-020-01669-3
Rabin, L. A., Miles, R. T., Kamata, A., Krishnan, A., Elbulok-Charcape, M., Stewart, G., & Compton, M. T. (2021). Development, item analysis, and initial reliability and validity of three forms of a multiple-choice mental health literacy assessment for college students (MHLA-c). Psychiatry Research, 300, 113897. https://doi.org/10.1016/j.psychres.2021.113897
Reckase, M. D. (2009). Multidimensional Item Response Theory. Multidimensional Item Response Theory. https://doi.org/10.1007/978-0-387-89976-3
Reise, S. P. (2012). The Rediscovery of Bifactor Measurement Models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555
Reise, S. P., & Yu, J. (1990). Parameter Recovery in the Graded Response Model Using MULTILOG. Journal of Educational Measurement, 27(2), 133–144. https://doi.org/10.1111/j.1745-3984.1990.tb00738.x
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures. Journal of Personality Assessment, 98(3), 223–237. https://doi.org/10.1080/00223891.2015.1089249
Rose, T., Joe, S., Williams, A., Harris, R., Betz, G., & Stewart-Brown, S. (2017). Measuring Mental Wellbeing Among Adolescents: A Systematic Review of Instruments. Journal of Child and Family Studies 2017 26:9, 26(9), 2349–2362. https://doi.org/10.1007/S10826-017-0754-0
Sathyanarayana, S., & Mohanasundaram, T. (2024). Fit Indices in Structural Equation Modeling and Confirmatory Factor Analysis: Reporting Guidelines. Asian Journal of Economics, Business and Accounting, 24(7), 561–577. https://doi.org/10.9734/AJEBA/2024/V24I71430
Sari, M. P., & Hazim, H. (2023). The Relationship Between Academic Anxiety and Academic Procrastination in Students of the Faculty of Psychology and Education, University of Muhammadiyah Sidoarjo: Hubungan Antara Kecemasan Akademik dengan Prokrastinasi Akademik pada Mahasiswa Fakultas P…. Journal of Islamic and Muhammadiyah Studies, 5, https://doi.org/10.21070/JIMS.V5I0.1581
Şengül Avşar, A. (2019). Comparison of Person-Fit Statistics for Polytomous Items in Different Test Conditions. Journal of Measurement and Evaluation in Education and Psychology, 10(4), 377–393. https://doi.org/10.21031/EPOD.525647
Şengül Avşar, A. (2023). Aberrant individuals’ effects on fit indices both of confirmatory factor analysis and polytomous IRT models. Current Psychology, 42(3), 2157–2166. https://doi.org/10.1007/S12144-021-01563-4
Sequeira, M., Singh, S., Fernandes, L., Gaikwad, L., Gupta, D., Chibanda, D., & Nadkarni, A. (2022). Adolescent Health Series: The status of adolescent mental health research, practice and policy in sub-Saharan Africa: A narrative review. Tropical Medicine and International Health, 27(9), 758–766. https://doi.org/10.1111/TMI.13802
Slocum-Gori, S. L., & Zumbo, B. D. (2010). Assessing the Unidimensionality of Psychological Scales: Using Multiple Criteria from Factor Analysis. Social Indicators Research 2010 102:3, 102(3), 443–461. https://doi.org/10.1007/S11205-010-9682-8
Smith, A. B., Rush, R., Fallowfield, L. J., Velikova, G., & Sharpe, M. (2008). Rasch fit statistics and sample size considerations for polytomous data. BMC Medical Research Methodology 2008 8:1, 8(1), 33-. https://doi.org/10.1186/1471-2288-8-33
Sumintono, B., & Widhiarso, W. (2014). Aplikasi model rasch untuk penelitian ilmu-ilmu sosial (2nd ed.). Cimahi: Trim Komunikata Publishing House. (November).
Sunarti, F. S., Almunsiri, O. Y., & Fadilah, L. (2026). The Relationship Between Parenting Style And Peer Social Support With Adolescent Mental Health At Smp Negeri 2 Pakuhaji. Proceeding of Banten Internasional Conference on Health Advancement and Research, 1(1), 100–107. https://binar.poltekkesbanten.ac.id/index.php/proceeding/article/view/25
Ten Berge, J. M. F., & Sočan, G. (2004). The Greatest Lower Bound to the Reliability of a Test and the Hypothesis of Unidimensionality. Psychometrika, 69(4), 613–625. https://doi.org/10.1007/BF02289858
World Health Organisation. (2024). Indonesia Adolescent Health Profile 2024. https://www.unicef.org/indonesia/health/reports/adolescent-health-profile
Wei, M., Alvarez, A. N., Ku, T. Y., Russell, D. W., & Bonett, D. G. (2010). Development and validation of a Coping with Discrimination Scale: factor structure, reliability, and validity. Journal of Counseling Psychology, 57(3), 328–344. https://doi.org/10.1037/A0019969
Wei, Y., McGrath, P. J., Hayden, J., & Kutcher, S. (2016). Measurement properties of tools measuring mental health knowledge: a systematic review. BMC Psychiatry 2016 16:1, 16(1), 297-. https://doi.org/10.1186/S12888-016-1012-5
Wright, B. D. (1977). Solving Measurement Problems With The Rasch Model. Journal of Educational Measurement, 14(2), 97–116. https://doi.org/10.1111/j.1745-3984.1977.tb00031.x
Yani, D. I., Chua, J. Y. X., Wong, J. C. M., Pikkarainen, M., Goh, Y. S. S., & Shorey, S. (2025). Perceptions of Mental Health Challenges and Needs of Indonesian Adolescents: A Descriptive Qualitative Study. International Journal of Mental Health Nursing, 34(1), e13505. https://doi.org/10.1111/INM.13505
Yen, W. M. (1984). Effects of Local Item Dependence on the Fit and Equating Performance of the Three-Parameter Logistic Model. Applied Psychological Measurement, 8(2), 125–145. https://doi.org/10.1177/0146621684008001
DOI: https://doi.org/10.24167/psidim.v25i1.14451
Print ISSN : 1411-6073 | online ISSN : 2579-6321 View My Stats
This work is licensed under a Creative Commons Attribution 4.0 International License.