Internal Structure Evaluation on the Indonesian Version of Psychological Well-Being Scales

Authors

  • Darmawan Muttaqin Faculty of Psychology, Universitas Surabaya, Indonesia

DOI:

https://doi.org/10.15575/psy.v9i1.10710

Keywords:

ESEM, psychological well-being, PWBS, reliability, factor structure

Abstract

The purpose of this research is to examine the internal structure of the Indonesian version of the Psychological Well-Being Scales (PWBS). This is a quantitative and cross-sectional research with the convenience sampling method used to obtain data from 1,337 students. The validity of the PWBS internal structure is evaluated using confirmatory factor analysis, exploratory structural equation modeling (ESEM), and composite reliability. The results showed that the Indonesian version of the 42-item PWBS and the 18-item PWBS do not have a satisfactory factor structure and internal consistency. Instead, it has few items that can accurately measure the concept of psychological well-being and are less able to represent the concept proposed by Ryff (1989). However, this research is not the only evidence that the Indonesian version of the PWBS cannot be used to measure psychological well-being.

References

Abbott, R. A., Ploubidis, G. B., Huppert, F. A., Kuh, D., & Croudace, T. J. (2010). An evaluation of the precision of measurement of Ryff’s psychological well-being scales in a population sample. Social Indicators Research, 97(3), 357–373. https://doi.org/10.1007/s11205-009-9506-x

Abbott, R. A., Ploubidis, G. B., Huppert, F. A., Kuh, D., Wadsworth, M. E., & Croudace, T. J. (2006). Psychometric evaluation and predictive validity of Ryff’s psychological well-being items in a UK birth cohort sample of women. Health and Quality of Life Outcomes, 4(1), 76. https://doi.org/10.1186/1477-7525-4-76

AERA, APA, & NCME. (2014). Standards for educational and psychological testing. American Educational Research Association. https://www.apa.org/science/programs/testing/standards

Asparouhov, T., & Muthén, B. O. (2009). Exploratory structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 397–438. https://doi.org/10.1080/10705510903008204

Bandalos, D. L. (2018). Measurement theory and applications for the social sciences. The Guilford Press.

Blankson, A. N., & McArdle, J. J. (2015). Measurement invariance of cognitive abilities across ethnicity, gender, and time among older Americans. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 70(3), 386–397. https://doi.org/10.1093/geronb/gbt106

Burns, R. A., & Machin, M. A. (2009). Investigating the structural validity of Ryff’s psychological well-being scales across two samples. Social Indicators Research, 93(2), 359–375. https://doi.org/10.1007/s11205-008-9329-1

Carlson, K. D., & Herdman, A. O. (2012). Understanding the impact of convergent validity on research results. Organizational Research Methods, 15(1), 17–32. https://doi.org/10.1177/1094428110392383

Cheng, S.-T., & Chan, A. C. M. (2005). Measuring psychological well-being in the Chinese. Personality and Individual Differences, 38(6), 1307–1316. https://doi.org/10.1016/j.paid.2004.08.013

Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49(1), 71–75. https://doi.org/10.1207/s15327752jpa4901_13

Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D., Oishi, S., & Biswas-Diener, R. (2009). New measures of well-being: Flourishing and positive and negative feelings. Social Indicators Research, 39, 247–266. https://doi.org/10.1007/978-90-481-2354-4_12

Dimitrova, R., & del Carmen, D. E. A. (2015). Measurement invariance of the satisfaction with life scale in Argentina, Mexico and Nicaragua. Social Inquiry into Well-Being, 1(1), 32-39. https://doi.org/10.13165/SIIW-15-1-1-04

Fernandes, H. M., Vasconcelos-Raposo, J., & Teixeira, C. M. (2010). Preliminary analysis of the psychometric properties of Ryff’s scales of psychological well-being in Portuguese adolescents. The Spanish Journal of Psychology, 13(2), 1032–1043. https://doi.org/10.1017/S1138741600002675

Finch, H. W., Immekus, J. C., & French, B. F. (2016). Applied psychometrics using SPSS and AMOS. Information Age Publishing Inc.

Furr, R. M. (2011). Scale construction and psychometrics for social and personality psychology. Sage Publications, Inc.

Gao, J., & McLellan, R. (2018). Using Ryff’s scales of psychological well-being in adolescents in mainland China. BMC Psychology, 6(1), 17. https://doi.org/10.1186/s40359-018-0231-6

Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2014). A primer on partial least squares structural equation modeling (PLS-SEM). Sage Publications, Inc.

Hambleton, R. K. (2005). Issues, designs and technical guidelines for adapting tests into multiple languages and cultures. In R. K. Hambleton, P. F. Merenda, & C. D. Spielberger (Eds.), Adapting Educational and Psychological Tests for Cross-Cultural Assessment (pp. 3–38). Erlbaum.

Johnston, M., Dixon, D., Hart, J., Glidewell, L., Schröder, C., & Pollard, B. (2014). Discriminant content validity: A quantitative methodology for assessing content of theory-based measures, with illustrative applications. British Journal of Health Psychology, 19(2), 240–257. https://doi.org/10.1111/bjhp.12095

Kállay, É., & Rus, C. (2014). Psychometric properties of the 44-item version of Ryff’s psychological well-being scale. European Journal of Psychological Assessment, 30(1), 15–21. https://doi.org/10.1027/1015-5759/a000163

Kitamura, T., Kishida, Y., Gatayama, R., Matsuoka, T., Miura, S., & Yamabe, K. (2004). Ryff’s psychological well-being inventory: Factorial structure and life history correlates among Japanese university students. Psychological Reports, 94(1), 83–103. https://doi.org/10.2466/pr0.94.1.83-103

Kline, R. B. (2014). Principles and practices of structural equation modeling (3rd ed.). American Psychological Association.

Li, R.-H. (2014). Reliability and validity of a shorter Chinese version for Ryff’s psychological well-being scale. Health Education Journal, 73(4), 446–452. https://doi.org/10.1177/0017896913485743

Lindfors, P., Berntsson, L., & Lundberg, U. (2006). Factor structure of Ryff’s psychological well-being scales in Swedish female and male white-collar workers. Personality and Individual Differences, 40(6), 1213–1222. https://doi.org/10.1016/j.paid.2005.10.016

Marcus, B., Bosnjak, M., Lindner, S., Pilischenko, S., & Schütz, A. (2007). Compensating for low topic interest and long surveys. Social Science Computer Review, 25(3), 372–383. https://doi.org/10.1177/0894439307297606

Marsh, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10, 85–110. https://doi.org/10.1146/annurev-clinpsy-032813-153700

Millsap, R. E., & Olivera-Aguilar, M. (2012). Investigating measurement invariance using confirmatory factor analysis. In R. Hoyle (Ed.), Handbook of Structural Equation Modeling (pp. 380–392). The Guilford Press.

Mubarok, F., & Miftahuddin, M. (2019). Uji validitas konstruk psychological well-being scale dengan metode confirmatory factor analysis (CFA). Jurnal Pengukuran Psikologi dan Pendidikan Indonesia (JP3I), 7(1), 22–32. https://doi.org/10.15408/jp3i.v7i1.12105

Muthén, L. K., & Muthen, B. (2017). Mplus user’s guide: Statistical analysis with latent variables, user’s guide. Muthén & Muthén.

Nagy, M. S. (2002). Using a single-item approach to measure facet job satisfaction. Journal of Occupational and Organizational Psychology, 75(1), 77–86. https://doi.org/10.1348/096317902167658

Papachristos, E. (2019). Assessing the performance of short multi-item questionnaires in aesthetic evaluation of websites. Behaviour and Information Technology, 38(5), 469–485. https://doi.org/10.1080/0144929X.2018.1539521

Pelupessy, D., Hartono, S. S. B., & Yang, Y. (2020). Psychological well-being and the sense of community among displaced (women) natural disaster survivors. Jurnal Sains Psikologi, 9(1), 46–56. https://doi.org/10.17977/um023v9i12020p46-56

Peterson, R. A., & Kim, Y. (2013). On the relationship between coefficient alpha and composite reliability. The Journal of Applied Psychology, 98(1), 194–198. https://doi.org/10.1037/a0030767

Prihandini, G. R., & Boediman, L. M. (2019). Pengaruh persepsi keterlibatan ayah dan harga diri terhadap kesejahteraan psikologis pada remaja awal. Ecopsy, 6(2). https://doi.org/10.20527/ecopsy.v6i2.6560

Purnamasari, P., Yudiarso, A., & Tondok, M. S. (2020). Well-being dan happiness pengemis jalanan di Surabaya. Keluwih: Jurnal Sosial dan Humaniora, 1(2), 102–107. https://doi.org/10.24123/soshum.v1i2.3106

Revelia, M. (2019). Uji validitas konstruk pada instrumen Ryff’s psychological well-being scale dengan metode confirmatory factor analysis (CFA). Jurnal Pengukuran Psikologi dan Pendidikan Indonesia (JP3I), 7(1), 8–14. https://doi.org/10.15408/jp3i.v7i1.12103

Rust, J., Kosinski, M., & Stillwell, D. (2021). Modern psychometrics: The science of psychological assessment. Routledge.

Ryff, C. D. (1989). Happiness is everything, or is it? Explorations on the meaning of psychological well-being. Journal of Personality and Social Psychology, 57(6), 1069–1081.

Ryff, C. D. (2014). Psychological well-being revisited: Advances in the science and practice of eudaimonia. Psychotherapy and Psychosomatics, 83(1), 10–28. https://doi.org/10.1159/000353263

Ryff, C. D., Almeida, D. M., Ayanian, J. Z., Carr, D. S., Cleary, P. D., Coe, C., … Williams, D. R. (2007). Midlife in the United States (MIDUS 2), 2004-2006. Inter-university Consortium for Political and Social Research [distributor]. https://doi.org/10.3886/ICPSR04652.v8

Ryff, C. D., & Keyes, C. L. M. (1995). The structure of psychological well-being revisited. Journal of Personality and Social Psychology, 69(4), 719–727. https://doi.org/10.1037/0022-3514.69.4.719

Ryff, C. D., & Singer, B. (1996). Psychological well-being: Meaning, measurement, and implications for psychotherapy research. Psychotherapy and Psychosomatics, 65(1), 14–23. https://doi.org/10.1159/000289026

Ryff, C. D., & Singer, B. H. (2008). Know thyself and become what you are: A eudaimonic approach to psychological well-being. Journal of Happiness Studies, 9(1), 13–39. https://doi.org/10.1007/s10902-006-9019-0

Sasaki, N., Watanabe, K., Imamura, K., Nishi, D., Karasawa, M., Kan, C., … Kawakami, N. (2020). Japanese version of the 42-item psychological well-being scale (PWBS-42): A validation study. BMC Psychology, 8(1), 75. https://doi.org/10.1186/s40359-020-00441-1

Schnettler, B., Zapata, E. M., Lobos, G., del Carmen Lapo, M., Berríos, C. A., & Hueche, C. (2017). Measurement invariance in the satisfaction with life scale in Chilean and Ecuadorian older adults. Personality and Individual Differences, 110, 96–101. https://doi.org/10.1016/j.paid.2017.01.036

Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Pearson.

van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492. https://doi.org/10.1080/17405629.2012.686740

van Dierendonck, D., Díaz, D., Rodríguez-Carvajal, R., Blanco, A., & Moreno-Jiménez, B. (2008). Ryff’s six-factor model of psychological well-being, A Spanish exploration. Social Indicators Research, 87(3), 473–479. https://doi.org/10.1007/s11205-007-9174-7

Villarosa, J., & Ganotice, F. (2018). Construct validation of Ryff’s psychological well-being scale: Evidence from Filipino teachers in the Philippines. Philippine Journal of Psychology, 51(1). https://doi.org/10.31710/pjp/0051.01.01

Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219–246. https://doi.org/10.1177/0095798418771807

Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070. https://doi.org/10.1037/0022-3514.54.6.1063

Whisman, M. A., & Judd, C. M. (2016). A cross-national analysis of measurement invariance of the satisfaction with life scale. Psychological Assessment, 28(2), 239–244. https://doi.org/10.1037/pas0000181

Yosita, T. L., Wismanto, Y. B., & Yudiati, E. A. (2022). Kesejahteraan psikologis pada ibu yang berperan ganda ditinjau dari dukungan suami dan tekanan psikologis. Jurnal Psikologi, 8(1), 71–81. https://doi.org/10.22146/gamajop.68548

Downloads

Published

2022-10-27

Issue

Vol. 9 No. 1 (2022): PSYMPATHIC

Section

Articles

Citation Check

License

The author whose published manuscript approved the following provisions:

1. The right of publication of all material published in the journal / published on the E-Journal of Psychology website is held by the editorial board with the knowledge of the author (moral right remains the author of the script).

2. The formal legal provisions for access to digital articles of this electronic journal are subject to the terms of the Creative Commons Attribution-ShareAlike license (CC BY-SA), which means that the Journal of Psychology reserves the right to save, transmit media / format, manage in database form, , maintain, and publish articles without requesting permission from the Author as long as it continues to include the name of the Author as the owner of Copyright.

3. Printed and published print and electronic manuscripts are open access for any purposes. In addition to these objectives, the editorial board shall not be liable for violations of copyright law.

Â