A Pilot Feasibility Study of a Research Protocol Examining Predictors of Post-Traumatic Stress Symptoms among Malaysian Firefighters
DOI:
https://doi.org/10.33102/mjosht.530Keywords:
feasibility study, reliability analysis, online survey, firefighters, pilot studyAbstract
Post-Traumatic Stress Symptoms (PTSS) among firefighters are an important concern, and identifying potential risk factors may assist organisations in better managing PTSS in this population. A larger study has been proposed to determine the prevalence and predictors of PTSS among Malaysian firefighters. This pilot feasibility study aimed to evaluate the newly designed research protocol, identify any issues pertaining to the questionnaires’ instructions and items, assess the data collection process, and determine the reliability of the instruments intended for the main study. This pilot study recruited firefighters from five fire and rescue stations in a state on the east coast of Peninsular Malaysia, using a cluster sampling approach. This cross-sectional study utilised both paper-based and online surveys to figure out the feasibility of subject recruitment, data collection methods, and data entry procedures. Measurement instruments were evaluated using Confirmatory Factor Analysis (CFA) and reliability analysis (internal consistency and two-week test-retest). Of the 108 respondents, 87% preferred the online questionnaire distribution method. Appropriate amendments to the research protocol, recruitment procedures, and data analysis plan were identified and deemed feasible for implementation in the main study. All instruments demonstrated acceptable values of Composite Reliability (CR), high internal consistency (Cronbach’s alpha values greater than 0.7), and moderate to excellent consistency of the Intraclass Correlation Coefficient (ICC) for test-retest reliability (ranging from 0.504 to 0.999). Overall, this pilot study supports the feasibility and reliability of the proposed research protocol for conducting the main study on PTSS among Malaysian firefighters.
Downloads
References
[1] N. Nkomo, "Predictors of posttraumatic stress disorder among firefighters," M. Eng. thesis, University of the Witwatersrand, Johannesburg, Mar. 2016.
[2] M.D.H.A. Malek, B.S. Baco, M.A.M. Nor, and I.S.M. Kamil, "The sources of occupational stress and coping strategies among emergency workers in Sabah, Malaysia," Int J Humanit Soc Sci., vol. 6, pp. 155–162, Jun. 2016.
[3] (2022) What is post-traumatic stress disorder?. [Online]. Available: https://doi.org/10.31887/dcns.2011.13.2/nandreasen
[4] A.E. Kazak, M. Alderfer, M.T. Rourke, S. Simms, R. Streisand, and J.R. Grossman, "Posttraumatic stress disorder (PTSD) and posttraumatic stress symptoms (PTSS) in families of adolescent childhood cancer survivors," J Pediatr Psychol., vol. 29, pp. 211–219, 2004.
[5] M.N.M. Salleh, H. Ismail, and H.M. Yusoff, "Prevalence and Predictors for Post-Traumatic Stress Disorder (PTSD) among Firefighters: A Systematic Review," Int J Public Heal Res., vol. 10, pp. 1183–1194, 2020.
[6] L. Thabane, J. Ma, R. Chu, J. Cheng, A. Ismaila, L.P. Rios, R. Robson, M. Thabane, L. Giangregorio, and C.H. Goldsmith, "A tutorial on pilot studies: The what, why and how," BMC Med Res Methodol., vol. 10, pp. 1–10, 2010, doi: https://doi.org/10.1186/1471-2288-10-1
[7] A. Levordashka, "Effects of Questionnaire Design, on Respondent Experience and Data Quality," M. Eng. thesis, VU University Amsterdam, Netherlands, 2016.
[8] D. Oppenheimer, T. Meyvis, and N. Davidenko, "Instructional Manipulation Checks: Detecting Satisficing to Increase Statistical Power," J Exp Soc Psychol., vol. 45, pp. 867–872, 2009, doi: https://doi.org/10.1016/j.jesp.2009.03.009
[9] J.A. Krosnick, A.L. Holbrook, and M.K. Berent, R.T. Carson, W.M. Hanemann, R.J. Kopp, R.C. Mitchell, S. Presser, P.A. Ruud, S.V. Smith, W.R. Moody, M.C. Green, and M. Conaway, "The impact of “no opinion” response options on data quality non-attitude reduction or an invitation to satisfice?" Public Opin Q., vol. 66, pp. 371–403, 2002, doi: https://doi.org/10.1086/341394
[10] M.N.M. Salleh, H. Ismail, and H.M. Yusoff, "Reliability and validity of a post-traumatic checklist-5 (PCL-5) among fire and rescue officers in Selangor, Malaysia," J Heal Res., vol. 35, pp. 379–387, 2020, doi: https://doi.org/10.1108/JHR-11-2019-0243
[11] O.A. Rahman, A. Sufian, and Z. Kamaruzaman, "Depression, anxiety and stress among firefighters at one of balai bomba in Negeri Sembilan-A case study," J Educ Soc Sci., vol. 13, pp. 86–94, 2019.
[12] K.M. Connor, and J.R.T. Davidson, "Development of a new resilience scale: The Connor‐Davidson Resilience Scale (CD-RISC)," Depress Anxiety., vol. 18, pp. 76–82, 2003.
[13] C.G. Ng, A.N.A. Siddiq, S.A. Aida, N.Z. Zainal, and O.H. Koh, "Validation of the Malay version of the Multidimensional Scale of Perceived Social Support (MSPSS-M) among a group of medical students in Faculty of Medicine, University Malaya," Asian J Psychiatr., vol. 3, pp. 3–6, 2010, doi: https://doi.org/10.1016/j.ajp.2009.12.001
[14] M.S.B. Yusoff, "The Validity of the Malay Brief COPE in Identifying Coping Strategies among Adolescents in Seconday School," Int Med J., vol. 18, pp. 29–33, 2011.
[15] J. In, "Introduction of a pilot study," Korean J Anesthesiol., vol. 70, pp. 601–605, 2017, doi: https://doi.org/10.4097/kjae.2017.70.6.601
[16] S. Eldridge, C. Bond, M. Campbell, G. Lancaster, L. Thabane, and S. Hopwell, "Definition and reporting of pilot and feasibility studies," in 2nd Clinical Trials Methodology Conference: Methodology Matters Edinburgh, UK, 2013, paper 14, p. 018.
[17] G.J. De Vries, and M. Olff, "The lifetime prevalence of traumatic events and posttraumatic stress disorder in the Netherlands," J Trauma Stress., vol. 22, pp. 259–267, 2009, doi: https://doi.org/10.1002/jts.20429
[18] I.S. Chung, M.Y. Lee, S.W. Jung, and C.W. Nam, "Minnesota multiphasic personality inventory as related factor for post-traumatic stress disorder symptoms according to job stress level in experienced firefighters: 5-year study," Ann Occup Environ Med., vol. 27, pp. 1–6, 2015, doi: https://doi.org/10.1186/s40557-015-0067-y
[19] F. Torres. (2020) What is posttraumatic stress disorder (PTSD)? [Online]. Available: https://psychiatry.org/patients-families/ptsd/what-is-ptsd
[20] F.W. Weathers, B.T. Litz, T.M. Keane, P.A. Palmieri, B.P. Marx, and P.P. Schnurr, (2013) The PTSD checklist for DSM-5 (PCL-5) with Life Events Checklist for DSM-5 (LEC-5) and extended Criterion A (Measurement instrument). [Online]. Available: https://www.ptsd.va.gov/
[21] R. Bahari, M.N.M. Alwi, and M.R. Ahmad, "Translation and Validation of the Malay Posttraumatic Stress Disorder Checklist for DSM-5 (MPLC-5)," Malaysian J Med Heal Sci., vol. 15, pp. 15–20, 2019.
[22] M.N.M. Salleh, H. Ismail, and H.M. Yusoff, "Development, Validity and Reliability of Fire and Rescue Officer Traumatic Event Checklist," Int J Public Heal Clin Sci., vol. 6, pp. 171–180, 2019.
[23] L. Campbell-Sills L, D.R. Forde, and M.B. Stein, "Demographic and childhood environmental predictors of resilience in a community sample," J Psychiatr Res., vol. 43, pp. 1007–1012, 2009, doi: https://doi.org/10.1016/J.JPSYCHIRES.2009.01.013
[24] N.A.B.A. Halim, A. Ghaus, and L.K. Hwei, Connor-Davidson Resilience Scale (CD-RISC) Bahasa Malaysia version, 2012.
[25] Y.H. Kwan, A. Ng, K.K. Lim, W. Fong, J.K. Phang, E.H. Chew, N.L. Lui, C.S. Tan, J. Thumboo, T. Østbye, and Y.Y. Leung, "Validity and reliability of the ten-item Connor-Davidson Resilience Scale (CD-RISC10) instrument in patients with axial spondyloarthritis (axSpA) in Singapore," Rheumatol Int., vol. 39, pp. 105–110, 2019, doi: https://doi.org/10.1007/s00296-018-4217-8
[26] G.D. Zimet, N.W. Dahlem NW, S.G. Zimet, and G.K. Farley , (1988) "The Multidimensional Scale of Perceived Social Support," J Pers Assess., vol. 52, pp. 30–41, 1988, doi: https://doi.org/10.1207/s15327752jpa5201_2
[27] P.F. Lovibond, and S.H. Lovibond SH, (1995) "The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories," Behav Res Ther., vol. 33, pp. 335–343, 1995, doi: https://doi.org/10.1016/0005-7967(94)00075-U
[28] R. Musa, M.A. Fadzil, and Z. Zain, "Translation, validation and psychometric properties of Bahasa Malaysia version of the Depression Anxiety and Stress Scales (DASS)," ASEAN J Psychiatry., vol. 8, pp. 82–89, 2007.
[29] C.S. Carver, "You want to measure coping but your protocol’s too long: Consider the brief COPE," Int J Behav Med., vol. 4, pp. 92–100, 1997, doi: https://doi.org/10.1207/s15327558ijbm0401_6
[30] Z. Abu Hassan, P. Schattner, and D. Mazza, "Doing A Pilot Study: Why Is It Essential?" Malaysian Fam Physician., vol. 1, pp. 170–73, 2006.
[31] W.N. Arifin, and M.S.B. Yusoff, "Confirmatory Factor Analysis of the Universiti Sains Malaysia emotional quotient inventory among medical students in Malaysia," SAGE Open., vol. 6, pp. 1-9, 2016, doi: https://doi.org/10.1177/2158244016650240
[32] A Handbook on Structural Equation Modelling, Z. Awang, 2014.
[33] J.F. Hair, J.J. Risher, M. Sarstedt, and C.M. Ringle, "When to use and how to report the results of PLS-SEM," Eur Bus Rev., vol. 31, pp. 2–24, 2019, doi: https://doi.org/10.1108/EBR-11-2018-0203
[34] F. Middleton, (2023) The 4 types of reliability in research ; definitions & examples. [Online]. Available: https://www.scribbr.com/methodology/types-of-reliability/
[35] K.S. Taber, "The use of Cronbach’s Alpha when developing and reporting research instruments in science education," Res Sci Educ., vol. 48, pp. 1273–1296, 2018, doi: https://doi.org/10.1007/s11165-016-9602-2
[36] T. Braun, K. Ehrenbrusthoff, C. Bahns, L. Happe, and C. Kopkow, "Cross-cultural adaptation, internal consistency, test-retest reliability and feasibility of the German version of the evidence-based practice inventory," BMC Health Serv Res., vol. 19, pp. 1–17, 2019, doi: https://doi.org/10.1186/s12913-019-4273-0
[37] B. Sudha, A.J. Samuel AJ, and K. Narkeesh, "Feasibility online survey to estimate physical activity level among the students studying professional courses: A cross-sectional online survey," J Exerc Rehabil., vol. 14, pp. 58–63, 2018, doi: https://doi.org/10.12965/jer.1835130.565
[38] R. Marra, and B. Bogue, "A critical assessment of online survey tools," in Proc. 2006 WEPAN Conf., pp 1–11.
[39] M.N. Norhayati, and A.A. Aniza, "Psychometric properties of the Impact of Event Scale - Revised," Int J Collab Res Intern Med Public Heal., vol. 6, pp. 39–51, 2014, doi: https://doi.org/10.1016/j.brat.2003.07.010
[40] Connor-Davidson Resilience Scale (CD- RISC), J.R.T. Davidson. 2018.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Huwaida Abdul Azis, Zairina A Rahman, Nizam Baharom, Mohd Radzniwan A. Rashid, Hamidin Awang, Nur Hafizah Mohammad Lukman
This work is licensed under a Creative Commons Attribution 4.0 International License.
The copyright of this article will be vested to author(s) and granted the journal right of first publication with the work simultaneously licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) license, unless otherwise stated.
