Wearable Biomonitoring Platform for the Assessment of Stress and its Impact on Cognitive Performance of Firefighters: An Experimental Study
Susana Rodrigues1, 2, *, Joana S. Paiva1, 2, 3, Duarte Dias1, 2, Gonçalo Pimentel1, 2, Mariana Kaiseler4, João Paulo S. Cunha1, 2
1 Institute for Systems Engineering and Computers – Technology and Science (INESC TEC), Porto, Portugal
2 Faculty of Engineering (FEUP), University of Porto, Porto, Portugal
3 Astronomy and Physics Department, Sciences Faculty, University of Porto, Porto, Portugal
4 Institute for Sport, Physical Activity and Leisure, Leeds Beckett University, Leeds, UK
Stress is a complex process with an impact on health and performance. The use of wearable sensor-based monitoring systems offers interesting opportunities for advanced health care solutions for stress analysis. Considering the stressful nature of firefighting and its importance for the community’s safety, this study was conducted for firefighters.
A biomonitoring platform was designed, integrating different biomedical systems to enable the acquisition of real time Electrocardiogram (ECG), computation of linear Heart Rate Variability (HRV) features and collection of perceived stress levels. This platform was tested using an experimental protocol, designed to understand the effect of stress on firefighter’s cognitive performance, and whether this effect is related to the autonomic response to stress.
The Trier Social Stress Test (TSST) was used as a testing platform along with a 2-Choice Reaction Time Task. Linear HRV features from the participants were acquired using an wearable ECG. Self-reports were used to assess perceived stress levels.
The TSST produced significant changes in some HRV parameters (AVNN, SDNN and LF/HF) and subjective measures of stress, which recovered after the stress task. Although these short-term changes in HRV showed a tendency to normalize, an impairment on cognitive performance was found after performing the stress event.
Current findings suggested that stress compromised cognitive performance and caused a measurable change in autonomic balance. Our wearable biomonitoring platform proved to be a useful tool for stress assessment and quantification. Future studies will implement this biomonitoring platform for the analysis of stress in ecological settings.
open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: https://creativecommons.org/licenses/by/4.0/legalcode. This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
* Address correspondence to this author at the Institute for Systems Engineering and Computers – Technology and Science INESC TEC - Rua Dr. Roberto Frias s/n Edifício 1, 4200-465 Porto, Portugal; Tel: 22 209 4000; E-mail: firstname.lastname@example.org
Wearable Biomonitoring Platform for the Assessment of Stress and its Impact on Cognitive Performance of Firefighters: An Experimental Study
Stress is widely recognized as a global challenge and has been the focus of concern by many researchers. Stress results from a transaction between the individual and the environment, where the individual perceives the demands of a situation as exceeding their individual resources [1Lazarus RS, Folkman S. Stress, coping and adaptation 1984.]. Stress perceptions are likely to activate physiological responses. Cannon was one of the first physiologists to explore the impact of stress, by describing the instinctual “fight-or-flight” response [2Cannon WB. Stresses and strains of homeostasis. Am J Med Sci 1935; 189: 1-14. [http://dx.doi.org/10.1097/00000441-193501000-00001] ]. When a threat is perceived, the Autonomic Nervous System (ANS) is triggered: the parasympathetic nervous system activation is reduced and the sympathetic nervous system is overactivated. This results in the secretion of stress-related hormones which leads to potential vasoconstriction of blood vessels, increased blood pressure, increased muscle tension, changes in Heart Rate (HR) and a decrease in heart rate variability (HRV). More recently, other possible response to threat exposure, called “Freezing”, has been investigated [3Roelofs K, Hagenaars MA, Stins J. Facing freeze: Social threat induces bodily freeze in humans. Psychol Sci 2010; 21(11): 1575-81. [http://dx.doi.org/10.1177/0956797610384746] [PMID: 20876881] ]. This response has been more evident in non-human species. It is characterized by bodily immobility and reduction in HR [4Niermann HCM, Figner B, Tyborowska A, Cillessen AHN, Roelofs K. Investigation of the stability of human freezing-like responses to social threat from mid to late adolescence. Front Behav Neurosci 2018; 12: 97. [http://dx.doi.org/10.3389/fnbeh.2018.00097] [PMID: 29867396] ]. In sum, when facing a threat, both the sympathetic and parasympathetic branches of the Autonomic Nervous System (ANS) are activated. While freezing is related with dominance in parasympathetic activity, fight-or-flight reactions are characterized by parasympathetic withdrawal and sympathetic elevation [5Roelofs K. Freeze for action: Neurobiological mechanisms in animal and human freezing. Phil Trans R Soc B 2017; 372(1718)].
The impact of the stress in the health condition is currently well recognized. Several personal, organizational, and medical costs, are being associated with increased stress health problems, such as heart disease, hypertension, upper respiratory tract infections, peptic ulcers, reduced immunity, migraines, alcoholism, depression, suicidal tendencies, anxiety, as well as other mental disorders [6Cohen S, Janicki-Deverts D, Doyle WJ, et al. Chronic stress, glucocorticoid receptor resistance, inflammation, and disease risk. Proc Natl Acad Sci USA 2012; 109(16): 5995-9. [http://dx.doi.org/10.1073/pnas.1118355109] [PMID: 22474371] , 7Fenici R, Brisinda D, Sorbo A. Methods for Real-Time Assessment of Operational Stress During Realistic Police Tactical Training 2011.]. For these reasons, it is extremely important to have instrumental solutions that allow the stressful event assessment and monitoring in order to measure, quantify and correlate with health impact. The use of technological wearable devices such as biomonitoring mobile sensors, that allow the continuous monitoring of physiological signals, offer interesting opportunities for advanced personal health care solutions and analysis of stress [8Carbonaro N, Anania G, Mura GD, Tesconi M, Tognetti A, Zupone G, et al. Wearable biomonitoring system for stress management: A preliminary study on robust ECG signal processing IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks; 2011; pp. 2011; 20-4., 9Dias D, Paulo Silva Cunha J. Wearable health devices-vital sign monitoring, systems and technologies. Sensors (Basel) 2018; 18(8): E2414. [http://dx.doi.org/10.3390/s18082414] [PMID: 30044415] ]. HRV has been proposed as a feasible and reliable quantitative marker describing the activity of the ANS in relation to stress [10Kim HG, Cheon EJ, Bai DS, Lee YH, Koo BH. Stress and heart rate variability: A meta-analysis and review of the literature. Psychiatry Investig 2018; 15(3): 235-45. [http://dx.doi.org/10.30773/pi.2017.08.17] [PMID: 29486547] ]. The HRV defines the complex variation of beat-to-beat intervals mainly controlled by ANS through the interaction of sympathetic and parasympathetic activity [11Schwab JO, Eichner G, Schmitt H, Weber S, Coch M, Waldecker B. The relative contribution of the sinus and AV node to heart rate variability. Heart 2003; 89(3): 337-8. [http://dx.doi.org/10.1136/heart.89.3.337] [PMID: 12591853] ]. However, little agreement exists in identifying the best HRV classifiers for stress [12Castaldo R, Melillo P, Bracale U, Caserta M, Triassi M, Pecchia L. Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis. Biomed Signal Process Control 2015; 18: 370-7.].
The current study sought to investigate stress impact on a sample of firefighters, since firefighting is a very stressful and demanding occupation [13Perroni F, Guidetti L, Cignitti L, Baldari C. Psychophysiological responses of firefighters to emergencies: A review. Open Sports Sci J 2014; 7: 8-15. [http://dx.doi.org/10.2174/1875399X01407010008] , 14Young PM, Partington S, Wetherell MA, St Clair Gibson A, Partington E. Stressors and coping strategies of U.K. firefighters during on-duty incidents. Stress and health. Journal of the International Society for the Investigation of Stress 2014; 30(5): 366-76.]. As an example, during emergency scenarios, firefighters have to quickly respond to innumerous stimuli under pressure and the decisions made during these emergency situations tend to be based on information that is ambiguous, incomplete or unusual, further complicating the decision process [15Leach J. Cognitive paralysis in an emergency: The role of the supervisory attentional system. Aviat Space Environ Med 2005; 76(2): 134-6. [PMID: 15742830] ]. Hence, stress is not only associated to physiological reactions, but also to cognitive responses such as attentional processes [16Ellenbogen MA, Schwartzman AE, Stewart J, Walker CD. Stress and selective attention: The interplay of mood, cortisol levels, and emotional information processing. Psychophysiology 2002; 39(6): 723-32. [http://dx.doi.org/10.1111/1469-8986.3960723] [PMID: 12462500] ]. Empirical evidence investigating the relationship between stress and cognitive performance has been quite mixed, depending on the levels of stress, nature of task, individual variables and so forth [17Starcke K, Wolf OT, Markowitsch HJ, Brand M. Anticipatory stress influences decision making under explicit risk conditions. Behav Neurosci 2008; 122(6): 1352-60. [http://dx.doi.org/10.1037/a0013281] [PMID: 19045954] ]. There are studies proposing that stress can negatively affect cognitive performance, particularly in searching for alternative solutions and making correct decisions [18Atsan N. Decision-making under stress and its implications for managerial decision-making: A review of literature. International Journal of Business and Social Research 2016; 6(3): 38-47. [http://dx.doi.org/10.18533/ijbsr.v6i3.936] ]. As opposed, other studies suggested that stress enhances the ability to better respond to stressful situations [19Nelson DL, Simmons BL. Health psychology and work stress: A more positive approach 2003.]. Pioneering work in this area was developed by Yerkes and Dodson [20Yerkes RM, Dodson JD. The relation of strength of stimulus to rapidity of habit formation. J Comp Neurol 1908; 18(5): 459-82.]. These authors proposed the Yerkes-Dodson Inverted-U function relating arousal and performance. Accordingly, performance increases with physiological or mental stress, but only up to a certain point. When the level of arousal is too high, performance decreases [21Mark G, Smith AP. Effects of occupational stress, job characteristics, coping, and attributional style on the mental health and job satisfaction of university employees. Anxiety Stress Coping 2012; 25(1): 63-78. [http://dx.doi.org/10.1080/10615806.2010.548088] [PMID: 21271408] ]. At the optimal level of arousal with regard to performance, stress is supposed to be minimal since adaptation to performance demands is maximal.
Considering that it is difficult to evaluate stress during firefighter’s real-life emergency, experimental designs are one typical alternative method. Advantages of such designs include avoiding retrospective report problems and can add rigor of an experimental design as well as allowing physiological stress response monitoring [22Zanstra YJ, Johnston DW. Cardiovascular reactivity in real life settings: measurement, mechanisms and meaning. Biol Psychol 2011; 86(2): 98-105. [http://dx.doi.org/10.1016/j.biopsycho.2010.05.002] [PMID: 20561941] ].
Following the above state of the art technology and considering the importance of investigating the influence of stress on health and cognitive performance, a controlled experimental protocol, using a wearable biomonitoring platform was designed for this effect. Hence, two hyphotheses were formulated: Hypothesis 1. Acute stress would cause a significant reduction in some Electrocardiogram (ECG) time-domain parameters—AVNN; SDNN; RMSSD; pNN20; pNN50 and an increase in ECG frequency-domain—LF/HF. Our second hypothesis was as follows: Hypothesis 2. Acute stress would impair cognitive performance, by increasing the Reaction Times (RT) and percentage of missing answers.
Twenty-one firefighters (2 females and 19 males) from a Fire department in Portugal voluntarily participated in this study. The age range was 21 to 59 years (M =29.90 ± 8.83). Regarding the educational background, seven had completed primary school, 10 completed the secondary school and four had attained graduation level education. The years of practice ranged between less than one year to 29 years (M=8.33 ± 8.21). The exclusion criteria for the study were participants having a history of cardiovascular disease and/or taking prescription drugs known to affect cardiovascular function. The study was approved by the University of Porto Ethics Committee. All informants were carefully instructed about the study protocol and gave written informed consent prior to examination.
2.2. Experimental Setup
For the acquisition of physiological data, participants were equipped with Vital Jacket® [23Cunha JPS. pHealth and wearable technologies: A permanent challenge. In: Blobel B, Pharow P, Sousa F, editors. pHealth 2012- Proceedings of the 9th Conference on Wearable Micro and Nano Technologies for Personalized Health 177. Porto, Portugal: IOS Press; 2012. p. 185-95., 24Cunha JPS, Cunha B, Pereira AS, Xavier W, Ferreira N, Meireles L. VitalJacket: A wearable wireless vital signs monitor for patients’ mobility in cardiology and sports. 4th. Int Conf Pervasive Comput Technol Healthc 2010; 2010: 22-5.]. The Vital Jacket® is a wearable bio-monitoring platform (in form of a t-shirt) able to collect medical grade ECG signals in real-time, without affecting daily activities of users. It also contains a 3-axis Accelerometer system, allowing ECG signals correction for actigraphy profiles and a Bluetooth transmitter that enables the visualization of ECG signal in real-time and also saves all the data in a SD memory card.
This equipment is certified according to the MDD93/42/EEC medical device directive and holds the European Conformity medical device mark [25Biodevices Certifications 2017. Available from: http://www.vitaljacket.com]. An android smartphone application was used for data synchronization and event marking. This system pairs with the Vital Jacket®via Bluetooth and enables the exact annotation of events in the device, using “Radiobuttons”. These events are saved in the device and synchronized with the ECG that is being acquired in real time. The android application stores all the information about the events in an SQL Light DataBase, from where a report of the event data can be generated and exported for further air traffiprocessing and analysis, always ensuring the synchronization between those events information and the data collected by the Vital Jacket®. Fig. (1) demonstrates the bio monitoring platform architechtutre.
System block diagram explaining the bio monitoring platform architecture.
In order to gather psychological stress data, the Spielberg State-Trait Anxiety Inventory (STAI 6-item short-form) was used [26Marteau TM, Bekker H. The development of a six-item short-form of the state scale of the Spielberger State-Trait Anxiety Inventory (STAI). Br J Clin Psychol 1992; 31(Pt 3): 301-6. [http://dx.doi.org/10.1111/j.2044-8260.1992.tb00997.x] [PMID: 1393159] ]. This instrument allows to quantify emotional, physical, and cognitive aspects of stress. Additionally, Visual Analogue Scales (VAS) were used to assess perceived stress [27Lesage FX, Berjot S, Deschamps F. Clinical stress assessment using a visual analogue scale. Occup Med (Lond) 2012; 62(8): 600-5. [http://dx.doi.org/10.1093/occmed/kqs140] [PMID: 22965867] ]. Participants have to rate the average level of perceived stress experienced during the tasks by marking any point on a 10-centimeter line ranging from ‘None’ to ‘As bad as it could be’.
Demographic and medical surveys were also used in order to assess participant’s current health state. Cognitive performance data was calculated using Matlab® scripts developed by our team.
A presentation session was organized to explain the aim and the overall protocol of the study. Then, those who wanted to participate in the study signed their name in a paper, expressing therefore their will to participate. The protocol lasted approximately 50 minutes and included a combination of tasks as shown in Fig. (2).
Diagram of the protocol. VAS - Visual Analogue Scales. TSST - Trier Social Stress Test.
Participants completed the demographic, medical survey and STAI 6-item short-form. Then, they were equipped with Vital Jacket® and were allowed to sit comfortably for a 5-minute resting baseline. Additionally, at the beginning of the protocol and at the end of each task, firefighters were requested to fill in the VAS in order to assess perceived stress. Then, they started by performing a 2-Choice Reaction Time Task (CRTT) [28Ribeiro MJ, Paiva JS, Castelo-Branco M. Spontaneous fluctuations in sensory processing predict within-subject reaction time variability. Front Hum Neurosci 2016; 10: 200. [http://dx.doi.org/10.3389/fnhum.2016.00200] [PMID: 27242470] ]. This task required participants to respond to a stimulus, by clicking in a button, as fast as possible. The stimuli consisted in three different types of targets: (a) an arrowhead pointing to the left on top of a square both filled with a sinewave grating pattern; (b) the same stimulus, but with the arrowhead directed to the right; (c) the grating square only (without an arrowhead) which remained in the center of the screen, between the appearance of each stimulus along the task. The stimuli were generated with Matlab®. The stimuli selected were subtle enough to induce incorrect or missed responses by the subjects during attention lapses caused by fatigue. This task was performed twice, at the beginning of the protocol (CRTT 1; pre-stress condition) and after the stress task (CRTT 2; post-stress condition). The stress procedure was based on an acute psychosocial stress paradigm, the Trier Social Stress Test (TSST) [29Kirschbaum C, Pirke K-M, Hellhammer DH. The ‘Trier Social Stress Test’-A tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology 1993; 28(1-2): 76-81. [http://dx.doi.org/10.1159/000119004] [PMID: 8255414] ]. The TSST inlcude elements of public speaking, mental arithmetic and anticipation. The period of induced stress lasts approximately 15 minutes, and is divided into 5-minute components. Before the test begins, the participants are fitted with the wearable ECG equipment. Stress induction begins with the participant being taken into a room where a panel of an evaluation comitee that includes three judges, along with a video camera and audio recorder. The first 5 minute component is the anticipatory stress phase, during which the judges ask the participant to prepare a 5 minute presentation. This participation is framed as part of a job interview. Also, the judges have been trained to maintain neutral expressions throughout the test. The participant is permitted to use paper and pen to prepare their presentation, but this paper is then unexpectedly taken away from them when it is time to begin the presentation. During the 5 minute presentation component, the judges observe the participant without comments. If the participant does not use the entire 5 minutes, they will ask him/her to carry on, until the entire 5 minutes have been used. The presentation is immediately followed by the mental arithmetic component, during which the participant is asked to count down from 1022 by 13´s for 5 minutes. When making a mistake, the participant is asked to start over. Immediately after the test, there is a debriefing, in which the participant is told that the purpose of the test was to evoke stress, and that the results are in no way a reflection on his or her personal abilities. This task was selected for inducing stress, considering its components of unpredictability and uncontrollability, as a means to represent those elements of stressors that are encountered daily by firefighters.
During all session, one of the researchers used the android smartphone application to mark the events that synchronized with the ECG. At the end of the protocol participants filled in STAI 6-item short-form again.
2.4. Data Analysis
Data were statistical analyzed using IBM SPSS (v.24) software. Considering the few number of population samples, some parameters failed in the normality test, so all parameters were analyzed using non-parametric statistical tests. Wilcoxon Signed Rank Test and Friedman Test were the nonparametric alternatives used to compare means between study time points. Paired- samples T-Test was used as Post-hoc pairwise comparisons to determine the exact differences between the time pairs [30Pallant J. SPSS survival manual 2013.]. Spearman correlation was performed in order to find significant correlations between performance measures, psychological variables and physiological data (ECG-related measures); and statistical significant differences between pre and post-stress conditions, concerning those variables. Median reaction time (RT) values were considered instead of mean values, because RTs are not normally distributed with a longer tail of slow compared with fast responses [31Georgieva K, Georgieva O, Georgieva P, Ribeiro MJ, Paiva JS. Regression approach for automatic detection of attention lapses. In: Intelligent Systems (IS), 2016 IEEE 8th International Conference; 2016.2016.].
2.4.2. ECG Data
In order to extract heartbeat information from the ECG recordings, a software with an ECG analyzer was used (software from Biodevices S.A - the same commercialized by this company to cardiology specialists). This software has an algorithm based on the one developed by Pan Tompkins [32Pan J, Tompkins WJ. A real-time QRS detection algorithm. IEEE Trans Biomed Eng 1985; 32(3): 230-6. [http://dx.doi.org/10.1109/TBME.1985.325532] [PMID: 3997178] ] incorporating ECG physiological filters to detect the “R” points of the ECG waveform. Using this analyzer, the RR interval (time between two consecutives “R” peaks in the ECG) was extracted.
A simple verification according to Clifford et al. [33Clifford GD, Azuaje F, McSharry P. Advanced methods and tools for ECG data analysis 2006.], was made to confirm if all the RR intervals were physiologically valid. The RR intervals that have physiological acceptance are named normal-to-normal (NN) intervals.
Following the guidelines presented by the task force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology [34Task Force of the European Society of Cardiology Heart rate variability, standards of measurement, physiological interpretation, and clinical use circulation 1996.] different HRV time and spectral domains parameters were used (see Table 1). Methods in the time domain define the intervals between successive normal QRS complexes (the Q-wave, R-wave, and S-wave). Measurements in the frequency domain provide information of how power (variance) distributes as a function of frequency. For time domain parameters, we used the Average of NN intervals (AVNN) and Standard Deviation of all NN (SDNN), expressed in milliseconds (ms) as well as the percentage of the number of pairs of successive NNs that differ by more than 20 or 50 ms compared to the total number of NN intervals, normally referenced to as pNN20 and pNN50, respectively [34Task Force of the European Society of Cardiology Heart rate variability, standards of measurement, physiological interpretation, and clinical use circulation 1996.]. The root mean square of differences between successive Rhythm-to-Rhythm (RR) intervals (RMSSD) was also used considering that it describes short-term HR variations. For extraction of spectral parameters the Lomb Periodogram was implemented [35Lomb NR. Least-squares frequency analysis of unequally spaced data. Astrophys Space Sci 1976; 39(2): 447-62. [http://dx.doi.org/10.1007/BF00648343] ]. For frequency domain analysis, we used both the Low Frequency (LF) component defined between 0.04-0.15 Hz as well as the high frequency (HF) component (0.15-0.4 Hz) and computed their ratio - LF/HF. A recent systematic review conducted by Castaldo et al. [12Castaldo R, Melillo P, Bracale U, Caserta M, Triassi M, Pecchia L. Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis. Biomed Signal Process Control 2015; 18: 370-7.] in order to find the more reliable HRV features trends during stress (see Table 1) suggested that four measures—AVNN, RMSSD, pNN50—in time and non-linear domains, resulted in being significantly depressed during stress. SDNN were also reduced in the majority of studies. Even though pNN20 is not frequently used in the literature, this metric was considered in our study, due to the interesting results obtained by Schaaff et al. [36Schaaff K, Adam MT, Eds. Measuring emotional arousal for online applications: Evaluation of ultra-short term heart rate variability measures. 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction 2013. [http://dx.doi.org/10.1109/ACII.2013.66] ]. The ratio between low and high frequency (LF/HF) showed to be significantly increased, suggesting a sympathetic activation and a parasympathetic withdrawal during acute stress.
Table 1 Descriptions of HRV measures and their tendency under stress [12Castaldo R, Melillo P, Bracale U, Caserta M, Triassi M, Pecchia L. Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis. Biomed Signal Process Control 2015; 18: 370-7.].
2.4.3. Cognitive Performance
Cognitive performance was analyzed considering the following Reaction Time (RT) related variables: median; minimum; maximum; standard deviation and the number of missed targets (missings) when performing CRTT. Performance results in terms of the number of correct responses versus total number of responses was not accessed for this experiment in specific, due to its low degree of complexity and habituation effects that could occur between the transition from the first time that participants performed the task (CRTT1) to CRTT2. Z-score values were considered regarding cognitive performance (RT-related variables) group statistical analysis.
3.1. Psychological Stress Scores
To test the Hypothesis 1, stress self-perceptions were firstly analyzed to understand if the acute stress task was self-perceived as stressful. Friedman Test was used to analyze VAS scores along the protocol. Results indicated that there was a statistically significant change in perceived stress between the four time points of the study: baseline, CRTT1, TSST and CRTT2 - χ2 (2, n = 21) = 28.95, p < .001. Post-hoc pairwise comparisons showed that perceived stress significantly increased from baseline (M=3.39) to TSST (M=5.41) and from CRRT1 (M=3.29) to TSST (M=5.41). A significant decrease was found from TSST (M=5.41) to CRTT2 (M=3.24) (Fig. 3d, Table 2).
Mean statistical significant differences for ECG-derived measures – a) AVNN; b) SDNN; c) LF/HF and subjective stress measures - d) VAS across study time points (p<.005; Friedman test). *Represents statistical significant differences (p<.005; post-hoc pairwise comparisons).
Table 2 Mean and standard deviation of self-reported measures of stress.
Wilcoxon Signed Rank Test was used to analyze STAI 6-item short-form data. Results revealed a statistically significant reduction of stress levels, from the beginning of the protocol to the end of the protocol, z = –2.24, p = < .05, with a medium effect size (r = .35). The median score on STAI 6-item short-form decreased from the beginning of the protocol (M = 2.02) to the end of the protocol (M = 1.76) (Table 2).
3.2. ECG Data
To test the Hypothesis 1, regarding the physiological impact of acute stress, ECG data was obtained from 17 participants out of the 21. Four ECG recordings were removed due to problems in server data storage. Physiological baseline data collected at the 5 first minutes of the protocol were compared with the three important time points of the study: the pre-stress condition - CRTT1, the stress condition – TSST; and the post stress condition - CRTT2 using 5 minutes windows length. The parameters used for these analysis were time domain: AVNN; SDNN; RMSSD; pNN20; pNN50 and frequency –domain: LF/HF. Friedman Test was used to understand if there were statistically significant differences in these prameters across the four time points of the study (Fig. 3a). Regarding AVNN, significant differences were found between the study time –points: χ2 (2, n=17) =16.55; p < .005. Post-hoc pairwise comparisons showed that AVNN significantly decreased from CRTT1 (M=765.65) to TSST (M=721.47) and then it increased from TSST (M=721.47) to CRTT2 (M=800.60). Inspection of the mean values showed that AVNN achieved the lowest value during TSST (M=765.65) (Fig. 3b). Regarding the SDNN, χ2 (2, n=17) =15.00; p < .005, post-hoc pairwise comparisons showed that SDNN significantly increased from CRTT1 (M=56.722) to TSST (M=72.74). For LF/HF - χ2 (2, n=17) =19.94; p < .001, post- hoc pairwise comparisons showed that LF/HF significantly increased from baseline (M=1.38) to CRTT1(M=2.08), baseline (M=1.38) to TSST (M=3.00) and baseline (M=1.38) to CRTT2 (M=2.07). The highest value was obtained during TSST (M=3.00) (Fig. 3c). In the time domain, with the exception of AVNN and SDNN, results from other parameters do not show any significant differences. However, there is a tendency for a lower RMSSD, pNN20 and pNN50 during the stress condition, when compared to the other moments.
3.3. Cognitive Performance
Regarding the subpopulation analyzed in terms of the influence of acute stress in cognitive performance when performing a simple Choice Reaction Time Task (CRTT), 19 participants were considered. Two participants were removed due to technical problems when saving data from the RT task.
To test Hyphotesis 2, some RT-related tasks and measures were statistically analysed. Despite cognitive performance in terms of RT-related measures and missed trials,apparently impaired by TSST; median RT, maximal RT, minimum RT and percentage of missing trials increased in post-stress condition -, none of these variables were shown to be significantly different between pre- and post-stress conditions (Table 3).
Table 3 Cognitive performance results regarding CRTT performed before and after the stress condition in terms of Reaction Time (RT) and percentage of missed trials (Missings).
Significant correlations were found between some of the cognitive performance variables using Spearman´s rank order correlation (Table 4) as explained below. A strong and negative correlation was found for median RT values between the CRTTs performed before and after stress condition, r = -.71, p < .001 suggesting that, the faster the subjects responded to targets in the CRTT1 (pre-stress condition), the slower they were in CRTT2, which is reinforced by the fact that Median RT median values across participants were higher after TSST compared to the previous finding (Fig. 4a). A strong and positive correlation was also found between Max RT values and percentage of Missings only in the CRTT2, r =.53, p < .01 (Table 4). Standard deviation of RT values showed a decrease in CRTT2 while stress levels increased, even though this change was not statistically significant. However, three significant correlations were found regarding this variable.
Table 4 Significant correlations values between the cognitive performance variables (median RT, Maximal RT, Min RT and Standard deviation of RTs) obtained during the two reaction time tasks (CRTT1 and CRTT2).
RT-related measures evolution between pre- and post-stress conditions. (a) Graphic representing the relation between z-score Median RT pre- (CRTT1) and post-stress (CRTT2) conditions and corresponding fit line. (b) Z-score standard deviation values (SD) of RT relation between pre- and post-stress stages and fit line.
Firstly, there was a negative and strong correlation between Min RT and standard deviation RT values only in CRTT2, r = -.67, p < .01, which increased and decreased respectively, after the stress condition. Secondly, standard deviation RT variable was shown to be negatively and strongly correlated between pre- and post-stress condition, r = -.70, p < .01 (Table 4). Thirdly, the difference of Min RT values between CRTT2 and CRTT1 was negatively and strongly correlated with the difference of RT standard deviation values between CRTT2 and CRTT1, r = -.63, p < .01 (Table 4) and considering that Min RT values increased after TSST and RT standard deviation values decreased after TSST, the proposed protocol showed that acute stress events are able to hamper response speed, despite turning response time frequency range narrower (Fig. 4b).
This study investigated the effects of stress on cognitive performance of firefighters and whether this effect was related to the autonomic response to stress, using a biomonitoring platform. Several HRV parameters were analysed in order to identify those that change significantly under the influence of stress.
Our first hypothesis indicated that stress would have an impact on participants physiology, particularly a reduction in some ECG time-domains—AVNN, SDNN, RMSSD, pNN20 and pNN50 and an increase in ECG frequency-domains— particularly LF/HF. In order to test the abovementioned hyphothesis, we analyzed psychological self-reported data in order to confirm if the chosen stress paradigm was in fact stressful for the participants. Hence, the TSST was chosen, based on previous research that indicated this task as a gold stress standard task [29Kirschbaum C, Pirke K-M, Hellhammer DH. The ‘Trier Social Stress Test’-A tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology 1993; 28(1-2): 76-81. [http://dx.doi.org/10.1159/000119004] [PMID: 8255414] , 37Olver JS, Pinney M, Maruff P, Norman TR. Impairments of spatial working memory and attention following acute psychosocial stress. Stress Health 2015; 31(2): 115-23. [http://dx.doi.org/10.1002/smi.2533] [PMID: 24395182] ]. Our results based on stress VAS results, along with the some HRV parameters showed that the selected stress test indeed evoked stress and was thus appropriate for the aim of this study. Accordingly, the present study shows that short-term psychological stress caused significant changes in some time domain measures – AVNN and SDNN and frequency domain parameters – LH/HF between time points of the study. The decrease in AVNN from CRTT1 (pre-stress) to the TSST (stress condition), suggested that the stimulus caused a higher activation of the cardiovascular system, preparing the body to rapidly react (fight-or-flight response) [38McCorry LK. Physiology of the autonomic nervous system. Am J Pharm Educ 2007; 71(4): 78. [http://dx.doi.org/10.5688/aj710478] [PMID: 17786266] ]. Hence, lower values are associated with stress responses [12Castaldo R, Melillo P, Bracale U, Caserta M, Triassi M, Pecchia L. Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis. Biomed Signal Process Control 2015; 18: 370-7.]. Regarding SDNN, there was a significant increase from CRTT1 to TSST. This is an unexpected result, because according to the literature in the area, acute stress tends to cause a decrease in SDNN [12Castaldo R, Melillo P, Bracale U, Caserta M, Triassi M, Pecchia L. Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis. Biomed Signal Process Control 2015; 18: 370-7.]. These findings are similar to those by, Schubert et al. [39Schubert C, Lambertz M, Nelesen RA, Bardwell W, Choi J-B, Dimsdale JE. Effects of stress on heart rate complexity-A comparison between short-term and chronic stress. Biol Psychol 2009; 80(3): 325-32. [http://dx.doi.org/10.1016/j.biopsycho.2008.11.005] [PMID: 19100813] ] in a study examining the stress effects on HRV, in 50 healthy subjects using a short-term stressor reactivity assessed with a speech task. Among other findings, results suggested that SDNN increased during the stress condition. The authors proposed that talking loud and particularly, doing stressful mental arithmetic’s were associated with a slowing in respiratory rate and a relative reduction in ventilation, and increase in SDNN. Such evidence on the influence of speech-related respiratory patterns on linear HRV measures could explain why in the current study the stress condition (TSST- that also includes a speech task and an arithmetic task) was associated with decreases in SDNN, independently of changes in parasympathetic modulation of HR.
The remaining time domain features (RMSSD, pNN20 and pNN50) showed a consistent but non-significant decrease during the stress condition, which is also compatible with a stress response [40Taelman J, Vandeput S, Spaepen A, Van Huffel S. Influence of mental stress on heart rate and heart rate variability 4th European conference of the international federation for medical and biological engineering Springer; 2009.2009., 41Trimmel M. Relationship of Heart Rate Variability (HRV) parameters including pNNxx with the subjective experience of stress, depression, well-being, and every-day trait moods (TRIM-T): A pilot study. Ergonomics Open J 2015; 8(1) [http://dx.doi.org/10.2174/1875934301508010032] ]. This might be explained by the limited number of subjects. Within the frequency domain, a significant increase in the LF/HF ratio during the stress condition was also found, indicating the marked effect of stress on sympathovagal balance [42Delaney JP, Brodie DA. Effects of short-term psychological stress on the time and frequency domains of heart-rate variability. Percept Mot Skills 2000; 91(2): 515-24. [http://dx.doi.org/10.2466/pms.2000.91.2.515] [PMID: 11065312] ]. Higher values reflect the domination of the sympathetic system over the parasympathetic one, typical of stress responses [43Kaur S, Bhalla P, Bajaj S, Sanyal S, Babbar R. Effect of physical and mental stress on heart rate variability in type-A and type-B personalities. Indian Journal of Applied Basic Medical Sciences 2013; 15(20): 59-70.]. A recent study conducted with air traffic controllers using a similar method also found statistically significant differences in some HRV metrics (AVNN, SDNN and LF/HF), reinforcing therefore the discriminatory power of these metrics for the stress quantification using HRV measurements [44Rodrigues S, Paiva JS, Dias D, Aleixo M, Filipe RM, Cunha JPS. Cognitive impact and psychophysiological effects of stress using a biomonitoring platform. Int J Environ Res Public Health 2018; 15(6): E1080. [http://dx.doi.org/10.3390/ijerph15061080] [PMID: 29861450] ]. These physiological results, gathered by the wearable ECG device, were concordant with an elevation of self-perceptions stress (VAS) in the stress condition, which returned to baseline at the end of the protocol, confirming therefore our hyphothese 1, with the exception of SDNN that increased with stress.
Our second hypothesis porposed that acute stress would impair cognitive performance, by increasing the RTs and the missing answers. Our results confirm this hyphotheses, showing that performance was impaired after stress. Accordingly, averaged RT median values across participants were negatively correlated between pre-and post-stress condition, showing that acute stress served as a turning point for the firefighter’s cognitive performance along the protocol. Additionally, significant correlations were found between some of the cognitive performance variables, indicating that TSST has negatively influenced the ability to respond quickly and effectively to targets. Particularly, performance was impaired precisely in terms of maximal RT and Missings percentage. Additionally, the fact that those two variables were positively correlated in CRTT2, reinforces the decline in performance induced by the increased stress levels after TSST. Considering that RT variability values also decreased after stress, it has been suggested that probably, the activation of sympathetic nervous system in acute stress conditions leads to a less variable RT response as already stated by previous studies not directly compatible with an improvement response judgment ability [45Robinson MD, Wilkowski BM, Meier BP. Unstable in more ways than one: Reaction time variability and the neuroticism/distress relationship. J Pers 2006; 74(2): 311-43. [http://dx.doi.org/10.1111/j.1467-6494.2005.00377.x] [PMID: 16529579] ]. In fact, perception ability was effectively impaired by stress levels in this case, leading to more missed trials by participants in CRTT2. It can be concluded that stress negatively influenced the cognitive performance of participants. Accordingly, a study conducted with 21 firefighters in order to understand stress during real emergency scenarios and its impact on cognitive performance found that cognitive performance was impaired immediately after their training period and after a short delay. In line with these findings, it was also found in the current study that despite the fact that after the stress condition, and during the CRTT2, HRV parameters showed a trend to “stabilize”, participants presented an impairment on their cognitive performance, by decreasing their attention levels. Similarly, in a study conducted with 23 healthy participants aiming to investigate the effects of TSST on impaired attention and working memory, it concluded that abnormalities in attention persisted for at least 30 minutes following the stressor [37Olver JS, Pinney M, Maruff P, Norman TR. Impairments of spatial working memory and attention following acute psychosocial stress. Stress Health 2015; 31(2): 115-23. [http://dx.doi.org/10.1002/smi.2533] [PMID: 24395182] ].
These results enhance even more the negative impact of stress levels on cognitive abilities in short and long terms, particularly for firefighters, who are constantly suffering from stressful/high strain events.
This study is not without limitations. Particularly, the reduced sample size, the trasnversal evaluation, the absence of a control group and the focus on only one simple cognitive task. Additionally, despite this task is a gold standard stress task in the literature, it does not represent the real world stressors faced daily by firefighters. Despite these, the current study is unique in terms of the specific population under study and the methodology used, providing an important insight into the direct effects of stress and allowing future avenues for new perspectives on the treatment and prevention of stress-related diseases, including a more personalized health and wellbeing approach.
Additionaly, the use of a medical certified wearable and non-invasive device, that collects clinical-grade ECG is also an asset in this study. Our scope is to deploy, in the future, this wearable platform during real situations, using the same population. The current results will serve as a stress groundtruth, where machine learning techniques will be implemented for the development of algorithms that will be used in early stress detection.
Findings from the current study suggested a relationship between stress and cognitive performance. Particularly, after an increase in the stress levels, the cognitive performance of firefighters decreased. These results support the need to further understand firefighters stress and cognitive functioning in order to prevent wrong decisions under pressure. Applied interventions should mitigate vulnerability to stress, by preparing and training firefighters. Moreover, prevention programs (e.g., mindfulness training) should also be developed and adapted to this population needs.
Regarding the autonomic response to stress we have identified a significant change in some HRV parameters under the influence of stress. Particularly, AVNN and LF/HF ratio seems to be very promising features for short-term stress classification based on HRV as classification results. This information could be of great help for researchers in the development of qOHealth technology, like the design of on-line platforms and devices that will help integrate psychophysiological stress information. Consequently, fire administrators and the firefighters themselves will benefit from the use of real time information. Acknowledging that critical decisions need to be made quickly on the spot, it seems advantageous to have complementary data to support decisions. As an example, awareness of firefighter’s real stress state in a particular situation, might be useful to make informed decisions on resting periods, task schedules or even on self-regulation strategies. This might be suitable information to consider for the professional task assignment (e.g., providing more resting periods). Additionally, future studies should consider the use of this type of bio monitoring platforms of stress during real events.
LIST OF ABBREVIATIONS
= Autonomic Nervous System
= Average of NN intervals
= Choice Reaction Time Task
= High Frequency
= Heart Rate
= Heart Rate Variability
= Statistical Package for Social Sciences software
= Low Frequency
= Ratio of Low Frequency and High Frequency power bands
= Normal-to-Normal intervals
= NN variations above 20 ms
= NN variations above 50 ms
= Quantified Occupational Health
= Root Mean Square of differences of successive NN intervals
= Reaction Times
= Rhythm-to-Rhythm intervals
= Standard Deviation of all NN intervals
= Spielberg State-Trait Anxiety Inventory
= Trier Social Stress Test
= Visual Analogue Scales
ETHICS APPROVAL AND CONSENT TO PARTICIPATE
The study was approved by the University of Porto Ethics Committee.
HUMAN AND ANIMAL RIGHTS
All the reported experiments in accordance with the ethical standards of the committee responsible for human experimentation (institutional and national), and with the Helsinki Declaration of 1975, as revised in 2013 (http://ethics.iit.edu/ecodes/node/3931).
CONSENT FOR PUBLICATION
Written and informed consent was obtained for the study.
CONFLICT OF INTEREST
The authors declare no conflict of interest, financial or otherwise.
We would like to thank the Chief Command of the Portuguese firefighter department and the firefighters for accepting to participate in this study. This work has been financed by National Funds through the FCT Fundação para a Ciência e Tecnologia (Portuguese Foundation for Science and Technology) within the project VR2Market CMUP-ERI/FIA/0031/2013 and FCT PhD grant PD/BD/135023/2017.
Lazarus RS, Folkman S. Stress, coping and adaptation 1984.
Niermann HCM, Figner B, Tyborowska A, Cillessen AHN, Roelofs K. Investigation of the stability of human freezing-like responses to social threat from mid to late adolescence. Front Behav Neurosci 2018; 12: 97. [http://dx.doi.org/10.3389/fnbeh.2018.00097] [PMID: 29867396]
Roelofs K. Freeze for action: Neurobiological mechanisms in animal and human freezing. Phil Trans R Soc B 2017; 372(1718)
Fenici R, Brisinda D, Sorbo A. Methods for Real-Time Assessment of Operational Stress During Realistic Police Tactical Training 2011.
Carbonaro N, Anania G, Mura GD, Tesconi M, Tognetti A, Zupone G, et al. Wearable biomonitoring system for stress management: A preliminary study on robust ECG signal processing IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks; 2011; pp. 2011; 20-4.
Castaldo R, Melillo P, Bracale U, Caserta M, Triassi M, Pecchia L. Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis. Biomed Signal Process Control 2015; 18: 370-7.
Young PM, Partington S, Wetherell MA, St Clair Gibson A, Partington E. Stressors and coping strategies of U.K. firefighters during on-duty incidents. Stress and health. Journal of the International Society for the Investigation of Stress 2014; 30(5): 366-76.
Leach J. Cognitive paralysis in an emergency: The role of the supervisory attentional system. Aviat Space Environ Med 2005; 76(2): 134-6. [PMID: 15742830]
Ellenbogen MA, Schwartzman AE, Stewart J, Walker CD. Stress and selective attention: The interplay of mood, cortisol levels, and emotional information processing. Psychophysiology 2002; 39(6): 723-32. [http://dx.doi.org/10.1111/1469-8986.3960723] [PMID: 12462500]
Starcke K, Wolf OT, Markowitsch HJ, Brand M. Anticipatory stress influences decision making under explicit risk conditions. Behav Neurosci 2008; 122(6): 1352-60. [http://dx.doi.org/10.1037/a0013281] [PMID: 19045954]
Atsan N. Decision-making under stress and its implications for managerial decision-making: A review of literature. International Journal of Business and Social Research 2016; 6(3): 38-47. [http://dx.doi.org/10.18533/ijbsr.v6i3.936]
Nelson DL, Simmons BL. Health psychology and work stress: A more positive approach 2003.
Yerkes RM, Dodson JD. The relation of strength of stimulus to rapidity of habit formation. J Comp Neurol 1908; 18(5): 459-82.
Mark G, Smith AP. Effects of occupational stress, job characteristics, coping, and attributional style on the mental health and job satisfaction of university employees. Anxiety Stress Coping 2012; 25(1): 63-78. [http://dx.doi.org/10.1080/10615806.2010.548088] [PMID: 21271408]
Cunha JPS. pHealth and wearable technologies: A permanent challenge. In: Blobel B, Pharow P, Sousa F, editors. pHealth 2012- Proceedings of the 9th Conference on Wearable Micro and Nano Technologies for Personalized Health 177. Porto, Portugal: IOS Press; 2012. p. 185-95.
Cunha JPS, Cunha B, Pereira AS, Xavier W, Ferreira N, Meireles L. VitalJacket: A wearable wireless vital signs monitor for patients’ mobility in cardiology and sports. 4th. Int Conf Pervasive Comput Technol Healthc 2010; 2010: 22-5.
Schaaff K, Adam MT, Eds. Measuring emotional arousal for online applications: Evaluation of ultra-short term heart rate variability measures. 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction 2013. [http://dx.doi.org/10.1109/ACII.2013.66]
Olver JS, Pinney M, Maruff P, Norman TR. Impairments of spatial working memory and attention following acute psychosocial stress. Stress Health 2015; 31(2): 115-23. [http://dx.doi.org/10.1002/smi.2533] [PMID: 24395182]
Taelman J, Vandeput S, Spaepen A, Van Huffel S. Influence of mental stress on heart rate and heart rate variability 4th European conference of the international federation for medical and biological engineering Springer; 2009.2009.
Trimmel M. Relationship of Heart Rate Variability (HRV) parameters including pNNxx with the subjective experience of stress, depression, well-being, and every-day trait moods (TRIM-T): A pilot study. Ergonomics Open J 2015; 8(1) [http://dx.doi.org/10.2174/1875934301508010032]
Kaur S, Bhalla P, Bajaj S, Sanyal S, Babbar R. Effect of physical and mental stress on heart rate variability in type-A and type-B personalities. Indian Journal of Applied Basic Medical Sciences 2013; 15(20): 59-70.
Rodrigues S, Paiva JS, Dias D, Aleixo M, Filipe RM, Cunha JPS. Cognitive impact and psychophysiological effects of stress using a biomonitoring platform. Int J Environ Res Public Health 2018; 15(6): E1080. [http://dx.doi.org/10.3390/ijerph15061080] [PMID: 29861450]