The Open Medical Informatics Journal




(Discontinued)

ISSN: 1874-4311 ― Volume 13, 2019
RESEARCH ARTICLE

Nurse Competence on Physiologic Monitors Use: Toward Eliminating Alarm Fatigue in Intensive Care Units



Azizeh K. Sowan*, a, b, Ana G. Verab, Elma I. Fonsecab, Charles C. Reedb, Albert F. Tarrielab, Andrea E. Berndta
a School of Nursing, University of Texas Health, San Antonio, 7703 Floyd Curl Dr. - MC 7975, TX 78229, USA
b University Health System, 4502 Medical Drive, San Antonio, Texas 78229, USA

Abstract

Background:

Studies on nurse competence on alarm management are a few and tend to be focused on limited skills. In response to Phase II of implementing the National Patient Safety Goal on clinical alarm systems safety, this study assessed nurses’ perceived competence on physiologic monitors use in intensive care units (ICUs) and developed and validated a tool for this purpose.

Methods:

This descriptive study took place in a Magnet hospital in a Southwestern state of the U.S. A Nurse Competence on Philips Physiologic Monitors Use Survey was created and went through validation by 13 expert ICU nurses. The survey included 5 subscales with 59 rated items and two open-ended questions. Items on the first 4 subscales reflect most common tasks nurses perform using physiologic monitors. Items on the fifth subscale (advanced functions) reflect rarely used skills and were included to understand the scope of utilizing advanced physiologic monitors’ features. Thirty nurses from 4 adult ICUs were invited to respond to the survey.

Results:

Thirty nurses (100%) responded to the survey. The majority of nurses were from Neuro (47%) and Surgical Trauma (37%) ICUs. The data supported the high reliability and construct validity of the survey. At least one (3%) to 8 nurses (27%) reported lack of confidence on each item on the survey. On the first four subscales, 3% - 40% of the nurses reported they had never heard of or used 27 features/functions on the monitors. No relationships were found between subscales’ scores and demographic characteristics (p > .05). Nurses asked for training on navigating the central-station monitor and troubleshooting alarms, and the use of unit-specific super users to tailor training to users’ needs.

Conclusion:

This is the first study to create and test a list of competencies for physiologic monitors use. Rigorous, periodic and individualized training is essential for safe and appropriate use of physiologic monitors and to decrease alarm fatigue. Training should be comprehensive to include all necessary skills and should not assume proficiency on basic skills. Special attention should be focused on managing technical alarms. Increasing the number of super users is a recommended strategy for individualized and unit-specific training. There is a need for a usability testing of complex IT-equipped medical devices, such as physiologic monitors, for effective, efficient and safe navigation of the monitors.

Keywords: Nurse competence, Physiologic monitors, Alarm fatigue, Intensive care units, ICUs, Survey.


Article Information


Identifiers and Pagination:

Year: 2017
Volume: 11
First Page: 1
Last Page: 11
Publisher Id: TOMINFOJ-11-1
DOI: 10.2174/1874431101711010001

Article History:

Received Date: 07/10/2016
Revision Received Date: 31/12/2016
Acceptance Date: 25/01/2017
Electronic publication date: 14/04/2017
Collection year: 2017

© 2017 Azizeh Khaled Sowan

open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: https://creativecommons.org/licenses/by/4.0/legalcode. This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.


* Address correspondence to this author at the School of Nursing, University of Texas Health, San Antonio, 7703 Floyd Curl Dr. - MC 7975, TX 78229, USA; Tel: 2105675799; Fax: 210-5671719; E-mails: sowan@uthscsa.edu, azizehsowan@yahoo.com





INTRODUCTION

Clinical alarm systems safety has received immense attention from clinicians, patient safety organizations, and policy makers [1The Joint Commission. The Joint Commission announces 2014 National Patient Safety Goal. Available from: http://www.jointcommission. org/assets/1/18/jcp0713_announce_new_nspg.pdf Accessed April 1, 2016.-5FDA Patient Safety News. FDA Patient Safety News: Show #106. Silver Spring, MD: US Food and Drug Administration; 2011 Jan. Alarming monitor problems. Available from: http://www.fda.gov/ downloads/Safety/FDAPatientSafetyNews/UCM417915.pdf 2011. Accessed May 10, 2016.], especially after the U.S. Food and Drug Administration’s (FDA) report indicated 566 alarm- related patient deaths [5FDA Patient Safety News. FDA Patient Safety News: Show #106. Silver Spring, MD: US Food and Drug Administration; 2011 Jan. Alarming monitor problems. Available from: http://www.fda.gov/ downloads/Safety/FDAPatientSafetyNews/UCM417915.pdf 2011. Accessed May 10, 2016.]. The Joint Commission (TJC) in the U.S. attributed the majority of alarm-related deaths to alarm fatigue and subsequently issued a National Patient Safety Goal (NPSG) on clinical alarm systems safety [1The Joint Commission. The Joint Commission announces 2014 National Patient Safety Goal. Available from: http://www.jointcommission. org/assets/1/18/jcp0713_announce_new_nspg.pdf Accessed April 1, 2016.]. TJC required healthcare organizations to implement the NPSG in two phases: Phase 1, beginning January 2014, was to identify high priority alarms, and Phase II, beginning January 2016, was to implement policies and procedures for alarm safety and to educate clinicians on alarm management [1The Joint Commission. The Joint Commission announces 2014 National Patient Safety Goal. Available from: http://www.jointcommission. org/assets/1/18/jcp0713_announce_new_nspg.pdf Accessed April 1, 2016.]. In response to Phase II, this study assessed nurses’ perceived competence on physiologic monitors use in intensive care units (ICUs).

The FDA reported that physiologic monitors (also referred to as bedside or patient monitors), often used by nurses, were most commonly involved in alarm related-deaths [5FDA Patient Safety News. FDA Patient Safety News: Show #106. Silver Spring, MD: US Food and Drug Administration; 2011 Jan. Alarming monitor problems. Available from: http://www.fda.gov/ downloads/Safety/FDAPatientSafetyNews/UCM417915.pdf 2011. Accessed May 10, 2016.]. The majority of studies on alarm systems safety verify the high rate of alarms produced by physiologic monitors, specifically in ICUs [6Görges M, Markewitz BA, Westenskow DR. Improving alarm performance in the medical intensive care unit using delays and clinical context. Anesth Analg 2009; 108(5): 1546-52.
[http://dx.doi.org/10.1213/ane.0b013e31819bdfbb] [PMID: 19372334]
-14Cho OM, Kim H, Lee YW, Cho I. Clinical alarms in intensive care units: Perceived obstacles of alarm management and alarm fatigue in nurses. Healthc Inform Res 2016; 22(1): 46-53.
[http://dx.doi.org/10.4258/hir.2016.22.1.46] [PMID: 26893950]
]. In fact, this rate reached 350 alarms per patient per day [3Association for the Advancement of Medical Instrumentation. A siren call for action: Priority issues from the Medical Device Alarms Summit Available from: http://www.aami.org/htsi/alarms/ pdfs/2011_Alarms_Summit_publication.pdf 2011. Accessed March 10, 2016.]. This high alarm rate can create alarm fatigue. Alarm fatigue occurs when clinicians ignore alarms from physiologic devices due to an excessive number of non-actionable or false positive alarms. Alarm fatigue can lead to unsafe workarounds, such as inappropriate disabling of alarms or unsafe adjustments to alarm limits, and was ranked by the ECRI Institute as one of the top 10 Technology Hazards [4ECRI. ECRI Institute Top 10 Health Technology Hazards Report for 2014. Available from: http://www.visimobile.com/ wp-content/ uploads/2013/12/6C-5-Top-10-Health-Tech-Hazards-2014-%E2%80%93-ECRI.pdf 2014. Accessed May 10, 2016.].

Alarm systems safety is complex. Beyond the mere high rate of non-actionable alarms, safety can be compromised as alarms often look and sound alike [9Sowan AK, Tarriela AF, Gomez TM, Reed CC, Rapp KM. Nurses perceptions and practices toward clinical alarms in a transplant cardiac intensive care unit: Exploring key issues leading to alarm fatigue. JMIR Hum Factors 2015; 2(1): e3.
[http://dx.doi.org/10.2196/humanfactors.4196] [PMID: 27025940]
, 10Sowan AK, Gomez TM, Tarriela AF, Reed CC, Paper BM. Changes in default alarm settings and standard in-service are insufficient to improve alarm fatigue in an intensive care unit: A pilot project. JMIR Hum Factors 2016; 3(1): e1.
[http://dx.doi.org/10.2196/humanfactors.5098] [PMID: 27036170]
]. These similarities can decrease clinicians’ sensitivity to alarm urgency and affect clinicians’ responses to alarms. Moreover, such challenges raise questions about the usability of medical devices [9Sowan AK, Tarriela AF, Gomez TM, Reed CC, Rapp KM. Nurses perceptions and practices toward clinical alarms in a transplant cardiac intensive care unit: Exploring key issues leading to alarm fatigue. JMIR Hum Factors 2015; 2(1): e3.
[http://dx.doi.org/10.2196/humanfactors.4196] [PMID: 27025940]
, 10Sowan AK, Gomez TM, Tarriela AF, Reed CC, Paper BM. Changes in default alarm settings and standard in-service are insufficient to improve alarm fatigue in an intensive care unit: A pilot project. JMIR Hum Factors 2016; 3(1): e1.
[http://dx.doi.org/10.2196/humanfactors.5098] [PMID: 27036170]
]. Recent studies in ICUs show that alarm safety is affected by multifactors such as unit layout, lack of policies and procedures on alarm management, poor usability of physiologic monitors, lack of standardized practices on alarm reduction strategies, and most important to the current topic, lack of nurse competence on physiologic monitors use [9Sowan AK, Tarriela AF, Gomez TM, Reed CC, Rapp KM. Nurses perceptions and practices toward clinical alarms in a transplant cardiac intensive care unit: Exploring key issues leading to alarm fatigue. JMIR Hum Factors 2015; 2(1): e3.
[http://dx.doi.org/10.2196/humanfactors.4196] [PMID: 27025940]
-13Sendelbach S, Wahl S, Anthony A, Shotts P. Stop the noise: A quality improvement project to decrease electrocardiographic nuisance alarms. Crit Care Nurse 2015; 35(4): 15-22.
[http://dx.doi.org/10.4037/ccn2015858] [PMID: 26232798]
]. The need for system-based management strategies to improve alarm safety is well documented, especially in ICUs in which multiple monitoring devices are in constant use [1The Joint Commission. The Joint Commission announces 2014 National Patient Safety Goal. Available from: http://www.jointcommission. org/assets/1/18/jcp0713_announce_new_nspg.pdf Accessed April 1, 2016.-4ECRI. ECRI Institute Top 10 Health Technology Hazards Report for 2014. Available from: http://www.visimobile.com/ wp-content/ uploads/2013/12/6C-5-Top-10-Health-Tech-Hazards-2014-%E2%80%93-ECRI.pdf 2014. Accessed May 10, 2016., 9Sowan AK, Tarriela AF, Gomez TM, Reed CC, Rapp KM. Nurses perceptions and practices toward clinical alarms in a transplant cardiac intensive care unit: Exploring key issues leading to alarm fatigue. JMIR Hum Factors 2015; 2(1): e3.
[http://dx.doi.org/10.2196/humanfactors.4196] [PMID: 27025940]
-13Sendelbach S, Wahl S, Anthony A, Shotts P. Stop the noise: A quality improvement project to decrease electrocardiographic nuisance alarms. Crit Care Nurse 2015; 35(4): 15-22.
[http://dx.doi.org/10.4037/ccn2015858] [PMID: 26232798]
]. On the other hand, although some system-based alarm management strategies achieved success in alarm reduction [14Cho OM, Kim H, Lee YW, Cho I. Clinical alarms in intensive care units: Perceived obstacles of alarm management and alarm fatigue in nurses. Healthc Inform Res 2016; 22(1): 46-53.
[http://dx.doi.org/10.4258/hir.2016.22.1.46] [PMID: 26893950]
, 15Cvach MM, Biggs M, Rothwell KJ, Charles-Hudson C. Daily electrode change and effect on cardiac monitor alarms: An evidence-based practice approach. J Nurs Care Qual 2013; 28(3): 265-71.
[http://dx.doi.org/10.1097/NCQ.0b013e31827993bc] [PMID: 23187092]
], in other studies this success was not complemented with improvements in alarm fatigue or nurses’ attitudes toward alarm safety [9Sowan AK, Tarriela AF, Gomez TM, Reed CC, Rapp KM. Nurses perceptions and practices toward clinical alarms in a transplant cardiac intensive care unit: Exploring key issues leading to alarm fatigue. JMIR Hum Factors 2015; 2(1): e3.
[http://dx.doi.org/10.2196/humanfactors.4196] [PMID: 27025940]
, 10Sowan AK, Gomez TM, Tarriela AF, Reed CC, Paper BM. Changes in default alarm settings and standard in-service are insufficient to improve alarm fatigue in an intensive care unit: A pilot project. JMIR Hum Factors 2016; 3(1): e1.
[http://dx.doi.org/10.2196/humanfactors.5098] [PMID: 27036170]
]. Nurses reported the need for more training on physiologic monitors [9Sowan AK, Tarriela AF, Gomez TM, Reed CC, Rapp KM. Nurses perceptions and practices toward clinical alarms in a transplant cardiac intensive care unit: Exploring key issues leading to alarm fatigue. JMIR Hum Factors 2015; 2(1): e3.
[http://dx.doi.org/10.2196/humanfactors.4196] [PMID: 27025940]
, 10Sowan AK, Gomez TM, Tarriela AF, Reed CC, Paper BM. Changes in default alarm settings and standard in-service are insufficient to improve alarm fatigue in an intensive care unit: A pilot project. JMIR Hum Factors 2016; 3(1): e1.
[http://dx.doi.org/10.2196/humanfactors.5098] [PMID: 27036170]
]. It seems that the complexity of modern IT-equipped physiologic monitors requires structured individualized training focused on developing specific skill sets to navigate monitors and manage alarms [11Sowan AK, Reed C, Tarriela AF, Gomez TM. Flaws in clinical alarm safety studies: The value of mixed methods and objective alarm data. Crit Care Med 2015; 43(12): 206.
[http://dx.doi.org/10.1097/01.ccm.0000474648.68026.66]
, 12Gomez T, Sowan AK, Tarriela A, Reed C, Stepanik K. Reducing non-actionable alarms of cardiac monitors as a strategy to improve alarm safety in a transplant/cardiac ICU. Crit Care Nurse 2015; 35(2): e72-3.].

Studies on nurse training on alarm management are a few and tend to be focused on limited skills related to frequency and best practice in electrodes change and customizing parameters to be patient-specific [14Cho OM, Kim H, Lee YW, Cho I. Clinical alarms in intensive care units: Perceived obstacles of alarm management and alarm fatigue in nurses. Healthc Inform Res 2016; 22(1): 46-53.
[http://dx.doi.org/10.4258/hir.2016.22.1.46] [PMID: 26893950]
, 15Cvach MM, Biggs M, Rothwell KJ, Charles-Hudson C. Daily electrode change and effect on cardiac monitor alarms: An evidence-based practice approach. J Nurs Care Qual 2013; 28(3): 265-71.
[http://dx.doi.org/10.1097/NCQ.0b013e31827993bc] [PMID: 23187092]
]. None of the previous studies outlined nurse competence on physiologic monitors use. To guide our initiatives and achieve Phase II of TJC’s clinical alarm systems safety NPSG, we created and validated a structured list of required alarm management skills and surveyed ICU nurses on their competence level on using physiologic monitors.

MATERIALS & METHODS

Design, Setting, and Sample

After obtaining approval of the Institute Review Board, this descriptive study took place in a Magnet hospital in a Southwestern state of the U.S. Nurses from 4 adult ICUs were invited to respond to a Nurse Competence on Physiologic Monitors Use Survey and were informed that the target sample size was 30 nurses because of budget constraints. Recruitment stopped after reaching a convenience sample of 30 nurses. ICUs were Medical (68 nurses), Transplant/Cardiac (49 nurses), Surgical Trauma (70 nurses), and Neuro ICU (43 nurses). New Philips physiologic monitors were deployed in all ICUs in April 2014. These included Philips IntelliVue MX800 bedside monitor, Philips IntelliVue Information Center iX central-station monitor, and Philips IntelliVue X2 transport monitor. Nurses received a structured group training of two hours demonstration on monitors use delivered by the company representative. If needed, individualized training was provided by their preceptors or unit educators.

Instrument Development

The survey used in this study assessed level of perceived competence in using Philips physiologic monitors and consisted of 5 subscales with a total of 59 items. The subscales are admit, discharge, and transfer patient (5 items), hardware and connectivity (6 items), alarm management (19 items), appropriate monitoring (24 items), and advanced/specialized functions (5 items). Items on the first 4 subscales reflect most common tasks nurses from all adult ICUs perform using the monitors. Items on advanced/specialized functions subscale reflect rarely, if any, used skills and were included to understand the scope of utilizing advanced physiologic monitors’ functions/features. The survey was designed by the PI of the study, was guided by the user manuals of Philips cardiac monitors [16Philips, IntelliVue Information Center iX: Instructions for use Release A 01. 1st ed. Andover, MA: Philips Medical Systems 2012., 17Philips. Instruction for Use IntelliVue Patient Monitor MX600/MX700/MX800: Release J with software revision: Patient Monitoring 2012. Andover, MA: Philips Medical Systems.], and was administered via SurveyMonkey. Manuals of cardiac monitors from other vendors (i.e., General Electric) were also reviewed to increase the generalizability of the survey [18Healthcare GE, Monitor CA. GE Healthcare, CARESCAPETM Monitor B850- Technical Manual Software Version 1. Available from: http://www.frankshospitalworkshop.com/equipment/documents/ecg/service_manuals/GEC/arescapeB850V1Monitor-Technicalmanual.pdf 2011. Accessed May 2, 2016.].

Instrument Validation

The original survey included 63 items and went through validation by 13 expert ICU nurses, 3 from Medical ICU, 3 from Surgical Trauma ICU, 3 from Transplant/Cardiac ICU, and 4 from Neuro ICU. Nurse evaluators validated the appropriateness and relevancy of items and the fitness of items to the assigned subscales. Nurse evaluators were unit educators, with at least 5 years of ICU experience, super users of physiologic monitors, and members of the hospital-wide alarm systems safety taskforce.

Item relevancy and appropriateness were assessed using the following scale: (1) A commonly used skill and all nurses need to know about it, (2) A rarely used skill but nurses need to know how to do it, (3) A rarely used skill and nurses do NOT need to know about it or how to do it, and (4) Never heard of this function/feature. Items were considered relevant and included in the final survey if two conditions were met: (1) the item was rated as commonly used and needed or rarely used but needed by at least 75% of the evaluators and (2) the item was rated as rarely used and NOT needed by only one nurse evaluator. The latter condition was used to achieve a high agreement score (92%) on items that should be excluded from the competency list, therefore to focus attention on required skills. The latter condition excluded items under advanced/specialized functions subscale, as we anticipated that skills under this particular subscale were not commonly used or required for daily monitoring. Nevertheless, we wanted to gain more insight about bedside nurse use of and confidence in specialized features. Items under this subscale were mostly rated as not needed (by at least 2 nurse evaluators) or never heard of this feature (by at least 2 nurse evaluators). Only 5 nurse evaluators (38%) scored items under advanced/specialized functions subscale as commonly or rarely used but needed. All other items on the survey except four met the appropriateness and relevancy conditions and were included in the final survey. Excluded items were “Set date and time”, “Understand the meaning of the eleven types of arrhythmia beat labels”, “Adjust screen brightness”, and “Select the appropriate detection mode (e.g., auto vs. manual respiration detection mode)”. Thus, after deleting these four items, the final survey had a total of 59 items. After validating item relevancy and appropriateness, the agreement between the 13 evaluators on the fitness of the 59 items to the 5 subscales was 100%.

The final survey included 3 sections. Section 1 collected information about demographic characteristics such as work unit, gender, age, work status, years of overall nursing experience, years of experience in the current unit, years of overall ICU experience, perceived level of computer expertise, whether nurses received training on physiologic monitors within the last 2 months, and whether they were super users for training on physiologic monitors.

Section 2 consisted of 59 scaled-items, scored on a 5-point Likert type scale, ranging from “1” for very unconfident to “5” for very confident, with an additional response option scored as “0” for never used or heard of this function/feature. In this section, nurses rated their skills when using bedside, central-station, and/or transport physiologic monitors. Items reflected knowledge, skills, and clinical reasoning/judgment in monitor use.

Section 3 included two open-ended items for nurses to (1) list other skills they think are relevant and essential for future in-service training, and (2) to indicate other tasks they frequently perform while using the physiologic monitors.

Data Analyses

Means and proportions were used to describe nurse characteristics and their level of confidence at the item and subscale levels. Correlations between subscales and demographic variables and among subscales themselves were tested using Pearson’s r and χ2 analyses. Psychometric properties of the survey of internal consistency reliability and construct validity were assessed as part of the study.

RESULTS

Demographics

Thirty nurses responded to the survey assessing their level of perceived confidence in using Philips physiologic monitors. As seen in Table 1, the majority of nurses were from Neuro (47%) and Surgical Trauma (37%) ICUs, female (83%), working full-time (60%), worked in their current unit for less than three years (63%), and had worked as a nurse for three or more years (57%). Most of the nurses indicated they had not received training on physiologic monitors within the last two months (83%), were not super users on physiologic monitors (83%), and rated their level of computer expertise as moderate or above moderate (97%).

Table 1
Demographic characteristics of nurse respondents (N= 30).


Perceived Level of Confidence

Items from the Nurse Competence on Physiologic Monitors Use Survey were evaluated based on 5 subscales. Table 2 presents the number of items in each subscale, subscale ranges, means, and standard deviations, and Cronbach's Alpha internal consistency coefficients. Nurses’ level of confidence was highest in the domain of appropriate monitoring (77th percentile), somewhat lower in the domains of admit, transfer, and discharge patients (74th percentile) and alarm management (73rd percentile), then by hardware and connectivity (70th percentile), and lowest in the domain of advanced functions (39th percentile).

Table 2
Survey subscales, number of subscale items, and reliability coefficients.


Preliminary evaluation of reliability was adequate in all subscales (i.e., Cronbach’s alpha ranging from 0.71 to 0.91). To examine the strength of relationships across the five survey subscales, Pearson’s correlation coefficients were generated. Interpretation of findings indicated all subscales were significantly and positively related to one another (r ranging from 0.59 to 0.84, P > .0001), providing support for the construct validity of the survey.

When examined for missing responses, 5 of the 59 items (8.5%) had one or two missing responses. Items were categorized into 4 main categories based on mean scores. A mean of 0 score indicates “Never used/heard of this function”. Items with mean scores from 1.00 - 2.99 indicate nurses were “Not confident”. Items with mean scores from 3.00 to 3.99 were categorized as “Neutral”. Items with mean scores from 4.00 to 5.00 indicate nurses were “Confident”.

Table 3
Percent of nurse responses to competence on physiologic monitors use items organized by subscales and confidence level (N=30).


As seen in Table 3, the range of reported confidence on the subscales’ items was 33% - 87% of the nurses on admit, discharge and transfer patient subscale, 17% - 83% on hardware and connectivity, 17% - 93% on alarm management, 33% - 97% on appropriate monitoring, and 3% to 50% on advanced/specialized functions. At least one (3%) to 8 nurses (27%) reported lack of confidence on each item on the survey. Of the nurses, 20% to 27% reported lack of confidence on the following items: transfer patient from central and bedside monitors (23%, Item 3), edit patient information after admission (23%, Item 4), resolve patient information mismatch (23%, Item 5), report device malfunctions to service personnel (20%, Item 8), customize default settings to patient specific (20%, Item 24), troubleshoot common technical alarm messages (23%, Item 25), eliminate redundant alarms when changing default settings (27%, Item 26), know when to contact service personnel to correct technical alarms (23%, Item 28), extend alarm pause time (23%, Item 29), adjust speed of waves (20%, Item 45), freeze and unfreeze waves (20%, Item 47), recognize when specific monitoring is needed (20%, Item 48), differentiate/print patient reports (23%, Item 53), and disable/re-enable monitor touchscreen operation (23%, Item 54). On the first four subscales, 3% - 40% of the nurses reported they had never heard of or used 27 features/functions on the monitors and 20% to 63% reported they had never heard of or used all features on the advanced/specialized functions subscale.

A series of comparison tests of χ2 were performed to examine if subscales’ scores differed as a function of demographic characteristics (i.e., age, ICU type, work status, years of experience as a nurse, years in current unit, and years in ICU). No differences were noted across analyses (p > .05).

Narrative Data

A total of 6 nurses (20%) listed other skills they felt were relevant and essential for future in-service training. These skills were understanding how bedside monitors transmit data to the main terminal (central-station monitor) and the limitations exist between the two monitors (Neuro and Transplant ICU nurses), navigating and function review of the central-station monitor (Neuro ICU nurse), and optimizing the use of the monitors and troubleshooting when the bedside monitor does not recognize the X2 transport monitor (Surgical Trauma ICU nurse). A Neuro ICU nurse mentioned that each ICU is specific in their use of the monitors and that having unit-specific super users would be helpful in tailoring training to user needs. A Surgical Trauma ICU nurse noted the need to enlarge the tele-monitoring window in the bedside monitor due to its small size. This issue arises when a nurse is simultaneously tele-monitoring a patient from the bedside monitor of another patient. In such cases, the tele-monitored patient data is displayed in a subscreen that occupies approximately 25% of the total monitor screen.

A total of 5 nurses listed other tasks they perform frequently when using the monitors. Most tasks were related to monitoring unit-specific parameters, such as pulmonary artery wedge pressure measurements, cardiac output thermodilution measurements, pulmonary artery pressure continuous readings (Transplant ICU nurses), central venous pressure, corrected QT interval, and monitoring intracranial pressure (ICP) using two ICP lines at the same time (Neuro ICU nurses).

DISCUSSION

In this study, we created and validated a set of competencies and surveyed bedside ICU nurses on their knowledge and perceived confidence in using physiologic monitors. Our initial intent was to gain information that would guide future in-service training on physiologic monitors use. Ultimately, we hope to develop a standardized self-assessment checklist that adult ICU nurses can use to evaluate and enhance alarm systems management and safety practices.

Excluding the 5 items under advanced/specialized functions subscale, 1 to 7 nurses (3% - 23%) reported a lack of skills or knowledge to perform one or more of the remaining 54 functions/features of the physiologic monitors. All of these items were rated as needed by the expert nurses who validated the survey, of particular interest, at least one fifth of the nurses reported a lack of confidence in 17 essential functions. Some of these functions were related to alarm management and appropriate monitoring, such as extending alarm pause time. Additionally, 9 (30%) nurses reported not using or had never heard of this particular function, indicating the need for future in-service. Extending alarm pause time is an important alarm management strategy to decrease the number of false alarms and alarm fatigue, especially for care procedures that last longer than 1 minute, which is the default setting of alarm pause in our system that can be extended to 5 or 10 minutes. On the other hand, some institutions may discourage extending the pause period for safety purposes.

There was also a reported lack of confidence in customizing default settings to be patient specific, recognizing when specific monitoring is needed for specific medical cases, and in eliminating redundant alarms when changing default settings. These skills are essential for safe monitoring and to decrease alarm fatigue and the overall number of alarms.

Our data also support the need to improve nurses’ skills on troubleshooting technical alarm messages and monitoring problems, when to contact service personnel and how to report device malfunctions. More than 20% of the nurses reported lack of confidence in these skills and up to 3 (10%) reported they had never used or heard of these functions. The narrative data also indicated the need for future in-service training on these skills. The absence of a standardized reporting system for device malfunctions is likely to contribute to this problem.

There are many types of Technical alarms. Examples of such alarms include “Empty Battery”, an alarm triggered because the remaining charge/power in the battery to operate the device is down to 10 minutes. This alarm cannot be paused or silenced and should be acknowledged by replacing the battery or connecting the device to the charger. To troubleshoot this particular alarm, nurses need to know how to identify the battery's power status of the X2 monitor from the display color, which is one of the front panel color indicators or LEDs (Item 11). Up to 11 (37%) nurses reported they had never heard of these functions. Other technical alarms include “ECG Leads Off”, which is triggered when leads are displaced or not all required leads are attached, and “Check Patient ID”, an alarm triggered when there is a mismatch in patient data between two monitoring devices connected to the patient. Nurses’ lack of competence in troubleshooting “Check Patient ID” technical alarm may explain nurses’ limited confidence in editing patient information after admission as well as resolving patient information mismatch (Items 4 and 5).

Troubleshooting monitoring problems is essential for alarm management. Most of the research on alarm management focuses attention on physiologic alarms [6Görges M, Markewitz BA, Westenskow DR. Improving alarm performance in the medical intensive care unit using delays and clinical context. Anesth Analg 2009; 108(5): 1546-52.
[http://dx.doi.org/10.1213/ane.0b013e31819bdfbb] [PMID: 19372334]
-8Drew BJ, Harris P, Zègre-Hemsey JK, et al. Insights into the problem of alarm fatigue with physiologic monitor devices: A comprehensive observational study of consecutive intensive care unit patients. PLoS One 2014; 9(10): e110274.
[http://dx.doi.org/10.1371/journal.pone.0110274] [PMID: 25338067]
]. Little information is available on the rate of technical alarms, which also contribute to alarm fatigue [19Bonafide CP, Lin R, Zander M, et al. Association between exposure to nonactionable physiologic monitor alarms and response time in a childrens hospital. J Hosp Med 2015; 10(6): 345-51.
[http://dx.doi.org/10.1002/jhm.2331] [PMID: 25873486]
]. In a previous study [10Sowan AK, Gomez TM, Tarriela AF, Reed CC, Paper BM. Changes in default alarm settings and standard in-service are insufficient to improve alarm fatigue in an intensive care unit: A pilot project. JMIR Hum Factors 2016; 3(1): e1.
[http://dx.doi.org/10.2196/humanfactors.5098] [PMID: 27036170]
], Sowan and colleagues analyzed data logged from physiologic monitors in a Transplant Cardiac ICU for a 10-week period and found a total of 9224 technical alarms (unpublished results, personal communication with the authors), equivalent to a rate of 12.6 alarm/patient day, with the most common being ECG Leads Off (a total of 5552 alarms).

Lack of confidence in different skills may be related to lack of use (or rarely used functions), lack of training on physiologic monitors, and/or lack of usability of physiologic monitors. However, skills such as admit and discharge a patient, connect monitor cables, place electrodes, identify major hardware components, pause and silence alarms, know parameters’ display and the meaning of waves, view active alarm messages and differentiate priority, change alarm limits safely, easily and appropriately, and many other skills are all commonly used in any adult ICUs on daily basis and essential for safe and appropriate monitoring. Having nurses reported lack of confidence in these fundamental skills strongly supports the need for training and examining the usability of physiologic monitors. Our results suggest poor usability of some features of the monitors. For example, 4 to 5 (13% - 17%) nurses reported lack of confidence in navigating different monitors' screens easily and efficiently (Items 43 and 52). Other nurses reported they had never heard of or used these functions. Furthermore the lack of confidence of the nurses in identifying the difference between latching and non-latching alarms and the high reported percentage (40%) on never heard of this function can be related to the look-alike and sound-alike alarms [10Sowan AK, Gomez TM, Tarriela AF, Reed CC, Paper BM. Changes in default alarm settings and standard in-service are insufficient to improve alarm fatigue in an intensive care unit: A pilot project. JMIR Hum Factors 2016; 3(1): e1.
[http://dx.doi.org/10.2196/humanfactors.5098] [PMID: 27036170]
], another usability-related issue. Since ease-of-use is a fundamental usability attribute, these findings, and similar to previous findings [9Sowan AK, Tarriela AF, Gomez TM, Reed CC, Rapp KM. Nurses perceptions and practices toward clinical alarms in a transplant cardiac intensive care unit: Exploring key issues leading to alarm fatigue. JMIR Hum Factors 2015; 2(1): e3.
[http://dx.doi.org/10.2196/humanfactors.4196] [PMID: 27025940]
, 10Sowan AK, Gomez TM, Tarriela AF, Reed CC, Paper BM. Changes in default alarm settings and standard in-service are insufficient to improve alarm fatigue in an intensive care unit: A pilot project. JMIR Hum Factors 2016; 3(1): e1.
[http://dx.doi.org/10.2196/humanfactors.5098] [PMID: 27036170]
, 20Sowan AK, Reed CC, Staggers N. Role of large clinical datasets from physiologic monitors in improving the safety of clinical alarm systems and methodological considerations: A case from Philips monitors. JMIR Hum Factors 2016; 3(2): e24.
[http://dx.doi.org/10.2196/humanfactors.6427] [PMID: 27694097]
], further support the need to examine the usability of physiologic monitors.

In the narrative data, nurses asked to focus the in-service on functions review and appropriate navigation of the central-station monitor. They also wanted to understand the data transmission process from the bedside to the central monitor, and the limitations of the two monitors. Although many of the functions/skills included in the survey are applicable to bedside, central-station and transport monitors, the processes of completing tasks and screen navigation differ based on the monitor in use. For example, the steps to admit a patient are different when using the central-station versus the bedside monitor, requiring nurses to master multiple skill sets. Additionally, some skills are limited to specific monitors, such as clearing sectors, unit management of log alarm data, and locating equipment, which are limited to the central-station monitor. Our survey did not focus on the specific skills limited to the central-station monitor.

Although skills on the survey were applicable to all adult ICUs and some items were written in general terms such as “know different types of parameters display”, patients’ medical conditions require knowledge of case-specific parameters. Therefore, the suggestion to have unit-specific super users is vital. For example, Neuro ICU nurses reported a concurrent monitoring of 2 ICP readings, a parameter that may not be frequently monitored in other ICUs. Monitoring 2 ICP measurements requires nurses to pick an alternative waveform for the second ICP measurement. In this case, it is important to know the capabilities of the physiologic monitor in terms of the maximum number of waveforms that can be displayed. Our bedside monitors allow simultaneous display of 8 waveforms. So, for example, if nurses are monitoring the waves of Lead 1, Lead 2, Pulse, NBP (noninvasive blood pressure), CVP (central venous pressure), ABP (arterial blood pressure), Respiration, and one ICP, they need to eliminate one of these measurements to monitor a second ICP waveform. Nurses usually sacrifice the Respiration waveform. The nurse decision on the parameter to sacrifice should be carefully made based on the client condition and the possibilities for risking safety. This issue, for example, can be one of the critical unit-specific training aspects.

In regard to advanced functions, more than one third of the nurses were either not aware or not using the following features: sepsis protocol/guidelines, manual entry of data into the monitor, and drug calculator. Not using sepsis protocol can be related to the fact that a sepsis protocol is embedded into the electronic medical record (EMR), reducing the need for such feature within the physiologic monitors. On the other hand, this feature can be useful for hospitals with no e-protocol for sepsis and when complete interoperability exists between the EMR and physiologic monitors. Similarly, manual entry of lab data into the monitor may not be usable, specifically when there is no algorithm to connect lab data and the monitored parameters to help in clinical decision-making. Likewise, the use of drug calculator within the monitor can be inconvenient for nurses, given the availability and ease of access to pocket calculators, cell phones, and/or drug calculation apps. When hospitals select their physiologic monitors and medical devices, a thorough discussion with the vendor is recommended to ensure optimal use of advanced features of their products. Unfortunately, little research is available about the use of such features within the physiologic monitors.

Our survey includes skills required by all bedside ICU nurses based on our institution’s policies and procedures of safe monitoring. In other hospitals, some of these skills may be performed by nurse practitioners, super users, certified critical care nurses, or physicians. Therefore, adhering to unit policies and procedures is important when surveying nurses about their competence on physiologic monitors use. Additionally, a system for periodic assessment, training, and documentation of nurse competence on physiologic monitors use should be in place for safe monitoring.

In previous projects on alarm systems safety, assembling a multidisciplinary alarm management team, changing alarm default settings, having a unit policy on frequency of electrodes’ replacement, and providing standardized in-service nursing training on physiologic monitors use were insufficient to reduce alarm fatigue, despite a significant reduction of 25% in alarm rate [10Sowan AK, Gomez TM, Tarriela AF, Reed CC, Paper BM. Changes in default alarm settings and standard in-service are insufficient to improve alarm fatigue in an intensive care unit: A pilot project. JMIR Hum Factors 2016; 3(1): e1.
[http://dx.doi.org/10.2196/humanfactors.5098] [PMID: 27036170]
]. Lack of competence on physiologic monitor use is a root cause of alarm fatigue [9Sowan AK, Tarriela AF, Gomez TM, Reed CC, Rapp KM. Nurses perceptions and practices toward clinical alarms in a transplant cardiac intensive care unit: Exploring key issues leading to alarm fatigue. JMIR Hum Factors 2015; 2(1): e3.
[http://dx.doi.org/10.2196/humanfactors.4196] [PMID: 27025940]
, 10Sowan AK, Gomez TM, Tarriela AF, Reed CC, Paper BM. Changes in default alarm settings and standard in-service are insufficient to improve alarm fatigue in an intensive care unit: A pilot project. JMIR Hum Factors 2016; 3(1): e1.
[http://dx.doi.org/10.2196/humanfactors.5098] [PMID: 27036170]
]. The educational aspect of this complex problem can be improved by focusing attention on the skills nurses need to effectively, efficiently and safely navigate physiologic monitors. Our competence list includes basic navigation skills for all adult ICUs. Detailing unit-specific skills can expand the list and super users should facilitate the competency process.

The findings of this study should be interpreted in light of the following limitations. Although we had a motivated sample, our sample size was small due to budget constraints. Including a larger sample of nurses would improve our knowledge about the essential skills in physiologic monitors use in adult ICUs and improve the generalizability of the study and survey. Extending the survey to pediatric and neonate ICUs may also be beneficial to understand unit-specific skills in monitoring pediatric and neonate patients. Although our survey was designed based on the features of Philips and General Electric Monitors, many items on the survey are applicable to all physiologic monitoring devices irrespective of the manufacturer. The main difference among physiologic monitors from different vendors can be related to the availability of advanced features (e.g., sepsis protocols). On the other hand, examining the survey against the functions of other monitoring devices may increase its generalizability.

CONCLUSION

This is the first study to create and test a list of competencies for physiologic monitor use. Rigorous, periodic and individualized training is essential for safe and appropriate use of physiologic monitors and to decrease alarm fatigue. Training should be comprehensive to include all necessary skills and should not assume proficiency on basic skills, such as admitting a patient to the monitor. Special attention should be focused on managing technical alarms. Increasing each unit’s number of super users is a recommended strategy for individualized and unit-specific training. There is a need for usability testing of complex IT-equipped medical devices such as physiologic monitors for effective, efficient and safe navigation.

LIST OF ABBREVIATIONS

(FDA)  = Food and Drug Administration
(TJC)  = The Joint Commission
(NPSG)  = National Patient Safety Goal
(ICUs)  = Intensive care units
(ECG)  = Electrocardiogram
(ICP)  = Intra cranial pressure
(NBP)  = Noninvasive blood pressure
(CVP)  = Central venous pressure
(ABP)  = Arterial blood pressure
(EMR)  = Electronic medical record

CONFLICT OF INTREST

The author confirms that this article content has no conflict of interest.

ACKNOWLEDGMENTS

This project was funded by the National Advisory Council for the School of Nursing and the School of Nursing the University of Texas Health at San Antonio. The role of funding sources was limited to providing financial support for the conduct of the research. Sponsors were not involved in study design, collection, analysis or interpretation of data, or writing of manuscript. We are grateful to Raquel V. Hernandez, the Business Operations Manager at the Center for Nursing Excellence where the study was conducted, for the administrative support and designing the survey in the SurveyMonkey.

REFERENCES

[1] The Joint Commission. The Joint Commission announces 2014 National Patient Safety Goal. Available from: http://www.jointcommission. org/assets/1/18/jcp0713_announce_new_nspg.pdf Accessed April 1, 2016.
[2] The Joint Commission. Sentinel event alerts: Medical device alarm safety in hospitals. Available from: http://www.jointcommission.org/ assets/1/18/SEA_50_alarms_4_5_13_FINAL1.PDF Accessed May 1, 2016.
[3] Association for the Advancement of Medical Instrumentation. A siren call for action: Priority issues from the Medical Device Alarms Summit Available from: http://www.aami.org/htsi/alarms/ pdfs/2011_Alarms_Summit_publication.pdf 2011. Accessed March 10, 2016.
[4] ECRI. ECRI Institute Top 10 Health Technology Hazards Report for 2014. Available from: http://www.visimobile.com/ wp-content/ uploads/2013/12/6C-5-Top-10-Health-Tech-Hazards-2014-%E2%80%93-ECRI.pdf 2014. Accessed May 10, 2016.
[5] FDA Patient Safety News. FDA Patient Safety News: Show #106. Silver Spring, MD: US Food and Drug Administration; 2011 Jan. Alarming monitor problems. Available from: http://www.fda.gov/ downloads/Safety/FDAPatientSafetyNews/UCM417915.pdf 2011. Accessed May 10, 2016.
[6] Görges M, Markewitz BA, Westenskow DR. Improving alarm performance in the medical intensive care unit using delays and clinical context. Anesth Analg 2009; 108(5): 1546-52.
[http://dx.doi.org/10.1213/ane.0b013e31819bdfbb] [PMID: 19372334]
[7] Siebig S, Kuhls S, Imhoff M, Gather U, Schölmerich J, Wrede CE. Intensive care unit alarmshow many do we need? Crit Care Med 2010; 38(2): 451-6.
[http://dx.doi.org/10.1097/CCM.0b013e3181cb0888] [PMID: 20016379]
[8] Drew BJ, Harris P, Zègre-Hemsey JK, et al. Insights into the problem of alarm fatigue with physiologic monitor devices: A comprehensive observational study of consecutive intensive care unit patients. PLoS One 2014; 9(10): e110274.
[http://dx.doi.org/10.1371/journal.pone.0110274] [PMID: 25338067]
[9] Sowan AK, Tarriela AF, Gomez TM, Reed CC, Rapp KM. Nurses perceptions and practices toward clinical alarms in a transplant cardiac intensive care unit: Exploring key issues leading to alarm fatigue. JMIR Hum Factors 2015; 2(1): e3.
[http://dx.doi.org/10.2196/humanfactors.4196] [PMID: 27025940]
[10] Sowan AK, Gomez TM, Tarriela AF, Reed CC, Paper BM. Changes in default alarm settings and standard in-service are insufficient to improve alarm fatigue in an intensive care unit: A pilot project. JMIR Hum Factors 2016; 3(1): e1.
[http://dx.doi.org/10.2196/humanfactors.5098] [PMID: 27036170]
[11] Sowan AK, Reed C, Tarriela AF, Gomez TM. Flaws in clinical alarm safety studies: The value of mixed methods and objective alarm data. Crit Care Med 2015; 43(12): 206.
[http://dx.doi.org/10.1097/01.ccm.0000474648.68026.66]
[12] Gomez T, Sowan AK, Tarriela A, Reed C, Stepanik K. Reducing non-actionable alarms of cardiac monitors as a strategy to improve alarm safety in a transplant/cardiac ICU. Crit Care Nurse 2015; 35(2): e72-3.
[13] Sendelbach S, Wahl S, Anthony A, Shotts P. Stop the noise: A quality improvement project to decrease electrocardiographic nuisance alarms. Crit Care Nurse 2015; 35(4): 15-22.
[http://dx.doi.org/10.4037/ccn2015858] [PMID: 26232798]
[14] Cho OM, Kim H, Lee YW, Cho I. Clinical alarms in intensive care units: Perceived obstacles of alarm management and alarm fatigue in nurses. Healthc Inform Res 2016; 22(1): 46-53.
[http://dx.doi.org/10.4258/hir.2016.22.1.46] [PMID: 26893950]
[15] Cvach MM, Biggs M, Rothwell KJ, Charles-Hudson C. Daily electrode change and effect on cardiac monitor alarms: An evidence-based practice approach. J Nurs Care Qual 2013; 28(3): 265-71.
[http://dx.doi.org/10.1097/NCQ.0b013e31827993bc] [PMID: 23187092]
[16] Philips, IntelliVue Information Center iX: Instructions for use Release A 01. 1st ed. Andover, MA: Philips Medical Systems 2012.
[17] Philips. Instruction for Use IntelliVue Patient Monitor MX600/MX700/MX800: Release J with software revision: Patient Monitoring 2012. Andover, MA: Philips Medical Systems.
[18] Healthcare GE, Monitor CA. GE Healthcare, CARESCAPETM Monitor B850- Technical Manual Software Version 1. Available from: http://www.frankshospitalworkshop.com/equipment/documents/ecg/service_manuals/GEC/arescapeB850V1Monitor-Technicalmanual.pdf 2011. Accessed May 2, 2016.
[19] Bonafide CP, Lin R, Zander M, et al. Association between exposure to nonactionable physiologic monitor alarms and response time in a childrens hospital. J Hosp Med 2015; 10(6): 345-51.
[http://dx.doi.org/10.1002/jhm.2331] [PMID: 25873486]
[20] Sowan AK, Reed CC, Staggers N. Role of large clinical datasets from physiologic monitors in improving the safety of clinical alarm systems and methodological considerations: A case from Philips monitors. JMIR Hum Factors 2016; 3(2): e24.
[http://dx.doi.org/10.2196/humanfactors.6427] [PMID: 27694097]
Track Your Manuscript:


Endorsements



"Open access will revolutionize 21st century knowledge work and accelerate the diffusion of ideas and evidence that support just in time learning and the evolution of thinking in a number of disciplines."


Daniel Pesut
(Indiana University School of Nursing, USA)

"It is important that students and researchers from all over the world can have easy access to relevant, high-standard and timely scientific information. This is exactly what Open Access Journals provide and this is the reason why I support this endeavor."


Jacques Descotes
(Centre Antipoison-Centre de Pharmacovigilance, France)

"Publishing research articles is the key for future scientific progress. Open Access publishing is therefore of utmost importance for wider dissemination of information, and will help serving the best interest of the scientific community."


Patrice Talaga
(UCB S.A., Belgium)

"Open access journals are a novel concept in the medical literature. They offer accessible information to a wide variety of individuals, including physicians, medical students, clinical investigators, and the general public. They are an outstanding source of medical and scientific information."


Jeffrey M. Weinberg
(St. Luke's-Roosevelt Hospital Center, USA)

"Open access journals are extremely useful for graduate students, investigators and all other interested persons to read important scientific articles and subscribe scientific journals. Indeed, the research articles span a wide range of area and of high quality. This is specially a must for researchers belonging to institutions with limited library facility and funding to subscribe scientific journals."


Debomoy K. Lahiri
(Indiana University School of Medicine, USA)

"Open access journals represent a major break-through in publishing. They provide easy access to the latest research on a wide variety of issues. Relevant and timely articles are made available in a fraction of the time taken by more conventional publishers. Articles are of uniformly high quality and written by the world's leading authorities."


Robert Looney
(Naval Postgraduate School, USA)

"Open access journals have transformed the way scientific data is published and disseminated: particularly, whilst ensuring a high quality standard and transparency in the editorial process, they have increased the access to the scientific literature by those researchers that have limited library support or that are working on small budgets."


Richard Reithinger
(Westat, USA)

"Not only do open access journals greatly improve the access to high quality information for scientists in the developing world, it also provides extra exposure for our papers."


J. Ferwerda
(University of Oxford, UK)

"Open Access 'Chemistry' Journals allow the dissemination of knowledge at your finger tips without paying for the scientific content."


Sean L. Kitson
(Almac Sciences, Northern Ireland)

"In principle, all scientific journals should have open access, as should be science itself. Open access journals are very helpful for students, researchers and the general public including people from institutions which do not have library or cannot afford to subscribe scientific journals. The articles are high standard and cover a wide area."


Hubert Wolterbeek
(Delft University of Technology, The Netherlands)

"The widest possible diffusion of information is critical for the advancement of science. In this perspective, open access journals are instrumental in fostering researches and achievements."


Alessandro Laviano
(Sapienza - University of Rome, Italy)

"Open access journals are very useful for all scientists as they can have quick information in the different fields of science."


Philippe Hernigou
(Paris University, France)

"There are many scientists who can not afford the rather expensive subscriptions to scientific journals. Open access journals offer a good alternative for free access to good quality scientific information."


Fidel Toldrá
(Instituto de Agroquimica y Tecnologia de Alimentos, Spain)

"Open access journals have become a fundamental tool for students, researchers, patients and the general public. Many people from institutions which do not have library or cannot afford to subscribe scientific journals benefit of them on a daily basis. The articles are among the best and cover most scientific areas."


M. Bendandi
(University Clinic of Navarre, Spain)

"These journals provide researchers with a platform for rapid, open access scientific communication. The articles are of high quality and broad scope."


Peter Chiba
(University of Vienna, Austria)

"Open access journals are probably one of the most important contributions to promote and diffuse science worldwide."


Jaime Sampaio
(University of Trás-os-Montes e Alto Douro, Portugal)

"Open access journals make up a new and rather revolutionary way to scientific publication. This option opens several quite interesting possibilities to disseminate openly and freely new knowledge and even to facilitate interpersonal communication among scientists."


Eduardo A. Castro
(INIFTA, Argentina)

"Open access journals are freely available online throughout the world, for you to read, download, copy, distribute, and use. The articles published in the open access journals are high quality and cover a wide range of fields."


Kenji Hashimoto
(Chiba University, Japan)

"Open Access journals offer an innovative and efficient way of publication for academics and professionals in a wide range of disciplines. The papers published are of high quality after rigorous peer review and they are Indexed in: major international databases. I read Open Access journals to keep abreast of the recent development in my field of study."


Daniel Shek
(Chinese University of Hong Kong, Hong Kong)

"It is a modern trend for publishers to establish open access journals. Researchers, faculty members, and students will be greatly benefited by the new journals of Bentham Science Publishers Ltd. in this category."


Jih Ru Hwu
(National Central University, Taiwan)


Browse Contents




Webmaster Contact: info@benthamopen.net
Copyright © 2023 Bentham Open