The Open Nursing Journal




ISSN: 1874-4346 ― Volume 13, 2019

Development and Psychometric Evaluation of the Instrument: Attitudes Towards Organ Donor Advocacy Scale (ATODAS)



Anne Flodén*, 1, Anna Forsberg2
1 The Unit for Organ and Tissue Donation, Sahlgrenska University Hospital, Gothenburg, Sweden
2 Institute of Health and Care Sciences, Sahlgrenska Academy at Gothenburg University, Gothenburg, Sweden


Article Information


Identifiers and Pagination:

Year: 2012
Volume: 6
First Page: 97
Last Page: 99
Publisher Id: TONURSJ-6-97
DOI: 10.2174/1874434601206010097
PMID: 22977652
PMCID: PMC3439801

Article History:

Received Date: 13/3/2012
Revision Received Date: 19/3/2012
Acceptance Date: 19/3/2012
Electronic publication date: 6/9/2012
Collection year: 2012

Article Metrics:

CrossRef Citations:
0

Total Statistics:

Full-Text HTML Views: 971
Abstract HTML Views: 867
PDF Downloads: 213
Total Views/Downloads: 2051

Unique Statistics:

Full-Text HTML Views: 611
Abstract HTML Views: 546
PDF Downloads: 154
Total Views/Downloads: 1311
Geographical View

© Flodén and Forsberg; Licensee Bentham Open.

open-access license: This is an open access article licensed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted, non-commercial use, distribution and reproduction in any medium, provided the work is properly cited.


* Address correspondence to this author at the Unit for Organ and Tissue Donation, Sahlgrenska University Hospital, Gothenburg, Sweden; Tel: +46706-461267; Fax: +4631-415562; E-mail: anne.floden@vgregion.se




DEAR EDITOR,

We appreciate the current discussion regarding our publication entitled Development and Psychometric Evaluation of the Instrument: Attitudes Towards Organ Donor Advocacy Scale (ATODAS) [1 Flodén A, Lennerling A, Fridh I, Rizell M, Forsberg A. Development and psychometric evaluation of the instrument: attitudes towards organ donor advocacy scale (ATODAS) Open Nurs J 2011; 5: 65-73.
[http://dx.doi.org/10.2174/1874434601105010065] [PMID: 22046210] [PMCID: PMC3204424]
]. This is what research and publication is all about, to criticize and discuss the rigor and trustworthiness of scientific results. However, the discussion seldom takes place in public which hampers the possibilities for others to learn more about methodological issues. We welcome the comments from Professor Loyd Lee Glenn and Dr. Jessica Stamey regarding the lack of psychometric soundness and the lack of clarity about content validity.

1. FORMING THE EXPERT GROUP TO GUARANTEE ITEM QUALITY AND CONTENT VALIDITY

We selected seven experts to assess the content validity of the initial 55-item scale. The number of experts was based on the guidance of Lynn [2 Lynn MR. Determination and quantification of content validity Nurs Res 1986; 35: 382-5.
[http://dx.doi.org/10.1097/00006199-198611000-00017] [PMID: 3640358]
] who states that a minimum of five experts would provide a sufficient level of control for change agreement and that the maximum numbers should be no more than ten.

There are a limited number of experts in Sweden with the prerequisite experience and knowledge in the field. The professional role of the experts was described in the article. The two intensive and critical care research nurses were selected on the basis of their extensive experience in this context, their methodological knowledge and expertise in developing instruments. They were known to us from their research. The four clinical nursing experts were selected due to their extensive experience of taking care of potential organ donors. Two of them worked in a neuro intensive care unit (NICU), which statistically cares for most of the brain dead patients occurring within intensive care. The other two worked in a large general ICU. We identified these four experts on the basis of their reputation as clinical supervisors. These four experts knew us by name as established researchers at our university but had no other relationship with us. To complement the clinical experts on the panel, a senior academic researcher an expert in item construction was invited to join the group.

All experts on the panel were sent a rating form with the theoretical definition as well as a delineation of the three dimensions, objectives and items. The experts discussed the instrument thoroughly. The experts were asked to rate each item for its relevance to the content domain and were invited to suggest revisions that would improve its clarity and to identify content not indexed by the existing set of scale items. Everyone rated each item individually.

Professor Loyd Lee Glenn and Dr. Jessica Stamey imply that there might have been potential bias involved in the selection process of the expert group, leading to errors in item construction. However, we argue that the experts’ long experience from intensive care and the critical situations of caring for potential organ donors, improved content validity. As presented, the content validity index (CVI) for the entire ATODA scale was 82%. A CVI score of 80% or higher is generally considered reasonable content validity [3 Polit D, Beck C. Essentials of nursing research. 7th. Philadelphia: Lippincott Williams & Wilkins 2010.
[PMCID: PMC2903691]
].

The item construction process involved several basic steps. First we conducted two qualitative studies with in-depth interviews [4 Flodén A, Forsberg A. A phenomenografic study of ICU-nurses’ perceptions of responsibilities and attitudes to organ donation and care for potential donors Intens Crit Care Nurs 2009; 25(6): 306-13.
[http://dx.doi.org/10.1016/j.iccn.2009.06.002] [PMID: 19608419]
,5 Flodén A, Berg M, Forsberg A. ICU nurses' perceptions of responsibilities and organisation in relation to organ donation – a phenomenographic study Intensive Crit Care Nurs 2011; 27(6): 305-16.
[http://dx.doi.org/10.1016/j.iccn.2011.08.002] [PMID: 21872472]
]. We further used the results from a large survey [6 Flodén A, Persson L-O, Rizell M, Sanner M, Forsberg A. Attitudes to organ donation among Swedish ICU nurses J Clin Nurs 2011; 20(21-22): 3183-95.
[http://dx.doi.org/10.1111/j.1365-2702.2011.03756.x] [PMID: 21564363]
] to find further areas of concern. After that we consulted the literature about advocacy and started to develop the theoretical framework behind organ donor advocacy. When this preparatory work was finalized we started to generate and construct items. By this rather rigorous procedure, we were confident that the content reflected most of the important aspects of organ donor advocacy.

However, in our view the main weakness in the results, was the total scale variance of 41.9%. This result indicates that important areas of concern may not be covered by this instrument, which could have contributed to the low response rate.

FACTORS AFFECTING LOW RESPONSE RATE

The response rate of 502 in the present study is acceptable, if using Tabachnick and Fidell [7 Tabachnick B, Fidell L. Using multi-variate statistics 4th. 2001.
[PMID: 16705786]
] reference that at least 300 cases are required for a factor analysis and MacCallum et al. [8 MacCallum RC, Widaman KF, Shang S, Hong S. Sample size in factor analysis Psychol Methods 1999; 4: 84-99.
[http://dx.doi.org/10.1037/1082-989X.4.1.84]
] recommended that a sample size of 500 or more is preferable. The whole subject is complex, involving many aspects of care and professional responsibilities where attitudes are the sum of thoughts and feelings that lead ultimately to action. Actions constitute a central part of any attitude, so we chose to construct the instrument in the form of statements on how the informants would act in a certain situation. We are aware of the difficulties and complexity of the ATODAS that involves illuminating one’s own moral obligations and standpoints. Therefore, almost every item in the ATODAS demands deep reflection on one’s professional and moral responsibility. We assume this contributed to the low response rate whereby only nurses with a firm opinion about organ donor advocacy chose to participate. As identified in the article, this aspect requires further testing and revision before using the ATODAS more widely.

We raised the issue “that this instrument could be very useful when attempting to grasp the complex content of attitudes towards organ donor advocacy, which at times involves ethical and delicate aspects of ICU-nurses’ professional actions” (p,71). We do not imply that the instrument does not need further testing rather, that any effort to grasp a complex matter such as organ donor advocacy, might be facilitated by an instrument that rests on a strong theoretical framework.

ITEM CORRELATION AND CONSTRUCT VALIDITY

Professor Glenn and Dr. Stamey state that there are a large number of items with correlations under 0.60. All scientific work is about making choices. We argue that construct validity can be approached in several ways. We chose to construct validity by principal component analysis since it is the method for identifying a cluster of related items on a scale. According to Hays [9 Hays RD, Hayashi T, Carson S, Ware JE. User’s guide for the multi-trait analysis program (MAP) The Rand Publication Series 1988.], item convergent validity is supported if an item correlates substantially (i.e. corrected correlation of 0.30 or above) with the scale it is hypothesized to represent. Hays advocate a more stringent convergent validity criterion if refining and adding development of a previous scale. In our study we employed this more stringent convergent validity criterion by Hays of 0.40 or above. We choose this five-factor solution since we judged it to fit the theoretical construct best and thereby we also accepted a few correlations close to 0.40.

ROTATION STRATEGY

In their critique Professor Loyd Lee Glenn and Dr. Jessica Stamey state that a low correlation to factors might not be a problem if the factors were orthogonal to each other. Orthogonal rotation is a subset of oblique rotations1. If the clusters of relationships are in fact uncorrelated, then oblique rotation will result in orthogonal factors. Therefore, the difference between orthogonal and oblique rotation is not in discriminating uncorrelated or correlated factors. As factor correlation decrease, the result from oblique and orthogonal rotation tends to become more similar [10 Kieffer KM. Orthogonal versus Oblique factor rotation: A review of the literature regarding the pros and cons The Education Resources Information Center 1998.].

PILOT STUDY

The pilot study was conducted as a part of instrument evaluation and refinement of the ATODAS. As Professor Loyd Lee Glenn and Dr. Jessica Stamey point out, we described a random sampling of ICU nurses to the pilot study and this was a mistake by us. However, the effect of this selection has probably low impact of the validity and reliability of the study as this error was made in the pilot study and corrected in the main study.

Finally, Professor Glenn and Dr. Stamey suggest that our results don’t support the idea that the factors in the ATODAS really separate entities from each other. In our study, based on principal component analysis to obtain a solution with the most optimal scale variance, the five-factor solution fitted the best. The rotated five-factor solution revealed the presence of a simple structure, with each factor showing a number of strong loadings and most variables loading substantially (>.35) on only one factor. Therefore, we argue that the results from this initial testing of the ATODAS supports that the factors are separated from each other.

We argue many more tests are needed for generalisability e.g. reliability and validity testing of the instrument on other nursing populations outside Sweden. The context and organization surrounding the care of potential organ donors does differ considerably by country. The planning for further research has already started including validating the ATODAS instrument for different nursing populations including translation and adding culture specific items.

In conclusion, although we acknowledge the helpful comments made by Professor Glenn and Dr. Stamey we maintain that this context specific self-assessment instrument aimed at measuring attitudes towards organ donor advocacy can be used in future research.

CONFLICT OF INTEREST

The authors confirm that this article content has no conflict of interest.

NOTES

Using oblique rotation provided the best definition of the uncorrelated and correlated cluster patterns of interrelated variables. Orthogonal rotation defines only uncorrelated patterns. Oblique rotation has greater flexibility in searching out patterns regardless of their correlation and the factors are rotated individually to fit each distinct cluster. The relationship between the resulting factors then reflects the relationship between the clusters.

ACKNOWLEDGEMENT

Declared none.

REFERENCES

[1] Flodén A, Lennerling A, Fridh I, Rizell M, Forsberg A. Development and psychometric evaluation of the instrument: attitudes towards organ donor advocacy scale (ATODAS) Open Nurs J 2011; 5: 65-73.
[http://dx.doi.org/10.2174/1874434601105010065] [PMID: 22046210] [PMCID: PMC3204424]
[2] Lynn MR. Determination and quantification of content validity Nurs Res 1986; 35: 382-5.
[http://dx.doi.org/10.1097/00006199-198611000-00017] [PMID: 3640358]
[3] Polit D, Beck C. Essentials of nursing research. 7th. Philadelphia: Lippincott Williams & Wilkins 2010.
[PMCID: PMC2903691]
[4] Flodén A, Forsberg A. A phenomenografic study of ICU-nurses’ perceptions of responsibilities and attitudes to organ donation and care for potential donors Intens Crit Care Nurs 2009; 25(6): 306-13.
[http://dx.doi.org/10.1016/j.iccn.2009.06.002] [PMID: 19608419]
[5] Flodén A, Berg M, Forsberg A. ICU nurses' perceptions of responsibilities and organisation in relation to organ donation – a phenomenographic study Intensive Crit Care Nurs 2011; 27(6): 305-16.
[http://dx.doi.org/10.1016/j.iccn.2011.08.002] [PMID: 21872472]
[6] Flodén A, Persson L-O, Rizell M, Sanner M, Forsberg A. Attitudes to organ donation among Swedish ICU nurses J Clin Nurs 2011; 20(21-22): 3183-95.
[http://dx.doi.org/10.1111/j.1365-2702.2011.03756.x] [PMID: 21564363]
[7] Tabachnick B, Fidell L. Using multi-variate statistics 4th. 2001.
[PMID: 16705786]
[8] MacCallum RC, Widaman KF, Shang S, Hong S. Sample size in factor analysis Psychol Methods 1999; 4: 84-99.
[http://dx.doi.org/10.1037/1082-989X.4.1.84]
[9] Hays RD, Hayashi T, Carson S, Ware JE. User’s guide for the multi-trait analysis program (MAP) The Rand Publication Series 1988.
[10] Kieffer KM. Orthogonal versus Oblique factor rotation: A review of the literature regarding the pros and cons The Education Resources Information Center 1998.

Endorsements



"Open access will revolutionize 21st century knowledge work and accelerate the diffusion of ideas and evidence that support just in time learning and the evolution of thinking in a number of disciplines."


Daniel Pesut
(Indiana University School of Nursing, USA)

"It is important that students and researchers from all over the world can have easy access to relevant, high-standard and timely scientific information. This is exactly what Open Access Journals provide and this is the reason why I support this endeavor."


Jacques Descotes
(Centre Antipoison-Centre de Pharmacovigilance, France)

"Publishing research articles is the key for future scientific progress. Open Access publishing is therefore of utmost importance for wider dissemination of information, and will help serving the best interest of the scientific community."


Patrice Talaga
(UCB S.A., Belgium)

"Open access journals are a novel concept in the medical literature. They offer accessible information to a wide variety of individuals, including physicians, medical students, clinical investigators, and the general public. They are an outstanding source of medical and scientific information."


Jeffrey M. Weinberg
(St. Luke's-Roosevelt Hospital Center, USA)

"Open access journals are extremely useful for graduate students, investigators and all other interested persons to read important scientific articles and subscribe scientific journals. Indeed, the research articles span a wide range of area and of high quality. This is specially a must for researchers belonging to institutions with limited library facility and funding to subscribe scientific journals."


Debomoy K. Lahiri
(Indiana University School of Medicine, USA)

"Open access journals represent a major break-through in publishing. They provide easy access to the latest research on a wide variety of issues. Relevant and timely articles are made available in a fraction of the time taken by more conventional publishers. Articles are of uniformly high quality and written by the world's leading authorities."


Robert Looney
(Naval Postgraduate School, USA)

"Open access journals have transformed the way scientific data is published and disseminated: particularly, whilst ensuring a high quality standard and transparency in the editorial process, they have increased the access to the scientific literature by those researchers that have limited library support or that are working on small budgets."


Richard Reithinger
(Westat, USA)

"Not only do open access journals greatly improve the access to high quality information for scientists in the developing world, it also provides extra exposure for our papers."


J. Ferwerda
(University of Oxford, UK)

"Open Access 'Chemistry' Journals allow the dissemination of knowledge at your finger tips without paying for the scientific content."


Sean L. Kitson
(Almac Sciences, Northern Ireland)

"In principle, all scientific journals should have open access, as should be science itself. Open access journals are very helpful for students, researchers and the general public including people from institutions which do not have library or cannot afford to subscribe scientific journals. The articles are high standard and cover a wide area."


Hubert Wolterbeek
(Delft University of Technology, The Netherlands)

"The widest possible diffusion of information is critical for the advancement of science. In this perspective, open access journals are instrumental in fostering researches and achievements."


Alessandro Laviano
(Sapienza - University of Rome, Italy)

"Open access journals are very useful for all scientists as they can have quick information in the different fields of science."


Philippe Hernigou
(Paris University, France)

"There are many scientists who can not afford the rather expensive subscriptions to scientific journals. Open access journals offer a good alternative for free access to good quality scientific information."


Fidel Toldrá
(Instituto de Agroquimica y Tecnologia de Alimentos, Spain)

"Open access journals have become a fundamental tool for students, researchers, patients and the general public. Many people from institutions which do not have library or cannot afford to subscribe scientific journals benefit of them on a daily basis. The articles are among the best and cover most scientific areas."


M. Bendandi
(University Clinic of Navarre, Spain)

"These journals provide researchers with a platform for rapid, open access scientific communication. The articles are of high quality and broad scope."


Peter Chiba
(University of Vienna, Austria)

"Open access journals are probably one of the most important contributions to promote and diffuse science worldwide."


Jaime Sampaio
(University of Trás-os-Montes e Alto Douro, Portugal)

"Open access journals make up a new and rather revolutionary way to scientific publication. This option opens several quite interesting possibilities to disseminate openly and freely new knowledge and even to facilitate interpersonal communication among scientists."


Eduardo A. Castro
(INIFTA, Argentina)

"Open access journals are freely available online throughout the world, for you to read, download, copy, distribute, and use. The articles published in the open access journals are high quality and cover a wide range of fields."


Kenji Hashimoto
(Chiba University, Japan)

"Open Access journals offer an innovative and efficient way of publication for academics and professionals in a wide range of disciplines. The papers published are of high quality after rigorous peer review and they are Indexed in: major international databases. I read Open Access journals to keep abreast of the recent development in my field of study."


Daniel Shek
(Chinese University of Hong Kong, Hong Kong)

"It is a modern trend for publishers to establish open access journals. Researchers, faculty members, and students will be greatly benefited by the new journals of Bentham Science Publishers Ltd. in this category."


Jih Ru Hwu
(National Central University, Taiwan)


Browse Contents



Webmaster Contact: info@benthamopen.net
Copyright © 2019 Bentham Open