The Open Nursing Journal




ISSN: 1874-4346 ― Volume 13, 2019
REVIEW ARTICLE

Electronic Questionnaires Design and Implementation



Clara Minto1, Giulia Beltrame Vriz2, Matteo Martinato3, Dario Gregori1, *
1 Unit of Biostatistics, Epidemiology and Public Health, Department of Cardiac, Thoracic and Vascular Sciences, University of Padova, Padova, Italy
2 Department of Obstetrics, Santa Chiara Hospital, Trento, Italy
3 University Hospital, Gastroenterology, Padova, Padova, Italy

Abstract

Background:

Nursing and health care research are increasingly using e-questionnaires and e-forms for data collection and survey conduction. The main reason lies in costs, time and data-entry errors containment, increased flexibility, functionality and usability. In spite of this growing usage, no specifc and comprehensive guidelines for designing and submitting e-questionnaires have been produced so far.

Objective:

The aim of this review is to collect information on the current best practices, taking them from various fields of application. An evaluation of the efficacy of the single indication is provided.

Method:

A literature review of guidelines currently available on WebSM (Web Survey Methodology) about electronic questionnaire has been performed. Four search strings were used: “Electronic Questionnaire Design”, “Electronic Questionnaire”, “Online Questionnaire” and “Online survey”. Articles’ inclusion criteria were English language, relevant topic in relation to the aim of the research and the publication date from January 1998 to July 2014.

Results:

The review process led to identify 48 studies. The greater part of guidelines is reported for Web, and e-mail questionnaire, while a lack of indications emerges especially for app and e-questionnaires.

Conclusion:

Lack of guidelines on e-questionnaires has been found, especially in health care research, increasing the risk of use of ineffective and expensive instruments; more research in this field is needed.

Keywords: Electronic questionnaires, Patients reported outcomes, App, Web survey design, Bias reduction techniques, Electronic tools.


Article Information


Identifiers and Pagination:

Year: 2017
Volume: 11
Issue: Suppl-1, M3
First Page: 157
Last Page: 202
Publisher Id: TONURSJ-11-157
DOI: 10.2174/1874434601711010157

Article History:

Received Date: 20/02/2017
Revision Received Date: 02/06/2017
Acceptance Date: 07/07/2017
Electronic publication date: 31/10/2017
Collection year: 2017

Article Metrics:

CrossRef Citations:
0

Total Statistics:

Full-Text HTML Views: 2543
Abstract HTML Views: 611
PDF Downloads: 749
ePub Downloads: 737
Total Views/Downloads: 4640

Unique Statistics:

Full-Text HTML Views: 1236
Abstract HTML Views: 366
PDF Downloads: 199
ePub Downloads: 146
Total Views/Downloads: 1947
Geographical View

© 2017 Minto et al.

open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: https://creativecommons.org/licenses/by/4.0/legalcode. This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.


* Address correspondence to this author at the Unit of Biostatistics, Epidemiology and Public Health, Department of Cardiac, Thoracic and Vascular Sciences, Via Loredan 18, 35121 Padova, Italy, Tel: +390498275384, Fax: +39 02 700445089; E-mail: dario.gregori@unipd.it




1. INTRODUCTION

Technological development and Internet diffusion have changed methods of data collection: World Wide Web and electronic tools represent new challenges for researchers, as these are the newest means to connect people and collect information. These advancements also affect research in clinical settings, where patients and healthcare providers are today more prone to Interent use and more expert on electronic devices like personal computers, tablets, mobile phones, smart phones and others. In nursing research, information is often collected directly from the patient, in order to minimize data entry errors [1Evans JR, Mathur A. The value of online surveys. Intest Res 2005; 15: 195-219.
[http://dx.doi.org/10.1108/10662240510590360]
, 2Manfreda KL, Batagelj Z, Vehovar V. Design of web survey questionnaires: Three basic experiments. J Comp Med Commun 2002; 1: 7-3.]. This method of data collection is called Patient Reported Oucomes PRO (MeSH), Assessment of the quality and effectiveness of health care as measured and directly reported by the patient, and is useful to investigate some health care aspects like patient illness perception, level of pain and efficacy of nurse’s interventions. One of the most important instruments of data collection is the questionnaire, allowing both a self-administration and an operator-assisted interview. Its validity is based on the consistency of gathered information with patients' actual conditions, health perception and thoughts.

Over the last 30 years, traditional survey methods as paper questionnaires or telephone interview, have been partially replaced by new collection instruments designed for electronic tools [3Palmblad M, Tiplady B. Electronic diaries and questionnaires: Designing user interfaces that are easy for all patients to use. Qual Life Res 2004; 13(7): 1199-207.
[http://dx.doi.org/10.1023/B:QURE.0000037501.92374.e1] [PMID: 15473498]
].

Although literature is rich of guidelines on how to create and use paper questionnaires, not all of such indications are applicable to electronic counterparts [1Evans JR, Mathur A. The value of online surveys. Intest Res 2005; 15: 195-219.
[http://dx.doi.org/10.1108/10662240510590360]
]: for example, while evidence on wording and item definition can be the same for all questionnaires, indications about layout, privacy or question structure may change depending on the type of device. Compared to traditional paper-based methods, electronic questionnaires offer several advantages like cost reduction [4Lumsden J. Guidelines for the design of online-questionnaires 2005.], speed in collection and data analysis [5Van SM, Jankowski N. Conducting Online Surveys. Qual Quant 2006; 40: 435-56.
[http://dx.doi.org/10.1007/s11135-005-8081-8]
], personalized design for target sample, lack of influence of researcher presence, comfort for respondents who can complete the questionnaire when and where they prefer, flexibility, functionality, usability, allowing inclusion of pop-up instruction, error messages, link incorporation and making possible to encode difficult skip patterns making such patterns vitually invisible to respondents. However, e-forms present also important disadvantages, able to potentially compromise survey success. Firstly, a sample cannot be representative if the sampling process is not controlled [5Van SM, Jankowski N. Conducting Online Surveys. Qual Quant 2006; 40: 435-56.
[http://dx.doi.org/10.1007/s11135-005-8081-8]
], and users can be worried for their privacy or have concerns about data circulation through a network. Furthermore, e-questionnaires can incur in typical errors due to their technological characteristics: e-mail forms can be read as a spam message, or instrument’s format can be incompatible with users’ device.

Literature reports four categories of errors: coverage, non-response, sampling and measurement errors [3Palmblad M, Tiplady B. Electronic diaries and questionnaires: Designing user interfaces that are easy for all patients to use. Qual Life Res 2004; 13(7): 1199-207.
[http://dx.doi.org/10.1023/B:QURE.0000037501.92374.e1] [PMID: 15473498]
, 5Van SM, Jankowski N. Conducting Online Surveys. Qual Quant 2006; 40: 435-56.
[http://dx.doi.org/10.1007/s11135-005-8081-8]
, 6Kalantari DH, Kalantari DE, Maleki S. E-survey (surveys based on e-mail & web). Procedia Comput Sci 2011; 3: 935-41.
[http://dx.doi.org/10.1016/j.procs.2010.12.153]
]. Coverage error (i) occurs when not all members of a population have the same chance to be included in the sample; non response error (ii) happens when potential users fail to respond to survey invitation. Sampling errors (iii) are a consequence of data collection methods: subjects of interest can be excluded due to technological limitations as low connection, small bandwidth, browser configuration or different devices. Finally, measurement errors (iv) occur when ambiguous or incorrect question wording causes imprecise and contradictory answers.

The aim of the study is (i) to help researchers in the nursing area in limiting potential survey errors, through a critical review of the main guidelines published over the last decade on electronic questionnaire, and (ii) to highlight which aspects of e-forms still need to be analyzed by literature. The study represents a pratical guide to help health researchers and nurses creating an effective e-questionnaire, adapted to the target population and able to collect relevant information.

2. METHODS

The present study is a review of the main guidelines currently present in literature about electronic questionnaire, including an overview on efficacy of these recommendations.

Literature review has been conducted using WebSM (Web Survey Methodology), a database specifically dedicated to address the methodological issues of Web surveys. The same search strings have been used to collect review and trial articles. Key words introduced in the advanced search of the website were: Electronic Questionnaire Design (search string 1), Electronic Questionnaire (search string 2), Online Questionnaire (search string 3), Online survey (search string 4). Articles’ inclusion criteria were English language, relevant topic in relation to the aim of the research and the publication date from January 1998 to July 2014.

3. RESULTS

Fig. (1) shows a flow chart of the process which led to identify 18 articles, relevant for the review, out of initial 1,073.

Fig. (1)
Flow chart of the paper selection process for the review.


Additional 23 articles found in the references of the 18 selected papers, have been included, for a total of 41 articles. Table (1) provides a summary of categories used for classifying e-forms aspects.

Results are organized in 4 different tables: findings from 16 papers were used to create Table (2) (Guidelines Table) and Table (3) (Guidelines’ Distribution Table), while findings from 25 papers contributed to create Table (4) (Efficacy Table).

Table (2) includes guidelines on electronic questionnaire. In this table, indications have been distributed among four types of e-questionnaire:

  • simple electronic questionnaire via personal computer, with a specific software program designed for the survey [4Lumsden J. Guidelines for the design of online-questionnaires 2005., 7Dillman DA, Tortora RD, Bowker D. Principles for constructing web surveys 1998.];
  • e-mail questionnaire, a type of e-survey via network system in which the questionnaire is sent as an e-mail message [6Kalantari DH, Kalantari DE, Maleki S. E-survey (surveys based on e-mail & web). Procedia Comput Sci 2011; 3: 935-41.
    [http://dx.doi.org/10.1016/j.procs.2010.12.153]
    ];
  • online questionnaire, directly inserts on the host website, and designed as a web page with a URL [6Kalantari DH, Kalantari DE, Maleki S. E-survey (surveys based on e-mail & web). Procedia Comput Sci 2011; 3: 935-41.
    [http://dx.doi.org/10.1016/j.procs.2010.12.153]
    ];
  • “App” questionnaire, downloaded as a Smart phone application.

Columns of Table include four types of e-questionnaires, while rows show main categories of guidelines: survey development, questionnaire design, and questionnaire layout and informatics accessibility. The first category, survey development, lists indications on what researcher should do before questionnaire distribution. In the questionnaire design category, we can find evidence about how to profile target audience, ensuring data quality and creating the welcome page, including specific criteria to formulate answers and questions. The row on questionnaire layout provides indications about tool’s visual configuration, with attention to colour use and choice of images. Finally, the category on information accessibility includes guidelines on costs, wording, and indications to ensure an easy and safe utilization of the questionnaire.

From literature review, it is possible to assess that the procedures identified for item’s definition are the same for the different kinds of electronic questionnaire; they are, basically, based on literature review, interviews, focus-group sessions, with potential respondents or experts (Table 2).

Table 1
Summary of categories used for classifying e-forms aspects.


Table 2
Guidelines on questionnaire design and implementation.


Also, the sample selection procedures are similar, but, specifically, for e-mail questionnaire and web questionnaire, guidelines address the issue of achievement of a desired level of randomness and representativeness of non-probability samples. Moreover, in these cases, it is important to use a database with valid e-mail addresses and permission by potential respondents to send surveys Table (2). As to testing and pretesting procedures, the guidelines across different electronic forms are similar, but it is important to take into account that for Web and e-mail questionnaire, virtual pretesting and testing is useful to ensure quick and effective control of the questionnaire (Table 2).

The validation procedures in term of reliability and validity are identical across different electronic questionnaire forms Table (2) and are comparable to procedures provided for paper questionnaire [8Litwin MS, Fink A. How to measure survey reliability and validity. Sage 1995.]. Shows which aspects of electronic questionnaires have been more investigated, and which ones need further analysis. For example, in the category about survey development Table (3), the majority of articles concern e-mail and web questionnaires, while four papers address simple e-forms [1Evans JR, Mathur A. The value of online surveys. Intest Res 2005; 15: 195-219.
[http://dx.doi.org/10.1108/10662240510590360]
, 9Burns KE, Duffett M, Kho ME, et al. A guide for the design and conduct of self-administered surveys of clinicians. CMAJ 2008; 179(3): 245-52.
[http://dx.doi.org/10.1503/cmaj.080372] [PMID: 18663204]
, 10Bailey J, Bensky E, Link M. Can Your Smartphone Do This?: A New Methodology for Advancing Digital Ethnography. 2011. In American Association for Public Opinion Research annual conference 2011.Phoenix, AZ. 2011., 14Batinic B, Reips UD, Bosnjak M, Eds. Online social sciences 2002.] and only one article discusses app-forms [9Burns KE, Duffett M, Kho ME, et al. A guide for the design and conduct of self-administered surveys of clinicians. CMAJ 2008; 179(3): 245-52.
[http://dx.doi.org/10.1503/cmaj.080372] [PMID: 18663204]
].

For what concerns efficacy, Table (4) reports estimates of the efficacy of some of the most relevant topics: login procedures, use of reminder letters, progress indicator, questionnaire length and cover messages. As shown in the table, use of personalized invitation [4Lumsden J. Guidelines for the design of online-questionnaires 2005.], adoptions of mixed strategies [9Burns KE, Duffett M, Kho ME, et al. A guide for the design and conduct of self-administered surveys of clinicians. CMAJ 2008; 179(3): 245-52.
[http://dx.doi.org/10.1503/cmaj.080372] [PMID: 18663204]
], creation of plain questionnaire, reduction of text length [10Bailey J, Bensky E, Link M. Can Your Smartphone Do This?: A New Methodology for Advancing Digital Ethnography. 2011. In American Association for Public Opinion Research annual conference 2011.Phoenix, AZ. 2011.], use of reminder letters or telephone contacts [11Palmblad M, Tiplady B. Electronic diaries and questionnaires: Designing user interfaces that are easy for all patients to use. Qual Life Res 2004; 13(7): 1199-207.
[http://dx.doi.org/10.1023/B:QURE.0000037501.92374.e1] [PMID: 15473498]
], inclusion of semiautomatic login procedure [12Lumsden J. Guidelines for the Design of Online-Questionnaires. NRC Publications Archive 2005; 31.-14Batinic B, Reips UD, Bosnjak M, Eds. Online social sciences 2002.] and adoption of strong privacy policies, are all elements that have the potential to increase response rates. On the other side, including in the cover letter or in the survey introduction an estimate of the completion time does not seem to significantly influence user’s attitudes.

Table 3
Reviewed papers distributed according to information and pertinence.


4. DISCUSSION

Literature review demonstrated a lack of indications about app and off-line e-questionnaires, while it has reported a wide collection of guidelines on e-mail and web forms. While many indications for online questionnaires can be applied also to simple e-forms, the same does not hold for app versions, since every type of device needs specific guidance in terms of media characteristics and electronic limitations. Colour and graphic use, as well as answers formulation and scrolling choice, can positively or negatively influence response rate: researcher for example should evaluate if scrolling is comfortable for smart phones users, or if a complex configuration does not increase download time. These and other guidelines on questionnaire layout should be taylored depending on type of electronic device. For example, for mail web questionnaire it is important to consider sampling procedures that take into account the representativeness of non-probability samples [5Van SM, Jankowski N. Conducting Online Surveys. Qual Quant 2006; 40: 435-56.
[http://dx.doi.org/10.1007/s11135-005-8081-8]
].

Such a lack of evidence affects also the entire process of questionnaire creation. For example, only one article deals with questionnaire design, explaining question types as rank order questions, categorical or nominal questions, magnitude estimate questions, ordinal questions or Likert scale [3Palmblad M, Tiplady B. Electronic diaries and questionnaires: Designing user interfaces that are easy for all patients to use. Qual Life Res 2004; 13(7): 1199-207.
[http://dx.doi.org/10.1023/B:QURE.0000037501.92374.e1] [PMID: 15473498]
, 9Burns KE, Duffett M, Kho ME, et al. A guide for the design and conduct of self-administered surveys of clinicians. CMAJ 2008; 179(3): 245-52.
[http://dx.doi.org/10.1503/cmaj.080372] [PMID: 18663204]
].

The category of information accessibility is the most discussed, consistently with the current interest in electronic tools. A large number of studies investigated topics like security (login procedure, privacy protection), strategies to encourage and help users (cover letter, instructions, reminders, users competence), technical procedures to create a simple tool (skip and filter questions, screen and type of device, technical procedures, browser and file size), ways to ensure data quality (repeated answer, confirmation message, thank you page), and indications to create a visually attractive questionnaire, in order to reduce dropout rates and increase users’ responses (progress indicator, one page and multiple page design, wording, phraseology, multiple choice, costs).

Table 4
Evidence-based classification on the impact of the various indications as proposed in the paper.


Furthermore, while the choice of the topic is relevant in increasing data quality [45Heerwegh D, Loosveldt G. Web surveys: The effect of controlling survey access using PIN numbers. Soc Sci Comput Rev 2002; 20: 10-21.
[http://dx.doi.org/10.1177/089443930202000102]
], the use of a grid design does not seem to improve it. Respondents’ appreciation on the survey is positively conditioned by the inclusion of progress indicators, as it influences perceptions on questionnaire length, and by the adoption of graphical details that make questionnaire more enjoyable. However, effectiveness of most of the guidelines still remains uncertain: the completion rate is always higher in PC questionnaire compared to app forms, also for sensitive topics; the header image is not affected by “banner blindness” phenomenon and can partially influence user answers [28Holland JL, Christian LM. The Influence of topic interest and interactive probing on responses to open-ended questions in web surveys. Soc Sci Comput Rev 2009; 27: 196-212.
[http://dx.doi.org/10.1177/0894439308327481]
]; finally, use of progress indicator and first question configuration have little or no effect on dropout and completeness rates [42Couper MP, Conrad FG, Tourangeau R. Visual context effects in web surveys. Public Opin Q 2007; 71: 623-34.
[http://dx.doi.org/10.1093/poq/nfm044]
].

It is important to highlight that the majority of retrieved papers concern marketing and epidemiological topics, while just a few studies have been conducted in clinical setting. Implementation of new electronic tools and adaptation of existing guidelines to the needs of health care and nursing researchers can contribute to reinforce efficacy in this particular setting. This is the case of users with particular needs, for whom literature does not report any specific guideline, but for a few articles [21Couper MP, Traugott MW, Lamias MJ. Web survey design and administration. Public Opin Q 2001; 65(2): 230-53.
[http://dx.doi.org/10.1086/322199] [PMID: 11420757]
] giving general information on font size, colours, and button size for subjects with visual or motor difficulties. Due to absence of particular indications for patients with disabilities, the risk to exclude part of the population is still present, with potential, eligible respondents not being able to participate because of their inability to use the instrument.

Lack of guidelines on e-questionnaires also has consequences in health research, especially for nurses (ideal users of this survey tool) [46Timmins F. Surveys and questionnaires in nursing research. Nurs Stand 2015; 29(42): 42-50.
[http://dx.doi.org/10.7748/ns.29.42.42.e8904] [PMID: 26080989]
]. Questionnaires, in nursing research, are useful tools also in simple research studies [47Thom B. Role of the simple, self-designed questionnaire in nursing research. J Pediatr Oncol Nurs 2007; 24(6): 350-5.
[http://dx.doi.org/10.1177/1043454207309478] [PMID: 18003595]
]. For these reasons, the shortage of methodological guidelines concerning the construction, validation and administration of questionnaires, particularly in electronic form, may increase the risk of use of ineffective and expensive instruments to conduct surveys.

In order to facilitate subjects’ participation and collect high-quality data, nurses should consider new technologies as resources to communicate with patients that use electronic tools in daily routine.

CONCLUSION

Literature review revealed the need of further implementation of guidelines on electronic questionnaires, particularly in nursing and health care research. The current research is suitable to be the starting point of future improvement: future studies on e-questionnaires will update this guidelines collection, including more accurate evidence in line with technological development and population characteristics. Finally, trials on the efficacy of guidelines have to be implemented in order to verify the validity of the indications coming from the current literature. The evolution of electronic techniques for data collection, and their integration into research practice, should always be consistent with the general criteria of validity and reliability, in order to ensure integrity of the scientific process and provide relevant information.

LIST OF ABBREVIATIONS

WebSM  = (Web Survey Methodology)
PRO  = (Patient Reported Oucomes (P.R.O)

CONSENT FOR PUBLICATION

Not applicable.

CONFLICT OF INTEREST

The authors declare no conflict of interest, financial or otherwise.

ACKNOWLEDGEMENTS

Declared none.

REFERENCES

[1] Evans JR, Mathur A. The value of online surveys. Intest Res 2005; 15: 195-219.
[http://dx.doi.org/10.1108/10662240510590360]
[2] Manfreda KL, Batagelj Z, Vehovar V. Design of web survey questionnaires: Three basic experiments. J Comp Med Commun 2002; 1: 7-3.
[3] Palmblad M, Tiplady B. Electronic diaries and questionnaires: Designing user interfaces that are easy for all patients to use. Qual Life Res 2004; 13(7): 1199-207.
[http://dx.doi.org/10.1023/B:QURE.0000037501.92374.e1] [PMID: 15473498]
[4] Lumsden J. Guidelines for the design of online-questionnaires 2005.
[5] Van SM, Jankowski N. Conducting Online Surveys. Qual Quant 2006; 40: 435-56.
[http://dx.doi.org/10.1007/s11135-005-8081-8]
[6] Kalantari DH, Kalantari DE, Maleki S. E-survey (surveys based on e-mail & web). Procedia Comput Sci 2011; 3: 935-41.
[http://dx.doi.org/10.1016/j.procs.2010.12.153]
[7] Dillman DA, Tortora RD, Bowker D. Principles for constructing web surveys 1998.
[8] Litwin MS, Fink A. How to measure survey reliability and validity. Sage 1995.
[9] Burns KE, Duffett M, Kho ME, et al. A guide for the design and conduct of self-administered surveys of clinicians. CMAJ 2008; 179(3): 245-52.
[http://dx.doi.org/10.1503/cmaj.080372] [PMID: 18663204]
[10] Bailey J, Bensky E, Link M. Can Your Smartphone Do This?: A New Methodology for Advancing Digital Ethnography. 2011. In American Association for Public Opinion Research annual conference 2011.Phoenix, AZ. 2011.
[11] Palmblad M, Tiplady B. Electronic diaries and questionnaires: Designing user interfaces that are easy for all patients to use. Qual Life Res 2004; 13(7): 1199-207.
[http://dx.doi.org/10.1023/B:QURE.0000037501.92374.e1] [PMID: 15473498]
[12] Lumsden J. Guidelines for the Design of Online-Questionnaires. NRC Publications Archive 2005; 31.
[13] Lumsden J, Morgan W. Online-questionnaire design: Establishing guidelines and evaluating existing eupport. http://nparc.cisti-icist.nrc-cnrc.gc.ca/ npsi/ctrl?action=rtdoc&an=8913785&lang=en
[14] Batinic B, Reips UD, Bosnjak M, Eds. Online social sciences 2002.
[15] Dube SR, Hu SS, Fredner-Maguire N, Dayton J. A Focus Group Pilot Study of Use of Smartphone to Collect Information about Health Behaviors. In: Association A S, Ed. 67th Annual Conference of the American Association for Public Opinion Research (AAPOR) 2012.Orlando, Florida. 2012.
[16] Dillman DA, Smyth JD, Christian LM. Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method 2008.
[17] Väätäjä H, Roto V. Mobile questionnaires for user experience evaluation. CHI’10 2010; 3361-6.
[18] Abraham SY, Steiger DM, Sullivan C. Electronic and mail self-administered questionnaires: A comparative assessment of use among elite Populations. Proceedings of the Section on Survey Research Methods 1998; 833-41.
[19] Emde M, Fuchs M. Using adaptive questionnaire design in open-ended questions: A field experiment. 67th Annual Conference 2012.San Diego, USA. 2012.
[20] Dillman DA, Tortora RD, Bowker D. Principles for constructing web surveys 1998.
[21] Couper MP, Traugott MW, Lamias MJ. Web survey design and administration. Public Opin Q 2001; 65(2): 230-53.
[http://dx.doi.org/10.1086/322199] [PMID: 11420757]
[22] Heerwegh D, Vanhove T, Loosveldt G, Matthijs K. Effects of personalization on web survey response rates and data quality. 2004. In: InRC33 Sixth International Conference on Social Science Methodology; Amsterdam. 2004.
[23] Joinson AN, Reips UD. Personalized salutation, power of sender and response rates to Web-based surveys. Comput Human Behav 2007; 23: 1372-83.
[http://dx.doi.org/10.1016/j.chb.2004.12.011]
[24] Heerwegh D, Loosveldt G. An experimental study on the effects of personalization, Survey Length Statements, Progress Indicators, and survey Sponsor Logos in Web Surveys J Off Stat 2006; 22: 191-210.
[25] Fischbacher C, Chappel D, Edwards R, Summerton N. Health surveys via the Internet: Quick and dirty or rapid and robust? J R Soc Med 2000; 93(7): 356-9.
[http://dx.doi.org/10.1177/014107680009300705] [PMID: 10928022]
[26] Schleyer TK, Forrest JL. Methods for the design and administration of web-based surveys. J Am Med Inform Assoc 2000; 7(4): 416-25.
[http://dx.doi.org/10.1136/jamia.2000.0070416] [PMID: 10887169]
[27] Schonlau M, Asch BJ, Du C. Web surveys as part of a mixed-mode strategy for populations that cannot be contacted by E-Mail. Soc Sci Comput Rev 2003; 21: 218-22.
[http://dx.doi.org/10.1177/0894439303021002007]
[28] Holland JL, Christian LM. The Influence of topic interest and interactive probing on responses to open-ended questions in web surveys. Soc Sci Comput Rev 2009; 27: 196-212.
[http://dx.doi.org/10.1177/0894439308327481]
[29] Crawford SD, Couper MP, Lamias MJ. Web surveys: perceptions of burden. Soc Sci Comput Rev 2001; 19: 146-62.
[http://dx.doi.org/10.1177/089443930101900202]
[30] Heerwegh D, Loosveldt G. Web Surveys: The Effect of Controlling Survey Access Using PIN Numbers. Soc Sci Comput Rev 2002; 20: 10-21.
[http://dx.doi.org/10.1177/089443930202000102]
[31] Dillman DA, Tortora RD, Conradt J, Bowker D. Influence of Plain Vs. Fancy Design on Response Rates for Web Surveys. In: Association AS, Ed. Joint Statistical Meetings 1998.
[32] Scott A, Jeon S-H, Joyce CM, et al. A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors. BMC Med Res Methodol 2011; 11: 126.
[http://dx.doi.org/10.1186/1471-2288-11-126] [PMID: 21888678]
[33] Healey B, Macpherson T, Kuijten B. An Empirical Evaluation of Three Web Survey Design Principles Market Bullet 2005; 16: 1.
[34] Heerwegh D, Loosveldt G. An Evaluation of the effect of response formats on data quality in web surveys. Soc Sci Comput Rev 2002; 20: 471-84.
[http://dx.doi.org/10.1177/089443902237323]
[35] Burdein I. Shorter Isn’t Always Better In: 2013 CASRO Online Research Conference 2014.
[36] Hoerger M. Participant dropout as a function of survey length in internet-mediated university studies: Implications for study design and voluntary participation in psychological research. Cyberpsychol Behav Soc Netw 2010; 13(6): 697-700.
[http://dx.doi.org/10.1089/cyber.2009.0445] [PMID: 21142995]
[37] Deutskens E, de Ruyter K, Wetzels M, Oosterveld P. Response rate and response quality of internet-based surveys: Experiment Study. Mark Lett 2004; 15: 21-36.
[http://dx.doi.org/10.1023/B:MARK.0000021968.86465.00]
[38] Zhang C. Satisficing in Web Surveys: Implications for Data Quality and Strategies for Reduction 2013.
[39] Stanley N, Jenkins S. Watch what I do: Using graphical input controls in Web surveys. Challanges of a changing world 2007; In: Proceedings of the Fifth International Conference of the Association for Survey Computing; . 2007; pp. 81-92.
[40] Joinson AN, Reips U-D, Buchanan T, Schofield CB. Privacy, Trust, and Self-Disclosure. Hum Comput Interact 2010; 25: 1-24.
[http://dx.doi.org/10.1080/07370020903586662]
[41] Barth A. Does the Choice of Header Images influence Responses? Findings from a Web Survey on Students’ Housing Situation. Survey Methods: Insights from the Field 2014.
[42] Couper MP, Conrad FG, Tourangeau R. Visual context effects in web surveys. Public Opin Q 2007; 71: 623-34.
[http://dx.doi.org/10.1093/poq/nfm044]
[43] Thorndike FP, Carlbring P, Smyth FL, et al. Web-based measurement: Effect of completing single or multiple items per webpage. Comput Human Behav 2009; 25: 393-401.
[http://dx.doi.org/10.1016/j.chb.2008.05.006]
[44] Peytchev A, Hill CA. Experiments in Mobile Web Survey Design: Similarities to other modes and unique considerations. Soc Sci Comput Rev 2010; 28: 319-35.
[http://dx.doi.org/10.1177/0894439309353037]
[45] Heerwegh D, Loosveldt G. Web surveys: The effect of controlling survey access using PIN numbers. Soc Sci Comput Rev 2002; 20: 10-21.
[http://dx.doi.org/10.1177/089443930202000102]
[46] Timmins F. Surveys and questionnaires in nursing research. Nurs Stand 2015; 29(42): 42-50.
[http://dx.doi.org/10.7748/ns.29.42.42.e8904] [PMID: 26080989]
[47] Thom B. Role of the simple, self-designed questionnaire in nursing research. J Pediatr Oncol Nurs 2007; 24(6): 350-5.
[http://dx.doi.org/10.1177/1043454207309478] [PMID: 18003595]

Endorsements



"Open access will revolutionize 21st century knowledge work and accelerate the diffusion of ideas and evidence that support just in time learning and the evolution of thinking in a number of disciplines."


Daniel Pesut
(Indiana University School of Nursing, USA)

"It is important that students and researchers from all over the world can have easy access to relevant, high-standard and timely scientific information. This is exactly what Open Access Journals provide and this is the reason why I support this endeavor."


Jacques Descotes
(Centre Antipoison-Centre de Pharmacovigilance, France)

"Publishing research articles is the key for future scientific progress. Open Access publishing is therefore of utmost importance for wider dissemination of information, and will help serving the best interest of the scientific community."


Patrice Talaga
(UCB S.A., Belgium)

"Open access journals are a novel concept in the medical literature. They offer accessible information to a wide variety of individuals, including physicians, medical students, clinical investigators, and the general public. They are an outstanding source of medical and scientific information."


Jeffrey M. Weinberg
(St. Luke's-Roosevelt Hospital Center, USA)

"Open access journals are extremely useful for graduate students, investigators and all other interested persons to read important scientific articles and subscribe scientific journals. Indeed, the research articles span a wide range of area and of high quality. This is specially a must for researchers belonging to institutions with limited library facility and funding to subscribe scientific journals."


Debomoy K. Lahiri
(Indiana University School of Medicine, USA)

"Open access journals represent a major break-through in publishing. They provide easy access to the latest research on a wide variety of issues. Relevant and timely articles are made available in a fraction of the time taken by more conventional publishers. Articles are of uniformly high quality and written by the world's leading authorities."


Robert Looney
(Naval Postgraduate School, USA)

"Open access journals have transformed the way scientific data is published and disseminated: particularly, whilst ensuring a high quality standard and transparency in the editorial process, they have increased the access to the scientific literature by those researchers that have limited library support or that are working on small budgets."


Richard Reithinger
(Westat, USA)

"Not only do open access journals greatly improve the access to high quality information for scientists in the developing world, it also provides extra exposure for our papers."


J. Ferwerda
(University of Oxford, UK)

"Open Access 'Chemistry' Journals allow the dissemination of knowledge at your finger tips without paying for the scientific content."


Sean L. Kitson
(Almac Sciences, Northern Ireland)

"In principle, all scientific journals should have open access, as should be science itself. Open access journals are very helpful for students, researchers and the general public including people from institutions which do not have library or cannot afford to subscribe scientific journals. The articles are high standard and cover a wide area."


Hubert Wolterbeek
(Delft University of Technology, The Netherlands)

"The widest possible diffusion of information is critical for the advancement of science. In this perspective, open access journals are instrumental in fostering researches and achievements."


Alessandro Laviano
(Sapienza - University of Rome, Italy)

"Open access journals are very useful for all scientists as they can have quick information in the different fields of science."


Philippe Hernigou
(Paris University, France)

"There are many scientists who can not afford the rather expensive subscriptions to scientific journals. Open access journals offer a good alternative for free access to good quality scientific information."


Fidel Toldrá
(Instituto de Agroquimica y Tecnologia de Alimentos, Spain)

"Open access journals have become a fundamental tool for students, researchers, patients and the general public. Many people from institutions which do not have library or cannot afford to subscribe scientific journals benefit of them on a daily basis. The articles are among the best and cover most scientific areas."


M. Bendandi
(University Clinic of Navarre, Spain)

"These journals provide researchers with a platform for rapid, open access scientific communication. The articles are of high quality and broad scope."


Peter Chiba
(University of Vienna, Austria)

"Open access journals are probably one of the most important contributions to promote and diffuse science worldwide."


Jaime Sampaio
(University of Trás-os-Montes e Alto Douro, Portugal)

"Open access journals make up a new and rather revolutionary way to scientific publication. This option opens several quite interesting possibilities to disseminate openly and freely new knowledge and even to facilitate interpersonal communication among scientists."


Eduardo A. Castro
(INIFTA, Argentina)

"Open access journals are freely available online throughout the world, for you to read, download, copy, distribute, and use. The articles published in the open access journals are high quality and cover a wide range of fields."


Kenji Hashimoto
(Chiba University, Japan)

"Open Access journals offer an innovative and efficient way of publication for academics and professionals in a wide range of disciplines. The papers published are of high quality after rigorous peer review and they are Indexed in: major international databases. I read Open Access journals to keep abreast of the recent development in my field of study."


Daniel Shek
(Chinese University of Hong Kong, Hong Kong)

"It is a modern trend for publishers to establish open access journals. Researchers, faculty members, and students will be greatly benefited by the new journals of Bentham Science Publishers Ltd. in this category."


Jih Ru Hwu
(National Central University, Taiwan)


Browse Contents



Webmaster Contact: info@benthamopen.net
Copyright © 2019 Bentham Open