The Open Public Health Journal




ISSN: 1874-9445 ― Volume 11, 2018
RESEARCH ARTICLE

Subjective Self-Rated Speech Intelligibility and Quality of Life in Patients with Parkinson’s Disease in a Malaysian Sample



Shin Ying Chu1, *, Chai Li Tan2
1 Centre for Rehabilitation & Special Needs, Speech Sciences Programme, Faculty of Health Sciences, Universiti Kebangsaan Malaysia, Jalan Raja Muda Abdul Aziz, Kuala Lumpur, 50300 Malaysia
2 Speech Sciences Programme, Faculty of Health Sciences, Universiti Kebangsaan Malaysia, Jalan Raja Muda Abdul Aziz, Kuala Lumpur, 50300 Malaysia

Abstract

Objectives:

This study compared the Quality of Life (QOL) of individuals with Parkinson’s disease (PD) with a healthy control from a sample in Malaysia. The relationship between the QOL, age, gender, duration of disease, self-rated speech scale, and life satisfaction level was examined.

Methods:

Fifty-four individuals with PD and 55 non-PD control adults completed the Parkinson’s Disease Questionnaire-39 (PDQ-39) and rated their speech intelligibility [Self-Rated Speech Scale (SRSS)] and life satisfaction level [Life Satisfaction Scale (LSS)] on a 10-point scale.

Results:

PD participants reported significantly lower QOL scores than the control group (Mann-Whitney U). Although there was no significant relationship between the QOL, age, gender, and duration of disease for PD participants, moderately significant correlations were observed between QOL, LSS and SRSS ratings (Spearman correlation). Individuals with PD showed lower QOL and higher concern in their communication than the control group.

Conclusion:

Identifying patients’ perception of their speech performance could help clinicians to better understand patients’ needs when delivering speech therapy services.

Keywords: Parkinson’s disease, Quality of life, Communication, Social support, Questionnaire, Self-Rated Speech Scale, Life Satisfaction Scale.


Article Information


Identifiers and Pagination:

Year: 2018
Volume: 11
First Page: 485
Last Page: 493
Publisher Id: TOPHJ-11-485
DOI: 10.2174/1874944501811010485

Article History:

Received Date: 6/8/2018
Revision Received Date: 7/11/2018
Acceptance Date: 9/11/2018
Electronic publication date: 23/11/2018
Collection year: 2018

Article Metrics:

CrossRef Citations:
0

Total Statistics:

Full-Text HTML Views: 104
Abstract HTML Views: 97
PDF Downloads: 59
ePub Downloads: 39
Total Views/Downloads: 299

Unique Statistics:

Full-Text HTML Views: 74
Abstract HTML Views: 60
PDF Downloads: 51
ePub Downloads: 33
Total Views/Downloads: 218
Geographical View

© 2018 Chu and Tan.

open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: https://creativecommons.org/licenses/by/4.0/legalcode. This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.


* Address correspondence to this author at the Centre for Rehabilitation & Special Needs, Speech Sciences Programme, Faculty of Health Sciences, Universiti Kebangsaan Malaysia, Jalan Raja Muda Abdul Aziz, Kuala Lumpur, 50300 Malaysia, Tel: +603-9289-5023, Fax: +603-2698-6039; E-mail: chushinying@ukm.edu.my




1. INTRODUCTION

Parkinson’s Disease (PD) is the world’s second most common neurodegenerative disease, and affects over 10 million people worldwide [1Parkinson’s disease Foundation. Statistics on Parkinson’s 2016. cited 2016http://www.pdf.org/en/parkinson_statistics, 2National Institute of Neurological Disorders and Stroke. Parkinson's Disease: Challenges, Progress, and Promise. Sept 1, [cited 2016] Available from: 2016.https://www.ninds.nih.gov/Disorders/All-Disorders/NINDS-Parkinsons-Disease-Information-Page/Parkinsons-Disease-Challenges]. Apart from resting tremor, slowness of movement, stiffness in muscle tone, and imbalance of body posture, PD is frequently accompanied by depression, dementia, swallowing difficulty, and speech and voice disorders [3Azmin S, Khairul Anuar AM, Tan HJ, et al. Nonmotor symptoms in a malaysian Parkinson’s disease population. Parkinsons Dis 2014; 2014: 472157.[http://dx.doi.org/10.1155/2014/472157] [PMID: 24800102] -5Theodoros DG, Hill AJ, Russell TG. Clinical and quality of life outcomes of speech treatment for Parkinson’s disease delivered to the home via telerehabilitation: A noninferiority randomized controlled trial. Am J Speech Lang Pathol 2016; 25(2): 214-32.[http://dx.doi.org/10.1044/2015_AJSLP-15-0005] [PMID: 27145396] ]. Hypokinetic dysarthria, a speech disorder that commonly presents in patients with PD, often results in limitation in their social interactions [6Lirani-Silva C, Mourão LF, Gobbi LT. Dysarthria and quality of life in neurologically healthy elderly and patients with Parkinson’s disease. CoDAS 2015; 27(3): 248-54.[http://dx.doi.org/10.1590/2317-1782/20152014083] [PMID: 26222941] , 7Takahashi K, Kamide N, Suzuki M, Fukuda M. Quality of life in people with Parkinson’s disease: The relevance of social relationships and communication. J Phys Ther Sci 2016; 28(2): 541-6.[http://dx.doi.org/10.1589/jpts.28.541] [PMID: 27065542] ]. PD affects many aspects of patients’ lives and since this disease is progressive, it is important to maintain functional abilities related to independent living when providing rehabilitation services [8van Uem JM, Marinus J, Canning C, et al. Health-Related quality of life in patients with Parkinson’s disease- A systematic review based on the ICF model. Neurosci Biobehav Rev 2016; 61: 26-34.[http://dx.doi.org/10.1016/j.neubiorev.2015.11.014] [PMID: 26645499] -10Cholewa J, Gorzkowska A, Szepelawy M, Nawrocka A, Cholewa J. Influence of functional movement rehabilitation on quality of life in people with Parkinson’s disease. J Phys Ther Sci 2014; 26(9): 1329-31.[http://dx.doi.org/10.1589/jpts.26.1329] [PMID: 25276010] ] in order to maintain their quality of life [11American Speech-Language-Hearing Association. Scope of Practice in Speech Language Pathology 2016 [Cited 2018] Available from 2016.http://www.asha.org/policy, 12Martinez-Martin P, Rodriguez-Blazquez C, Kurtis MM, Chaudhuri KR. The impact of non-motor symptoms on health-related quality of life of patients with Parkinson’s disease. Mov Disord 2011; 26(3): 399-406.[http://dx.doi.org/10.1002/mds.23462] [PMID: 21264941] ] and reduce the burden on caregivers [13Razali R, Ahmad F, Rahman FN, Midin M, Sidi H. Burden of care among caregivers of patients with Parkinson disease: A cross-sectional study. Clin Neurol Neurosurg 2011; 113(8): 639-43.[http://dx.doi.org/10.1016/j.clineuro.2011.05.008] [PMID: 21684679] ].

Quality of life is defined as an individual’s perception of their experiences in life [14The World Health Organization quality of life assessment (WHOQOL): Position paper from the World Health Organization. Soc Sci Med 1995; 41(10): 1403-9.[http://dx.doi.org/10.1016/0277-9536(95)00112-K] [PMID: 8560308] ]. It also reflects the degree of challenges that one faces in life [15Scheife RT, Schumock GT, Burstein A, Gottwald MD, Luer MS. Impact of Parkinson’s disease and its pharmacologic treatment on quality of life and economic outcomes. Am J Health Syst Pharm 2000; 57(10): 953-62.[PMID: 10832495] ], including social functions, emotional, physical, and mental conditions. Quality of life has been used as a clinical outcome measure for service delivery in different disorders, including PD [5Theodoros DG, Hill AJ, Russell TG. Clinical and quality of life outcomes of speech treatment for Parkinson’s disease delivered to the home via telerehabilitation: A noninferiority randomized controlled trial. Am J Speech Lang Pathol 2016; 25(2): 214-32.[http://dx.doi.org/10.1044/2015_AJSLP-15-0005] [PMID: 27145396] , 16Higginson IJ, Carr AJ. Using quality of life measures in the clinical setting (Measuring Quality of Life, part 2). BMJ 2013; 22: 1297-304.]. Some of the commonly used tools that quantify quality of life in PD are the Parkinson’s Disease Questionnaire (PDQ-39), Parkinson’s Disease Questionnaire Short Form (PDQ-8), Parkinson’s Impact Scale (PIMS), Parkinson’s Disease Quality of Life Questionnaire (PDQL), and Scales for Outcomes in Parkinson’s Disease–Psychosocial (SCOPAPS) [17Martinez-Martin P, Jeukens-Visser M, Lyons KE, et al. Health-related quality-of-life scales in Parkinson’s disease: Critique and recommendations. Mov Disord 2011; 26(13): 2371-80.[http://dx.doi.org/10.1002/mds.23834] [PMID: 21735480] ]. Among these, the PDQ-39 is commonly used to measure one’s experiences of the impact of PD on life. It is widely used in determining treatment outcomes and when reviewing the overall impact of PD [18Peto V, Jenkinson C, Fitzpatrick R, Greenhall R. The development and validation of a short measure of functioning and well being for individuals with Parkinson’s disease. Qual Life Res 1995; 4(3): 241-8.[http://dx.doi.org/10.1007/BF02260863] [PMID: 7613534] ]. It consists of 39 items and measures eight dimensions of quality of life relating to PD (i.e., mobility, activities of daily living, emotional, stigma, social support, cognitions, communication, and bodily discomfort).

Using the PDQ-39, PD patients reported higher scores (indicates poorer experience) in the mobility dimension. This indicates that PD is severely affecting the patients’ mobility, and the rank is followed by activities of daily living dimension or bodily discomfort [7Takahashi K, Kamide N, Suzuki M, Fukuda M. Quality of life in people with Parkinson’s disease: The relevance of social relationships and communication. J Phys Ther Sci 2016; 28(2): 541-6.[http://dx.doi.org/10.1589/jpts.28.541] [PMID: 27065542] , 19Jenkinson C, Fitzpatrick R, Peto V, Greenhall R, Hyman N. The Parkinson’s Disease Questionnaire (PDQ-39): Development and validation of a Parkinson’s disease summary index score. Age Ageing 1997; 26(5): 353-7.[http://dx.doi.org/10.1093/ageing/26.5.353] [PMID: 9351479] , 20Schrag A, Jahanshahi M, Quinn N. How does Parkinson’s disease affect quality of life? A comparison with quality of life in the general population. Mov Disord 2000; 15(6): 1112-8.[http://dx.doi.org/10.1002/1531-8257(200011)15:6<1112::AID-MDS1008>3.0.CO;2-A] [PMID: 11104193] ]. When comparing quality of life between people with PD and the general population, Schrag and colleagues (2000) found that individuals with PD showed greatest impairment in the areas related to physical and social functioning. For instance, the core features of PD such as slowness of movement and muscle stiffness could have limited their daily physical function in feeding themselves, doing household chores, etc. and thus, further affected their social interactions with others when physical movement including speech are greatly impaired [21Chu SY, Barlow SM, Lee J, Wang J. Polar-phase indices of perioral muscle reciprocity during syllable production in Parkinson’s disease. Int J Speech-Language Pathol 2017; 19(6): 616-27.[http://dx.doi.org/10.1080/17549507.2016.1265587] [PMID: 28425760] ]. However, both those with PD and the general population showed similar scores in emotional adjustment, indicating that PD interferes with various aspects of quality of life, particularly those related to physical and social functioning. By understanding an individual’s quality of life, clinicians could determine the difficulties experienced by individuals. Therefore, the PDQ-39 could be used to better understand the person's perspective of goals and disability when planning a treatment protocol that promotes the social, emotional, and physical well-being of individuals with PD [22Cruice M, Worrall L, Hickson L. Quality-of-life measurement in speech pathology and audiology. Asia Pac J Speech Lang Hear 2000; 5(1): 1-20.[http://dx.doi.org/10.1179/136132800807547546] ]. While quality of life helps evaluate an individual’s life experiences, the individual’s satisfaction about life may be measured by the life satisfaction scale, a subjective measure that focuses on one’s perspectives on life as a whole [23Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess 1985; 49(1): 71-5.[http://dx.doi.org/10.1207/s15327752jpa4901_13] [PMID: 16367493] ]. A psychological study on the elderly showed that better life satisfaction could reduce the risk of mortality by 18% [24Boehm JK, Winning A, Segerstrom S, Kubzansky LD. Variability modifies life satisfaction’s association with mortality risk in older adults. Psychol Sci 2015; 26(7): 1063-70.[http://dx.doi.org/10.1177/0956797615581491] [PMID: 26048888] ]. To date, there is no research which examines the life satisfaction levels of people with PD; their satisfaction towards life with PD is yet to be defined. It is difficult to improve life’s satisfaction when the relationship between life’s satisfaction and quality of life is not explained.

Apart from quality of life and life satisfaction level, communication is another important aspect of life. Communication is essential for social interaction and is strongly associated with the quality of life [25Cruice M. The contribution and impact of the international classification of functioning, disability and health on quality of life in communication disorders. Int J Speech-Language Pathol 2008; 10(1-2): 38-49.[http://dx.doi.org/10.1080/17549500701790520] ]. It is crucial to understand the communicative difficulties experienced by individuals, and to develop effective interventions to achieve the rehabilitative goals of improving the quality of life [11American Speech-Language-Hearing Association. Scope of Practice in Speech Language Pathology 2016 [Cited 2018] Available from 2016.http://www.asha.org/policy, 22Cruice M, Worrall L, Hickson L. Quality-of-life measurement in speech pathology and audiology. Asia Pac J Speech Lang Hear 2000; 5(1): 1-20.[http://dx.doi.org/10.1179/136132800807547546] ]. When treating patients with a progressive disorder such as PD, dealing solely with physical function is insufficient. Clinicians should take into account various life domains, including social interaction and communication factors when working with PD patients. According to the American Speech-Language-Hearing Association (2016), speech-language pathologists should address patients’ communication skills in order to increase their quality of life. However, quality of life is often overlooked by speech-language pathologists due to the absence of a conceptual relationship between communication and quality of life [25Cruice M. The contribution and impact of the international classification of functioning, disability and health on quality of life in communication disorders. Int J Speech-Language Pathol 2008; 10(1-2): 38-49.[http://dx.doi.org/10.1080/17549500701790520] ]. In fact, speech and language changes in PD have negative impacts upon individuals and their family lives before the frank impairments of intelligibility are apparent [26Miller N, Noble E, Jones D, Burn D. Life with communication changes in Parkinson’s disease. Age Ageing 2006; 35(3): 235-9.[http://dx.doi.org/10.1093/ageing/afj053] [PMID: 16540492] ]. One common way to assess patients’ speech intelligibility is by using a self-rating scale. Self-rating of speech performance was designed to measure an individual’s perception of his or her speech performance to measure the outcomes of speech treatment such as stuttering and motor speech disorders [27Block S, Onslow M, Packman A, Gray B, Dacakis G. Treatment of chronic stuttering: Outcomes from a student training clinic. Int J Lang Commun Disord 2005; 40(4): 455-66.[http://dx.doi.org/10.1080/03093640500088161] [PMID: 16195200] -29Hartelius L, Elmberg M, Holm R, Lovberg AS, Nikolaidis S. Living with dysarthria: Evaluation of a self-report questionnaire. Folia Phoniatr Logop 2008; 60(1): 11-9.[http://dx.doi.org/10.1159/000111799] [PMID: 18057906] ].

Although speech-language pathologists have been practicing in Malaysia for over 20 years, no research has been conducted to determine the quality of life and communication component of individuals with PD [30Ahmad K, Ibrahim H, Othman BF, Vong E. Addressing education of speech-language pathologists in the World Report on Disability: Development of a speech-language pathology program in Malaysia. Int J Speech-Language Pathol 2013; 15(1): 37-41.[http://dx.doi.org/10.3109/17549507.2012.757709] [PMID: 23323816] ]. Hence, this research had three goals. First, to compare the quality of life of individuals with PD with healthy controls. Second, to determine if the communication component of the Parkinson’s Disease Questionnaire (PDQ-39) differed between these two groups. Third, to evaluate the relationship between QOL, age, gender, duration of disease, Self-Rated Speech Scale (SRSS), and Life Satisfaction Scale (LSS) for the PD group.

2. METHODS

2.1. Participants

A total of 55 individuals with PD and 55 non-PD healthy control adults participated in this study. One of the PD participants was excluded because subject did not complete all questions in the survey package. Hence, data from 54 individuals with PD and 55 controls were compared. Of PD participants, 94% were active members of the Malaysia Parkinson’s Disease Association (MPDA). All PD patients were diagnosed by neurologists. The remaining 6% of PD participants and all of the control participants were recruited through word of mouth and advertisement at the University’s Audiology and Speech Sciences Clinic. Ethics approval for this study was obtained from the National Universiti Kebangsaan Malaysia Board of Ethics. All participants provided informed consent before participating in the study.

2.2. Measures

2.2.1. Parkinson’s Disease Questionnaire (PDQ-39)

The Parkinson’s Disease Questionnaire (PDQ- 39) (Isis Innovation Limited 1998) was used to compare the quality of life of individuals with PD and controls across eight dimensions: mobility (10 items), activities of daily living (6 items), emotional well-being (6 items), stigma (4 items), social support (3 items), cognitions (4 items), communication (3 items), and bodily discomfort (3 items). The PDQ-39 consists of 39 items, presented with a 5-point ordinal Likert scale (0 = never, 1 = occasionally, 2 =sometimes, 3 = often, 4 = always). Each dimension score was calculated, and the total score was computed into the PD Summary Index score (PDSI). A lower PDSI score indicates a better quality of life and vice versa. The PDQ- 39 has been tested for validity and reliability [17Martinez-Martin P, Jeukens-Visser M, Lyons KE, et al. Health-related quality-of-life scales in Parkinson’s disease: Critique and recommendations. Mov Disord 2011; 26(13): 2371-80.[http://dx.doi.org/10.1002/mds.23834] [PMID: 21735480] ], with a satisfactory level of internal consistency, content and convergent validity, and stability [19Jenkinson C, Fitzpatrick R, Peto V, Greenhall R, Hyman N. The Parkinson’s Disease Questionnaire (PDQ-39): Development and validation of a Parkinson’s disease summary index score. Age Ageing 1997; 26(5): 353-7.[http://dx.doi.org/10.1093/ageing/26.5.353] [PMID: 9351479] , 31Damiano AM, McGrath MM, Willian MK, et al. Evaluation of a measurement strategy for Parkinson’s disease: Assessing patient health-related quality of life. Qual Life Res 2000; 9(1): 87-100.[http://dx.doi.org/10.1023/A:1008928321652] [PMID: 10981209] ].

2.3. Procedure

A survey package with an information sheet, consent form, demographic sheet, and PDQ-39 was distributed by hand to each participant. Additionally, the participants were requested to rate their perceptions of their speech intelligibility [Self-Rated Speech Scale (SRSS)] and their life satisfaction level [Life Satisfaction Scale (LSS)]. The SRSS consists of an ordinal 10-point scale (1 = excellent, 10 = worst) to “Grade your speech after having Parkinson’s disease.” Similarly, the LSS stated, “Grade your life satisfaction after you have Parkinson’s disease” on a scale with “1” indicating ‘excellent’, and “10” indicating ‘worst’. The PD participants were asked to complete the survey based on their latest one-month experience of PD, whereas the control group was requested to complete the questionnaire by reflecting on their daily experiences. To examine the reliability of the PDQ-39, twelve participants were asked to refill the PDQ-39 form across a period of 2.5 weeks. Spearman’s correlation was selected to examine reliability, and the result showed that the PDQ-39 is moderately reliable (r= 0.60, p= 0.041) [32Mukaka MM. Statistics corner: A guide to appropriate use of correlation coefficient in medical research. Malawi Med J 2012; 24(3): 69-71.[PMID: 23638278] ].

2.4. Data Analysis

The descriptive statistic for the demographic information was calculated for both groups. Mann-Whitney U tests were used because data were non-normally distributed for both PD [Kolmogorov-Smirnov D (54) = 0.147, p = 0.004] and control groups [Kolmogorov-Smirnov D (54) = 0.140, p = 0.009]. The similar test (Mann-Whitney U tests) was used to examine the difference of the item's score for the Communication Dimension. The three items (“Had difficulty with your speech?”, “Felt unable to communicate with people properly?”, “Felt ignored by people?”) that examined the Communication dimension in the PDQ-39 form were compared between groups. Additionally, Spearman correlation was conducted between the PDSI score and the age, gender, SRSS, and the LSS, for PD group.

3. RESULTS

3.1. Demographic Data

PD participants were aged between 45 and 86 years (Mean= 66.75, SD= 7.35). Among them, 25 (45%) were males, and 30 were females (55%). The non-PD control group were aged between 53 and 85 years (Mean= 65.25, SD= 7.50), and included 28 males (51%) and 27 females (49%). An independent samples t-test showed a non-significant difference in age between the PD and control groups, t (110) = 1.05, p = 0.30. Additionally, a non-significant difference in gender was found between groups, t (110) = 0.33, p = 0.70. Only ethnic Chinese (PD group= 85%) and Indians were recruited into this current study as Malays are not active members of the MPDA. Employment status differed significantly, with a notably higher number of participants unemployed in both groups (PD= 84% unemployed, control= 56% unemployed), X2(1) = 11.28, p< .001).

3.2. PDQ-39

The Parkinson’s disease questionnaire summary index (PDSI) mean score for the PD group (Mean= 31.38; SE= 2.34) was higher than the control group (Mean= 11.75; SE= 1.46), suggesting that the PD group had a poorer quality of life. Additionally, all of these dimensions were significantly different between groups, except for the social support dimension (U= 1199.00, p= 0.05, (Table 1). Specifically, the PD and control groups had an average score of 19.24 (SE= 2.66) and 11.97 (SE= 2.05) respectively. Additionally, the three items (“Had difficulty with your speech?”, “Felt unable to communicate with people properly?”, “Felt ignored by people?”) that examined the Communication Dimension in the PDQ-39 form were compared between groups (Table 2). All three items showed significant differences between the PD and control groups (p< 0.001). More specifically, the PD group reported a higher mean score (Mean= 1.47, SE= 0.16) on the item 34 “Had difficulty with your speech?” than those in the control (Mean= 0.27, SE= 0.09) group.

Table 1
Mann-Whitney values across the PDQ-39 for the PD group.


Table 2
Mann Whitney values on Communication Dimension.


3.3. Correlations Between PDQ-39, Age, Gender, Duration of PD, SRSS, and LSS

The Spearman correlation coefficient of the relationship between PDQ-39, age, gender, duration of PD, SRSS, and LSS is tabulated in Table 3. Overall, age, gender, and duration of disease show no significant correlation with PDQSI score. However, the SRSS (rho= 0.329, p< 0.05, mean=5.41, SD=2.14) and the LSS (rho= 0.464, p< 0.001, mean=4.95, SD=2.16) were moderately positively correlated to the PDQSI score. A strong correlation was considered to be over 0.60, a moderate correlation between 0.30 and 0.60, and a low correlation is below 0.30 [33Hinkle DE, Wiersma W, Jurs SG. Applied statistics for the behavioral sciences 5th ed. 5th ed.2003.].

Table 3
Correlation of PDSI score with age, gender, duration of PD, SRSS, and LSS.


4. DISCUSSION

To our knowledge, this is the first study evaluating QOL and subjective self-rated speech intelligibility in patients with PD in comparison with a control group in Malaysia. Consistent with the previous research, our findings showed that the PD group scored higher in PDSI scores than the control group [21Chu SY, Barlow SM, Lee J, Wang J. Polar-phase indices of perioral muscle reciprocity during syllable production in Parkinson’s disease. Int J Speech-Language Pathol 2017; 19(6): 616-27.[http://dx.doi.org/10.1080/17549507.2016.1265587] [PMID: 28425760] , 34Karlsen KH, Larsen JP, Tandberg E, Maeland JG. Influence of clinical and demographic variables on quality of life in patients with Parkinson’s disease. J Neurol Neurosurg Psychiatry 1999; 66(4): 431-5.[http://dx.doi.org/10.1136/jnnp.66.4.431] [PMID: 10201412] ]. Individuals with PD had worse QOL scores in all dimensions than the control population, indicating that individuals with PD tend to have a lower quality of life than controls. Although PD and control groups had significant differences in mobility, activities of daily living, emotional, stigma, cognition, communication, and bodily discomfort scores as reported in the PDQ-39, such group differences were not observed in the social support dimension. This result might be due to the sample recruitment location, given that 96% of the participants were recruited from a support group. The present data indicate that participation in a support group provides benefits in improving their social support. Indeed, previous studies have shown that members of a PD support group would have greater acceptance of the disease and cope better with difficulties in life than non-members [35Barak A, Boniel-Nissim M, Suler J. Fostering empowerment in online support groups. Comput Human Behav 2008; 24(5): 1867-83.[http://dx.doi.org/10.1016/j.chb.2008.02.004] -37van Uden-Kraan CF, Drossaert CH, Taal E, Shaw BR, Seydel ER, van de Laar MA. Empowering processes and outcomes of participation in online support groups for patients with breast cancer, arthritis, or fibromyalgia. Qual Health Res 2008; 18(3): 405-17.[http://dx.doi.org/10.1177/1049732307313429] [PMID: 18235163] ]. Further research is warranted to determine whether social support is more positive for those who participated in the self-help group than those who do not.

In PD, speech impairment often leads to communication difficulties and affect participation in life, and quality of life [7Takahashi K, Kamide N, Suzuki M, Fukuda M. Quality of life in people with Parkinson’s disease: The relevance of social relationships and communication. J Phys Ther Sci 2016; 28(2): 541-6.[http://dx.doi.org/10.1589/jpts.28.541] [PMID: 27065542] ]. This was supported by our finding that individuals with PD struggle with more communication issues than the control group. Additionally, PD participants who have a better perception of their speech intelligibility (i.e., lower scores on the SRSS) tend to have a better quality of life and vice versa. This suggests that the feeling of being “able to communicate” is important in maintaining social relationships with one’s family and relatives, and “feeling accepted by others” is important because it provides patients with feelings of acceptance and assurance. Again, communication deficits appear to be a significant concern in individuals with PD because they might limit their social relationships [20Schrag A, Jahanshahi M, Quinn N. How does Parkinson’s disease affect quality of life? A comparison with quality of life in the general population. Mov Disord 2000; 15(6): 1112-8.[http://dx.doi.org/10.1002/1531-8257(200011)15:6<1112::AID-MDS1008>3.0.CO;2-A] [PMID: 11104193] , 38McAuliffe MJ, Baylor CR, Yorkston KM. Variables associated with communicative participation in Parkinson’s disease and its relationship to measures of health-related quality-of-life. Int J Speech-Language Pathol 2017; 19(4): 407-17.[http://dx.doi.org/10.1080/17549507.2016.1193900] [PMID: 27347713] ]. As such, poor speech intelligibility in individuals with PD could lead to social exclusion, which can negatively affect their health and well-being due to increasing allostatic load [39Simandan D. Rethinking the health consequences of social class and social mobility. Soc Sci Med 2018; 200: 258-61.[http://dx.doi.org/10.1016/j.socscimed.2017.11.037] [PMID: 29301638] ]. The allostatic load theory aims to explain the physiological mechanisms that lead from various stressors experienced over the lifespan [40Simandan D. On how much one can take: Relocating exploitation and exclusion within the broader framework of allostatic load theory. Health Place 2010; 16(6): 1291-3.[http://dx.doi.org/10.1016/j.healthplace.2010.08.009] [PMID: 20813575] ]. However, some participants also reported that communication does not affect their overall quality of life. One possibility is that this claim might result from lack of clarity in the SRSS scale. More specifically, some participants reported that they were unsure how to answer this question. The research team is aware that PD patients are seldom asked to judge their speech in clinical settings. For all of our participants, this appears to be the first time they had been asked to judge their speech using the SRSS scale. Given that communication difficulties affect quality of life, clinicians should take into account the need to educate patients to rate their speech, particularly when considering their speech intelligibility expectations. Future studies in this population should include both subjective and objective speech measurements that provide more clinical data assessing the relationship between speech intelligibility and quality of life. This could guide clinicians to better understand their clients’ needs when providing speech treatment to increase their quality of life and enhance good practice standards, as required by the Speech Therapist’s professional’s guidelines [41Ahmad K. Discharging patients: A perspective from speech-language pathologists working in public hospitals in malaysia. Int J Speech-Language Pathol 2010; 12(4): 317-9.[http://dx.doi.org/10.3109/17549507.2010.483017] [PMID: 20590514] ].

In general, age and gender showed no significant correlation with the PDSI score, indicating that the PDQ-39 is an age- and gender-free survey. In addition, the non-significant correlation between the duration of disease and the PDSI score implies that the PDQ-39 is a quality of life measurement for PD patients regardless of the duration of the patient having the disease. However, this was not the case for life satisfaction levels. Respondents from this study reported a moderate correlation between the LSS and PDSI scores, indicating that life satisfaction could affect their quality of life. Additionally, when asked to fill in the life-satisfaction scale, approximately 80% of the participants commented that their life-satisfaction level is greatly affected by their medication. For instance, patients with inconsistent medication effects would report lower life-satisfaction scales than those who are more consistently responsive to drugs. It seems that medication effects significantly affect these patients’ levels of quality of life [42Hashim H, Azmin S, Razlan H, et al. Eradication of Helicobacter pylori infection improves levodopa action, clinical symptoms and quality of life in patients with Parkinson’s disease. PLoS One 2014; 9(11): e112330.[http://dx.doi.org/10.1371/journal.pone.0112330] [PMID: 25411976] ].

5. LIMITATIONS

Two limitations are relevant to the present study. First, PD participants were instructed to fill in this survey based on their impression of the ‘medication ON’ stage. Results reported in this current study do not reflect their quality of life levels at the ‘medication OFF’ stage. Most of the participants commented that they have different performances depending on whether medication is ON or OFF state. Future studies should compare the QOL of PD participants during both medications ON and OFF states to determine whether medication stage affects an individual’s overall quality of life. Further analysis, such as the Bayes methods, could be conducted to expand the scope of our research question to better understand the factors that could affect quality of life levels at medication ON vs OFF stages in these patients [43Goodman SN. Toward evidence-based medical statistics. 1: The P value fallacy. Ann Intern Med 1999; 130(12): 995-1004.[http://dx.doi.org/10.7326/0003-4819-130-12-199906150-00008] [PMID: 10383371] , 44Goodman SN. Toward evidence-based medical statistics. 2: The Bayes factor. Ann Intern Med 1999; 130(12): 1005-13.[http://dx.doi.org/10.7326/0003-4819-130-12-199906150-00019] [PMID: 10383350] ].

Second, some participants commented that two items from the PDQ-39 (item 2- “Had difficulty looking after your home, e.g. DIY (Do-It-Yourself), housework, cooking?”) and (item 15- “Had difficulty cutting up your food?”) might not be culturally appropriate. In Malaysian culture, the term “DIY” is not in common daily usage, particularly by the elderly. Additionally, the term “look after” does not typically include cooking or housework; it means to keep an eye on the home from robbery or fire by most of the participants. For item 15, “cutting up food” using fork and knife is not part of Malaysian culture. Malays and Indians use their right hands without utensils during meals, while the Chinese use chopsticks or spoons and forks. Most of the participants commented that they do not need to cut their food with a knife while eating. A slight modification of these two items to become more culturally appropriate would also increase clarity in future studies.

CONCLUSION

The present study shows that PD patients have a lower quality of life than the general public, and demonstrated that PD support groups could help to improve social support. This study also indicates that the PDQ-39 is an age- and gender-free survey. In addition, the duration of having PD does not affect quality of life as measured by the PDQ-39 in the current sample. It was also found that medication responsiveness may be one factor that influences life satisfaction and quality of life. Given that SRSS and quality of life scores are moderately correlated, identifying patients’ perceptions of their speech intelligibility could help clinicians to better understand patients’ needs during speech therapy. Future studies should examine the effects of medication, SRSS, and LSS on the quality of life of PD patients to provide a high quality of service delivery.

ETHICS APPROVAL AND CONSENT TO PARTICIPATE

This study was approved by the Research Ethics Committees, Universiti Kebangsaan Malaysia.

HUMAN AND ANIMAL RIGHTS

No animals/humans were used for studies that are the basis of this research.

CONSENT FOR PUBLICATION

For the consent, one-page subject information sheet and informed consent letter were attached to each questionnaire and it explained that participation was voluntary, confidential, and no risk or harm, and any demanding privacy were respected.

CONFLICT OF INTEREST

The authors declare no conflict of interest, financial or otherwise.

ACKNOWLEDGEMENTS

This study was supported in part by the UKM Young Researcher Research Grant GGPM-2016-070 (first author). The authors wish to thank all the participants for taking part in this study. A special thanks to Kai Shuo Cho for his assistance in data collection.

REFERENCES

[1] Parkinson’s disease Foundation. Statistics on Parkinson’s 2016. cited 2016http://www.pdf.org/en/parkinson_statistics
[2] National Institute of Neurological Disorders and Stroke. Parkinson's Disease: Challenges, Progress, and Promise. Sept 1, [cited 2016] Available from: 2016.https://www.ninds.nih.gov/Disorders/All-Disorders/NINDS-Parkinsons-Disease-Information-Page/Parkinsons-Disease-Challenges
[3] Azmin S, Khairul Anuar AM, Tan HJ, et al. Nonmotor symptoms in a malaysian Parkinson’s disease population. Parkinsons Dis 2014; 2014: 472157.[http://dx.doi.org/10.1155/2014/472157] [PMID: 24800102]
[4] Ramig LO, Fox C, Sapir S. Speech treatment for Parkinson’s disease. Expert Rev Neurother 2008; 8(2): 297-309.[http://dx.doi.org/10.1586/14737175.8.2.297] [PMID: 18271714]
[5] Theodoros DG, Hill AJ, Russell TG. Clinical and quality of life outcomes of speech treatment for Parkinson’s disease delivered to the home via telerehabilitation: A noninferiority randomized controlled trial. Am J Speech Lang Pathol 2016; 25(2): 214-32.[http://dx.doi.org/10.1044/2015_AJSLP-15-0005] [PMID: 27145396]
[6] Lirani-Silva C, Mourão LF, Gobbi LT. Dysarthria and quality of life in neurologically healthy elderly and patients with Parkinson’s disease. CoDAS 2015; 27(3): 248-54.[http://dx.doi.org/10.1590/2317-1782/20152014083] [PMID: 26222941]
[7] Takahashi K, Kamide N, Suzuki M, Fukuda M. Quality of life in people with Parkinson’s disease: The relevance of social relationships and communication. J Phys Ther Sci 2016; 28(2): 541-6.[http://dx.doi.org/10.1589/jpts.28.541] [PMID: 27065542]
[8] van Uem JM, Marinus J, Canning C, et al. Health-Related quality of life in patients with Parkinson’s disease- A systematic review based on the ICF model. Neurosci Biobehav Rev 2016; 61: 26-34.[http://dx.doi.org/10.1016/j.neubiorev.2015.11.014] [PMID: 26645499]
[9] Sawada Y, Shinohara R, Sugisawa Y, et al. The relation between the maintenance of physical functions and social interaction among community-dwelling elderly people: A six-year follow-up study. J Phys Ther Sci 2011; 23(2): 171-5.[http://dx.doi.org/10.1589/jpts.23.171]
[10] Cholewa J, Gorzkowska A, Szepelawy M, Nawrocka A, Cholewa J. Influence of functional movement rehabilitation on quality of life in people with Parkinson’s disease. J Phys Ther Sci 2014; 26(9): 1329-31.[http://dx.doi.org/10.1589/jpts.26.1329] [PMID: 25276010]
[11] American Speech-Language-Hearing Association. Scope of Practice in Speech Language Pathology 2016 [Cited 2018] Available from 2016.http://www.asha.org/policy
[12] Martinez-Martin P, Rodriguez-Blazquez C, Kurtis MM, Chaudhuri KR. The impact of non-motor symptoms on health-related quality of life of patients with Parkinson’s disease. Mov Disord 2011; 26(3): 399-406.[http://dx.doi.org/10.1002/mds.23462] [PMID: 21264941]
[13] Razali R, Ahmad F, Rahman FN, Midin M, Sidi H. Burden of care among caregivers of patients with Parkinson disease: A cross-sectional study. Clin Neurol Neurosurg 2011; 113(8): 639-43.[http://dx.doi.org/10.1016/j.clineuro.2011.05.008] [PMID: 21684679]
[14] The World Health Organization quality of life assessment (WHOQOL): Position paper from the World Health Organization. Soc Sci Med 1995; 41(10): 1403-9.[http://dx.doi.org/10.1016/0277-9536(95)00112-K] [PMID: 8560308]
[15] Scheife RT, Schumock GT, Burstein A, Gottwald MD, Luer MS. Impact of Parkinson’s disease and its pharmacologic treatment on quality of life and economic outcomes. Am J Health Syst Pharm 2000; 57(10): 953-62.[PMID: 10832495]
[16] Higginson IJ, Carr AJ. Using quality of life measures in the clinical setting (Measuring Quality of Life, part 2). BMJ 2013; 22: 1297-304.
[17] Martinez-Martin P, Jeukens-Visser M, Lyons KE, et al. Health-related quality-of-life scales in Parkinson’s disease: Critique and recommendations. Mov Disord 2011; 26(13): 2371-80.[http://dx.doi.org/10.1002/mds.23834] [PMID: 21735480]
[18] Peto V, Jenkinson C, Fitzpatrick R, Greenhall R. The development and validation of a short measure of functioning and well being for individuals with Parkinson’s disease. Qual Life Res 1995; 4(3): 241-8.[http://dx.doi.org/10.1007/BF02260863] [PMID: 7613534]
[19] Jenkinson C, Fitzpatrick R, Peto V, Greenhall R, Hyman N. The Parkinson’s Disease Questionnaire (PDQ-39): Development and validation of a Parkinson’s disease summary index score. Age Ageing 1997; 26(5): 353-7.[http://dx.doi.org/10.1093/ageing/26.5.353] [PMID: 9351479]
[20] Schrag A, Jahanshahi M, Quinn N. How does Parkinson’s disease affect quality of life? A comparison with quality of life in the general population. Mov Disord 2000; 15(6): 1112-8.[http://dx.doi.org/10.1002/1531-8257(200011)15:6<1112::AID-MDS1008>3.0.CO;2-A] [PMID: 11104193]
[21] Chu SY, Barlow SM, Lee J, Wang J. Polar-phase indices of perioral muscle reciprocity during syllable production in Parkinson’s disease. Int J Speech-Language Pathol 2017; 19(6): 616-27.[http://dx.doi.org/10.1080/17549507.2016.1265587] [PMID: 28425760]
[22] Cruice M, Worrall L, Hickson L. Quality-of-life measurement in speech pathology and audiology. Asia Pac J Speech Lang Hear 2000; 5(1): 1-20.[http://dx.doi.org/10.1179/136132800807547546]
[23] Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess 1985; 49(1): 71-5.[http://dx.doi.org/10.1207/s15327752jpa4901_13] [PMID: 16367493]
[24] Boehm JK, Winning A, Segerstrom S, Kubzansky LD. Variability modifies life satisfaction’s association with mortality risk in older adults. Psychol Sci 2015; 26(7): 1063-70.[http://dx.doi.org/10.1177/0956797615581491] [PMID: 26048888]
[25] Cruice M. The contribution and impact of the international classification of functioning, disability and health on quality of life in communication disorders. Int J Speech-Language Pathol 2008; 10(1-2): 38-49.[http://dx.doi.org/10.1080/17549500701790520]
[26] Miller N, Noble E, Jones D, Burn D. Life with communication changes in Parkinson’s disease. Age Ageing 2006; 35(3): 235-9.[http://dx.doi.org/10.1093/ageing/afj053] [PMID: 16540492]
[27] Block S, Onslow M, Packman A, Gray B, Dacakis G. Treatment of chronic stuttering: Outcomes from a student training clinic. Int J Lang Commun Disord 2005; 40(4): 455-66.[http://dx.doi.org/10.1080/03093640500088161] [PMID: 16195200]
[28] Block S, Onslow M, Packman A, Gray B, Dacakis G. Treatment of chronic stuttering: Outcomes from a student training clinic. Int J Lang Commun Disord 2005; 40(4): 455-66.[http://dx.doi.org/10.1080/03093640500088161] [PMID: 16195200]
[29] Hartelius L, Elmberg M, Holm R, Lovberg AS, Nikolaidis S. Living with dysarthria: Evaluation of a self-report questionnaire. Folia Phoniatr Logop 2008; 60(1): 11-9.[http://dx.doi.org/10.1159/000111799] [PMID: 18057906]
[30] Ahmad K, Ibrahim H, Othman BF, Vong E. Addressing education of speech-language pathologists in the World Report on Disability: Development of a speech-language pathology program in Malaysia. Int J Speech-Language Pathol 2013; 15(1): 37-41.[http://dx.doi.org/10.3109/17549507.2012.757709] [PMID: 23323816]
[31] Damiano AM, McGrath MM, Willian MK, et al. Evaluation of a measurement strategy for Parkinson’s disease: Assessing patient health-related quality of life. Qual Life Res 2000; 9(1): 87-100.[http://dx.doi.org/10.1023/A:1008928321652] [PMID: 10981209]
[32] Mukaka MM. Statistics corner: A guide to appropriate use of correlation coefficient in medical research. Malawi Med J 2012; 24(3): 69-71.[PMID: 23638278]
[33] Hinkle DE, Wiersma W, Jurs SG. Applied statistics for the behavioral sciences 5th ed. 5th ed.2003.
[34] Karlsen KH, Larsen JP, Tandberg E, Maeland JG. Influence of clinical and demographic variables on quality of life in patients with Parkinson’s disease. J Neurol Neurosurg Psychiatry 1999; 66(4): 431-5.[http://dx.doi.org/10.1136/jnnp.66.4.431] [PMID: 10201412]
[35] Barak A, Boniel-Nissim M, Suler J. Fostering empowerment in online support groups. Comput Human Behav 2008; 24(5): 1867-83.[http://dx.doi.org/10.1016/j.chb.2008.02.004]
[36] Charlton GS, Barrow CJ. Coping and self-help group membership in Parkinson’s disease: An exploratory qualitative study. Health Soc Care Community 2002; 10(6): 472-8.[http://dx.doi.org/10.1046/j.1365-2524.2002.00385.x] [PMID: 12485134]
[37] van Uden-Kraan CF, Drossaert CH, Taal E, Shaw BR, Seydel ER, van de Laar MA. Empowering processes and outcomes of participation in online support groups for patients with breast cancer, arthritis, or fibromyalgia. Qual Health Res 2008; 18(3): 405-17.[http://dx.doi.org/10.1177/1049732307313429] [PMID: 18235163]
[38] McAuliffe MJ, Baylor CR, Yorkston KM. Variables associated with communicative participation in Parkinson’s disease and its relationship to measures of health-related quality-of-life. Int J Speech-Language Pathol 2017; 19(4): 407-17.[http://dx.doi.org/10.1080/17549507.2016.1193900] [PMID: 27347713]
[39] Simandan D. Rethinking the health consequences of social class and social mobility. Soc Sci Med 2018; 200: 258-61.[http://dx.doi.org/10.1016/j.socscimed.2017.11.037] [PMID: 29301638]
[40] Simandan D. On how much one can take: Relocating exploitation and exclusion within the broader framework of allostatic load theory. Health Place 2010; 16(6): 1291-3.[http://dx.doi.org/10.1016/j.healthplace.2010.08.009] [PMID: 20813575]
[41] Ahmad K. Discharging patients: A perspective from speech-language pathologists working in public hospitals in malaysia. Int J Speech-Language Pathol 2010; 12(4): 317-9.[http://dx.doi.org/10.3109/17549507.2010.483017] [PMID: 20590514]
[42] Hashim H, Azmin S, Razlan H, et al. Eradication of Helicobacter pylori infection improves levodopa action, clinical symptoms and quality of life in patients with Parkinson’s disease. PLoS One 2014; 9(11): e112330.[http://dx.doi.org/10.1371/journal.pone.0112330] [PMID: 25411976]
[43] Goodman SN. Toward evidence-based medical statistics. 1: The P value fallacy. Ann Intern Med 1999; 130(12): 995-1004.[http://dx.doi.org/10.7326/0003-4819-130-12-199906150-00008] [PMID: 10383371]
[44] Goodman SN. Toward evidence-based medical statistics. 2: The Bayes factor. Ann Intern Med 1999; 130(12): 1005-13.[http://dx.doi.org/10.7326/0003-4819-130-12-199906150-00019] [PMID: 10383350]

Endorsements



"Open access will revolutionize 21st century knowledge work and accelerate the diffusion of ideas and evidence that support just in time learning and the evolution of thinking in a number of disciplines."


Daniel Pesut
(Indiana University School of Nursing, USA)

"It is important that students and researchers from all over the world can have easy access to relevant, high-standard and timely scientific information. This is exactly what Open Access Journals provide and this is the reason why I support this endeavor."


Jacques Descotes
(Centre Antipoison-Centre de Pharmacovigilance, France)

"Publishing research articles is the key for future scientific progress. Open Access publishing is therefore of utmost importance for wider dissemination of information, and will help serving the best interest of the scientific community."


Patrice Talaga
(UCB S.A., Belgium)

"Open access journals are a novel concept in the medical literature. They offer accessible information to a wide variety of individuals, including physicians, medical students, clinical investigators, and the general public. They are an outstanding source of medical and scientific information."


Jeffrey M. Weinberg
(St. Luke's-Roosevelt Hospital Center, USA)

"Open access journals are extremely useful for graduate students, investigators and all other interested persons to read important scientific articles and subscribe scientific journals. Indeed, the research articles span a wide range of area and of high quality. This is specially a must for researchers belonging to institutions with limited library facility and funding to subscribe scientific journals."


Debomoy K. Lahiri
(Indiana University School of Medicine, USA)

"Open access journals represent a major break-through in publishing. They provide easy access to the latest research on a wide variety of issues. Relevant and timely articles are made available in a fraction of the time taken by more conventional publishers. Articles are of uniformly high quality and written by the world's leading authorities."


Robert Looney
(Naval Postgraduate School, USA)

"Open access journals have transformed the way scientific data is published and disseminated: particularly, whilst ensuring a high quality standard and transparency in the editorial process, they have increased the access to the scientific literature by those researchers that have limited library support or that are working on small budgets."


Richard Reithinger
(Westat, USA)

"Not only do open access journals greatly improve the access to high quality information for scientists in the developing world, it also provides extra exposure for our papers."


J. Ferwerda
(University of Oxford, UK)

"Open Access 'Chemistry' Journals allow the dissemination of knowledge at your finger tips without paying for the scientific content."


Sean L. Kitson
(Almac Sciences, Northern Ireland)

"In principle, all scientific journals should have open access, as should be science itself. Open access journals are very helpful for students, researchers and the general public including people from institutions which do not have library or cannot afford to subscribe scientific journals. The articles are high standard and cover a wide area."


Hubert Wolterbeek
(Delft University of Technology, The Netherlands)

"The widest possible diffusion of information is critical for the advancement of science. In this perspective, open access journals are instrumental in fostering researches and achievements."


Alessandro Laviano
(Sapienza - University of Rome, Italy)

"Open access journals are very useful for all scientists as they can have quick information in the different fields of science."


Philippe Hernigou
(Paris University, France)

"There are many scientists who can not afford the rather expensive subscriptions to scientific journals. Open access journals offer a good alternative for free access to good quality scientific information."


Fidel Toldrá
(Instituto de Agroquimica y Tecnologia de Alimentos, Spain)

"Open access journals have become a fundamental tool for students, researchers, patients and the general public. Many people from institutions which do not have library or cannot afford to subscribe scientific journals benefit of them on a daily basis. The articles are among the best and cover most scientific areas."


M. Bendandi
(University Clinic of Navarre, Spain)

"These journals provide researchers with a platform for rapid, open access scientific communication. The articles are of high quality and broad scope."


Peter Chiba
(University of Vienna, Austria)

"Open access journals are probably one of the most important contributions to promote and diffuse science worldwide."


Jaime Sampaio
(University of Trás-os-Montes e Alto Douro, Portugal)

"Open access journals make up a new and rather revolutionary way to scientific publication. This option opens several quite interesting possibilities to disseminate openly and freely new knowledge and even to facilitate interpersonal communication among scientists."


Eduardo A. Castro
(INIFTA, Argentina)

"Open access journals are freely available online throughout the world, for you to read, download, copy, distribute, and use. The articles published in the open access journals are high quality and cover a wide range of fields."


Kenji Hashimoto
(Chiba University, Japan)

"Open Access journals offer an innovative and efficient way of publication for academics and professionals in a wide range of disciplines. The papers published are of high quality after rigorous peer review and they are Indexed in: major international databases. I read Open Access journals to keep abreast of the recent development in my field of study."


Daniel Shek
(Chinese University of Hong Kong, Hong Kong)

"It is a modern trend for publishers to establish open access journals. Researchers, faculty members, and students will be greatly benefited by the new journals of Bentham Science Publishers Ltd. in this category."


Jih Ru Hwu
(National Central University, Taiwan)


Browse Contents



Advertisements


Webmaster Contact: info@benthamopen.com
Copyright © 2018 Bentham Open