The Open Microbiology Journal




ISSN: 1874-2858 ― Volume 13, 2019
RESEARCH ARTICLE

Use of Proviral DNA to Investigate Virus Resistance Mutations in HIV-infected Zimbabweans



Tutsirai V. Musingwini1, Danai T. Zhou1, 2, *, Doreen Mhandire3, Kerina Duri4, Exnevia Gomo1, Olav Oktedalen5, Benjamin Chimukangara6, Tinei Shamu7, Sandra Shawarira-Bote7, Collet Dandara8, Babill Stray-Pedersen9
1 University of Zimbabwe, College of Health Sciences, Department of Medical Laboratory Sciences, Harare, Zimbabwe
2 Institute of Clinical Medicine, University in Oslo, Oslo University Hospital, Oslo, Norway
3 University of Zimbabwe, College of Health Sciences, Department of Chemical Pathology, Harare, Zimbabwe
4 Universisty of Zimbabwe, College of Health Sciences, Department of Immunology, Harare, Zimbabwe
5 Department of Infectious Diseases, Oslo University Hospital, Oslo, Norway
6 Africa Centre for Health and Population Studies, University of KwaZulu-Natal, KwaZulu-Natal, South Africa
7 Newlands Clinic, Newlands, Harare, Zimbabwe
8 Division of Human Genetics, Department of Clinical Laboratory Sciences & Institute for Infectious Disease and Molecular Medicine, Faculty of Health Sciences, University of Cape Town, Cape Town, South Africa
9 Institute of Clinical Medicine, University in Oslo and Women’s Clinic, Oslo University Hospital, Oslo, Norway

Abstract

Background:

Antiretroviral therapy (ART) to suppress HIV replication has reduced morbidity and mortality yet effectiveness of current HIV drugs is threatened by HIV drug resistance (HIVDR) mutations.

Objective:

To determine HIVDR mutations using proviral DNA from specimens of patients presenting to an HIV treatment clinic.

Methods:

DNA from 103 patients, 86 treatment-experienced, 17 treatment-naïve, were genotyped for the HIV-1C reverse transcriptase gene (RT; codons 21-304) using Sanger sequencing and sequences analyzed using Sequencher software. Resistance mutations were interpreted using Stanford HIVDR reference database.

Results:

Median age was 39 (IQR, 33-46) years and 80% of patients were female. Six-percent (n=6) had at least one HIVDR mutation, comprising NRTI-associated mutations, (M184V, T69D, T69N and V75I); NNRTI-associated mutations (G190A, K103N, V106M, Y181C) and thymidine analogue associated mutations (D67N, K70R, K219Q, L210W, M41L, T215Y). Of the six participants, with at least one HIVDR mutation, all were treatment experienced, five were on tenofovir, lamivudine and nevirapine and one was on tenofovir, lamivudine and atazanavir. There was no difference in median CD4 count and viral loads when patients were compared by presence of HIVDR mutations.

Conclusion:

We demonstrated the use of proviral DNA in HIVDR testing in adult patients and present that all the patients with various kinds of HIVDR mutations were treatment experienced, pointing to the role of drug regimens in driving viral mutations. Thus, the use of proviral DNA has potential to help provide surveillance on risk of HIVDR in HIV-infected individuals who are on treatment, which may assist in corrective treatment.

Keywords: Drug resistance, Genotyping, HIV proviral DNA, Sequencing, Zimbabwe.


Article Information


Identifiers and Pagination:

Year: 2017
Volume: 11
First Page: 45
Last Page: 52
Publisher Id: TOMICROJ-11-45
DOI: 10.2174/1874285801711010045

Article History:

Received Date: 07/11/2016
Revision Received Date: 27/01/2017
Acceptance Date: 28/02/2017
Electronic publication date: 28/04/2017
Collection year: 2017

Article Metrics:

CrossRef Citations:
0

Total Statistics:

Full-Text HTML Views: 1704
Abstract HTML Views: 1033
PDF Downloads: 294
ePub Downloads: 262
Total Views/Downloads: 3293

Unique Statistics:

Full-Text HTML Views: 717
Abstract HTML Views: 548
PDF Downloads: 203
ePub Downloads: 170
Total Views/Downloads: 1638
Geographical View

© 2017 Musingwini et al.

open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: https://creativecommons.org/licenses/by/4.0/legalcode. This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.


* Address correspondence to this author at the University of Zimbabwe, College of Health Sciences, Department of Medical Laboratory Sciences, Institute of Clinical Medicine, University in Oslo, Oslo University Hospital, Oslo, Norway; Tel: +263 4 707 707; E-mails: danaizh@yahoo.co.uk, zhoud@africau.edu




INTRODUCTION

Historically, the human immunodeficiency virus (HIV) has infected nearly 78 million people and close to 39 million have died of acquired immunodeficiency syndrome (AIDS), to date [1UNAIDS Global report: UNAIDS report on the global AIDS pandemic (2013) UNAIDS factsheet 2013. Available at: http://www.unaids.org/sites/default/files/en/media/unaids/contentassets/documents/epidemiology/2013/gr2013/UNAIDS_Global_Report_2013_en.pdf, 2Hamers RL, Wallis CL, Kityo C, et al. HIV-1 drug resistance in antiretroviral-naive individuals in sub-Saharan Africa after rollout of antiretroviral therapy: a multicentre observational study. Lancet Infect Dis 2011; 11(10): 750-9.
[http://dx.doi.org/10.1016/S1473-3099(11)70149-9] [PMID: 21802367]
]. According to 2013 estimates, the adult prevalence of HIV in Zimbabwe was 15% affecting 1.2 million adults and 170 000 children (0-14 years) [3 Ministry of Health and Child Care Report on Zimbabwe National HIV and AIDS Estimates (2013). 2014:1-38. Available at: Ministry+of+Health+and+Child+Care+Report+on+Zimbabwe+National+HIV+and+AIDS+Estimates+2013]. In an effort to curb the pandemic, the World Health Organisation (WHO) has recommended the use of combination antiretroviral therapy (cART), with first-line regimens in adults having two nucleoside reverse-transcriptase inhibitors (NRTIs) and a non-nucleoside reverse-transcriptase inhibitor (NNRTI). Ritonavir-boosted protease inhibitors (bPIs) are preferred in second-line regimens, in place of NNRTIs [4Zimbabwe National HIV and AIDS Strategic Plan (ZNASP) 2006-2010 Available at: http://www.safaids.net/files/ZNASP 2006-2010.pdf, 5 National Medicine and Therapeutics Policy Advisory Committee (NMTPAC) and the AIDS and TB Directorate, Ministry of Health and Child Care, (2013) Guidelines for Antiretroviral Therapy for the Prevention and Treatment of HIV in Guidelines for Prevention and Treatment of HIV in Zimbabwe. Available at: http://preventcrypto.org/wp-content/uploads/2012/07/Zimbabwe-National-ART-guidelines-2-1.pdf].

In line with these recommendations, the Zimbabwean government through the Ministry of Health and Child Care (MOHCC) first introduced the national antiretroviral treatment (ART) program in 2004, which was providing approximately 581 801 adults with ART by 2012 [5 National Medicine and Therapeutics Policy Advisory Committee (NMTPAC) and the AIDS and TB Directorate, Ministry of Health and Child Care, (2013) Guidelines for Antiretroviral Therapy for the Prevention and Treatment of HIV in Guidelines for Prevention and Treatment of HIV in Zimbabwe. Available at: http://preventcrypto.org/wp-content/uploads/2012/07/Zimbabwe-National-ART-guidelines-2-1.pdf, 6Dzangare J, Gonese E, Mugurungi O, et al. Monitoring of early warning indicators for HIV drug resistance in antiretroviral therapy clinics in Zimbabwe. Clin Infect Dis 2012; 54(Suppl. 4): S313-6.
[http://dx.doi.org/10.1093/cid/cir1014] [PMID: 22544194]
]. Estimates showed that 962 779 people including 104 937 children were in need of ART in Zimbabwe in 2013 (based on CD4 counts ≤ 350 cells/ml), and projections showed that the number of people in need of ART will increase to 1.3 million and 1.4 million in 2014 and 2015, respectively [5 National Medicine and Therapeutics Policy Advisory Committee (NMTPAC) and the AIDS and TB Directorate, Ministry of Health and Child Care, (2013) Guidelines for Antiretroviral Therapy for the Prevention and Treatment of HIV in Guidelines for Prevention and Treatment of HIV in Zimbabwe. Available at: http://preventcrypto.org/wp-content/uploads/2012/07/Zimbabwe-National-ART-guidelines-2-1.pdf]. With the rapid scale up of ART over the years, the emergence of antiretroviral (ARV) drug resistance mutations in Zimbabwe has been inevitable as in any other settings [7Marcelin AG. Resistance to nucleoside reverse transcriptase inhibitors. In: Geretti AM, Ed. Antiretroviral Resistance in Clinical Practise. London: Mediscript 2006. Available at: http://www.ncbi.nlm.nih.gov/books/NBK2241/., 8Paraschiv S, Otelea D, Baicus C, Tinischi M, Costache M, Neaga E. Nucleoside reverse transcriptase inhibitor resistance mutations in subtype F1 strains isolated from heavily treated adolescents in Romania. Int J Infect Dis 2009; 13(1): 81-9.
[http://dx.doi.org/10.1016/j.ijid.2008.03.032] [PMID: 18632295]
]. Treatment failure may result from acquired drug resistant mutations due to ARV drug pressure and such variants of the virus can also be transmitted to newly infected individuals who are not yet on ART as transmitted drug resistance [9Bennett DE, Camacho RJ, Otelea D, et al. Drug resistance mutations for surveillance of transmitted HIV-1 drug-resistance: 2009 update. PLoS One 2009; 4(3): e4724.
[http://dx.doi.org/10.1371/journal.pone.0004724] [PMID: 19266092]
, 10Zdanowicz MM. The pharmacology of HIV drug resistance. Am J Pharm Educ 2006; 70(5): 100.
[http://dx.doi.org/10.5688/aj7005100] [PMID: 17149429]
].

Findings from the PharmAccess African Studies to Evaluate Resistance Monitoring (PASERM) among 2 436 antiretroviral-naive individuals in 11 geographic areas in Kenya, Nigeria, South Africa, Uganda, Zambia and Zimbabwe showed overall baseline prevalence of acquired drug resistance mutations (DRMs) of 5.6% [CI: 4.6 - 6.7] in 2007-2009 [11Hamers RL, Sigaloff KC, Kityo C, Mugyenyi P, de Wit TF. Emerging HIV-1 drug resistance after roll-out of antiretroviral therapy in sub-Saharan Africa. Curr Opin HIV AIDS 2013; 8(1): 19-26.
[http://dx.doi.org/10.1097/COH.0b013e32835b7f94]
]. The most commonly occurring mutations were the NNRTI mutation K103N (1.8%), thymidine analog mutation (TAM): M41L (1.6%) and NRTI mutation M184V (1.2%).

TAMs result in multi-nucleoside resistance [12Wang Y, Xing H, Liao L, et al. The development of drug resistance mutations K103N Y181C and G190A in long term Nevirapine-containing antiviral therapy. AIDS Res Ther 2014; 11: 36.
[http://dx.doi.org/10.1186/1742-6405-11-36] [PMID: 25926857]
, 13Bocket L, Yazdanpanah Y, Ajana F, et al. Thymidine analogue mutations in antiretroviral-naive HIV-1 patients on triple therapy including either zidovudine or stavudine. J Antimicrob Chemother 2004; 53(1): 89-94.
[http://dx.doi.org/10.1093/jac/dkh006] [PMID: 14645320]
], K103N and Y181C mutations cause high-level resistance to efavirenz (EFV) and nevirapine (NVP) [14Taiwo B. Understanding transmitted HIV resistance through the experience in the USA. Int J Infect Dis 2009; 13(5): 552-9.
[http://dx.doi.org/10.1016/j.ijid.2008.10.008] [PMID: 19136289]
], whilst M184V causes high-level resistance to lamivudine (3TC) and rapidly emerges in patients on 3TC regimens [12Wang Y, Xing H, Liao L, et al. The development of drug resistance mutations K103N Y181C and G190A in long term Nevirapine-containing antiviral therapy. AIDS Res Ther 2014; 11: 36.
[http://dx.doi.org/10.1186/1742-6405-11-36] [PMID: 25926857]
-15Götte M, Arion D, Parniak MA, Wainberg MA. The M184V mutation in the reverse transcriptase of human immunodeficiency virus type 1 impairs rescue of chain-terminated DNA synthesis. J Virol 2000; 74(8): 3579-85.
[http://dx.doi.org/10.1128/JVI.74.8.3579-3585.2000] [PMID: 10729133]
]. Thus, the presence of such viral mutations reduces viral susceptibility to ARV drugs, in comparison with wild type virus and will eventually compromise effectiveness of ART [16Chen L, Lee C. Distinguishing HIV-1 drug resistance, accessory, and viral fitness mutations using conditional selection pressure analysis of treated versus untreated patient samples. Biol Direct 2006; 1: 14.
[http://dx.doi.org/10.1186/1745-6150-1-14] [PMID: 16737543]
].

In a recent study on acquired ARV drug resistance mutations in treatment experienced patients in Zimbabwe, 11 of 108 (10%) patients had primary drug resistance mutations, with the mutation M184V occurring most frequently [17Chimukangara B, Gwanzura L, Mitchell R, Katzenstein D, Masimirembwa C. Drug resistance mutations from whole blood proviral DNA among patients on antiretroviral drugs in Zimbabwe. Curr HIV Res 2014; 12(5): 309-16.
[http://dx.doi.org/10.2174/1570162X12666141017100733] [PMID: 25323793]
]. Another study on children aged 0 to 18 months in a prevention of mother to child transmission (PMTCT) program in Zimbabwe, showed that 29 (12.5%) children had NRTI-associated mutations and 145 (62.5%) had NNRTI-associated mutations [18Zimbabwe Paediatric HIVDR Survey Report (2012) Surveillance of initial drug resistant HIV-1 among children under 18 months of age newly diagnosed with HIV 2012. Available at: http://nac.org.zw/sites/default/files/.pdf]. Transmission of such viral variants to newly infected individuals could jeopardize the effective use of the already limited ART regimens in Zimbabwe.

It is necessary to determine the HIV drug resistance mutations in a population if management of HIV/AIDS through ARV therapy is to remain effective. Although sequencing of plasma viral RNA (vRNA) remains the gold standard in genotypic resistance testing [19Derache A, Shin H-S, Balamane M, et al. HIV drug resistance mutations in proviral DNA from a community treatment program. PLoS One 2015; 10(1): e0117430.
[http://dx.doi.org/10.1371/journal.pone.0117430] [PMID: 25635815]
], the method has been shown to miss the presence of drug resistance if there has been poor suppression of the virus due to interruption in adherence. Moreover, some studies have shown analysis of the alternative proviral DNA to give relatively similar results to plasma vRNA [19Derache A, Shin H-S, Balamane M, et al. HIV drug resistance mutations in proviral DNA from a community treatment program. PLoS One 2015; 10(1): e0117430.
[http://dx.doi.org/10.1371/journal.pone.0117430] [PMID: 25635815]
, 20Banks L, Gholamin S, White E, Zijenah L, Katzenstein DA. Comparing peripheral blood mononuclear cell DNA and circulating plasma viral RNA pol genotypes of Subtype C HIV-1. J AIDS Clin Res 2012; 3(2): 141-7.
[PMID: 23019537]
] which warrants the investigative use of proviral DNA in drug resistance testing. Hence the main objective of this study was to determine HIVDR mutations using proviral DNA from blood specimens of HIV infected ART-naïve and ART-experienced patients presenting to an HIV treatment clinic in Harare, Zimbabwe.

MATERIALS AND METHODS

Participant recruitment

One hundred and three (103) HIV-infected adult patients visiting the HIV clinic in Harare, Zimbabwe for treatment during the period March to August 2013 were recruited for the study. Details of the study site have been described previously [21Zhou DT, Kodogo V, Chokuona KF, Gomo E, Oektedalen O, Stray-Pedersen B. Dyslipidemia and cardiovascular disease risk profiles of patients attending an HIV treatment clinic in Harare, Zimbabwe. HIV AIDS (Auckl) 2015; 7: 145-55.
[http://dx.doi.org/10.2147/HIV.S78523] [PMID: 25999764]
]. Some of the participants were ART-experienced and the control group was ART-naive. ART-naïve group acted as a control group, to discount effect of proviral DNA archived in patients’ cells. Patients were invited to join the study as they came and written informed consent was obtained from all participants. A questionnaire-guided interview was conducted to obtain demographic and clinical data such as age, sex, drug regimen, duration on ART and time since diagnosis. The study was ethically cleared by the Joint Research Ethics Committee of the University of Zimbabwe College of Health Sciences and the Parirenyatwa Group of Hospitals (JREC), the Medical Research Council of Zimbabwe (MRCZ) and Research Ethics Committee, Norway (REK) [21Zhou DT, Kodogo V, Chokuona KF, Gomo E, Oektedalen O, Stray-Pedersen B. Dyslipidemia and cardiovascular disease risk profiles of patients attending an HIV treatment clinic in Harare, Zimbabwe. HIV AIDS (Auckl) 2015; 7: 145-55.
[http://dx.doi.org/10.2147/HIV.S78523] [PMID: 25999764]
].

Specimen Collection

Venipuncture was used to draw 5 ml of whole blood from each participant into EDTA-coated tubes labeled appropriately. Routine CD4 cell counts were done using Partec Cyflow Counter II and viral loads were measured using absolute quantification by digital PCR methods on a Roche LightCycler® 480 System at clinic site. Samples were couriered to African Institute of Biomedical Science and Technology (AiBST) in Harare, Zimbabwe and stored at -20°C prior to viral genotyping.

DNA Extraction

DNA extraction was achieved using the QIAGEN QIA amp DNA mini extraction kit (QIAGEN, GmbH Germany) according to manufacturer’s protocol. In summary, 20 µl of QIAGEN protease was mixed with 200 µl of thawed whole blood. 200 µl of buffer was added to the sample tubes and vortexed for 15 seconds. Samples were then incubated at 56oC for 10 minutes. 200 µl of ethanol was added to the lysate and mixed by vortexing for 15 seconds. The lysate was transferred to silica membrane spin columns and was washed using provided wash buffers. DNA was recovered using an elution buffer and the extract was stored at -20°C before use in the polymerase chain reaction (PCR).

Polymerase Chain Reaction

PCR conditions, primers and reagent volumes were adopted from a previously published study [17Chimukangara B, Gwanzura L, Mitchell R, Katzenstein D, Masimirembwa C. Drug resistance mutations from whole blood proviral DNA among patients on antiretroviral drugs in Zimbabwe. Curr HIV Res 2014; 12(5): 309-16.
[http://dx.doi.org/10.2174/1570162X12666141017100733] [PMID: 25323793]
] and details of primers are shown in (Tables 1 and 2). In summary, DNA was amplified by nested PCR using Thermo Scientific Phusion Hot Start II High-Fidelity DNA polymerase (Affibody AB, Sweden) on a PTC-100 thermo cycler (BioRad, California, USA).

Table 1
Details of primers.


Cycling conditions were as follows: 96°C for 2 minutes; 40 cycles of 96°C for 20 seconds; 55°C for 20 seconds; and 72°C for 2 minutes, with a final extension at 72°C for 10 minutes. Second round PCR conditions were the same as the first round, with 35 cycles and an annealing temperature of 56oC. Amplification was confirmed by gel electrophoresis before purification.

Table 2
HIV-1 reverse transcriptase sequencing primers.


Polymerase Chain Reaction Product Purification and Sequencing

The QIAquick PCR purification kit (QIAGEN, GmbH, Germany) was used to purify the amplicons in preparation for sequencing, according to manufacturer’s instructions. Briefly, 20μl of second round amplicon was mixed with 100μl of binding buffer (1:5 ratios). The mixture was transferred to a spin column and centrifuged at 13000rpm for 1 minute. The columns were washed with 20μl washing buffer. Purified amplicon was eluted in 50μl of elution buffer. Amplicons were sequenced at Molecular Cloning Laboratory (MCLAB, California, USA) on an ABI 3730xl genetic analyzer. The sequencing primers used are shown in (Table 1). Sequence assembly was done using Sequencher v.5.3 (Gene Codes Co.) and drug resistance mutations were determined using the Stanford HIV drug resistance database (Stanford HIVdb) [22HIV Stanford Database. HIV Stanford Database. California, USA: Palo Alto 2013.].

RESULTS

Demographic Characteristics

A total of 103 patient samples were analyzed for drug resistance mutations in this study. Of these patients, 86 (83%) were receiving ART, and 17 were ART-naïve. The median age was 39 (33-46) years, and the median time on ART was 4 (2-7) years. Time since diagnosis was longer for patients receiving ART than those who were ART-naïve (p=0.02) (Table 3).

Table 3
Demographics and clinical characteristics of study participants.


HIV Drug Resistance Mutations

Six of the 103 participants (6%) had drug resistance mutations (Table 4). The mutations observed were; NRTI mutations T69D, T69N, V75I and M184V; NNRTI mutations, K103N, V106M, Y181C and G190A; and TAMs (M41L, D67N, K70R, L210W, T215Y, K219Q) (Table 3).

Table 4
Observed HIV-1 subtype C drug resistance mutations.


One (0.97%) of the samples analyzed had only one NRTI mutation (T69N); two of the samples had three drug resistance mutations each, and shared a common NRTI mutation M184V. One participant had seven mutations, three were TAMs (L210W, T215Y and M41L), two were NRTI mutations (M184V, V75I) and two were NNRTI mutations (G190A, V106M) (Table 4). The participant with seven mutations had been on ART for 5 years, had a CD4 cell count of 399 cells/µl, as determined soon after recruitment, but the patient died during the course of the study. The most frequently occurring mutation in the whole group of patients was the M184V mutation, which occurred in five of the six (83%) participants who had mutations (Table 4).

DISCUSSION

Drug resistance testing, before initiating ART, is not currently performed, as a routine test, in resource-limited settings, mainly due to costs. The current universal standard specimen in drug resistance testing is plasma. Plasma samples must be stored at a temperature of -80°C within 6 hours of collection. The costs incurred in transportation, storing, extraction and reverse transcribing vRNA has made resistance testing from plasma inaccessible in settings where resources are limiting [19Derache A, Shin H-S, Balamane M, et al. HIV drug resistance mutations in proviral DNA from a community treatment program. PLoS One 2015; 10(1): e0117430.
[http://dx.doi.org/10.1371/journal.pone.0117430] [PMID: 25635815]
]. Whilst genotypic testing is reliable in patients with high viral loads (>1000 copies/ml), access to viral load testing is also not widely available in Zimbabwe due to the costs associated with the assay [5 National Medicine and Therapeutics Policy Advisory Committee (NMTPAC) and the AIDS and TB Directorate, Ministry of Health and Child Care, (2013) Guidelines for Antiretroviral Therapy for the Prevention and Treatment of HIV in Guidelines for Prevention and Treatment of HIV in Zimbabwe. Available at: http://preventcrypto.org/wp-content/uploads/2012/07/Zimbabwe-National-ART-guidelines-2-1.pdf, 17Chimukangara B, Gwanzura L, Mitchell R, Katzenstein D, Masimirembwa C. Drug resistance mutations from whole blood proviral DNA among patients on antiretroviral drugs in Zimbabwe. Curr HIV Res 2014; 12(5): 309-16.
[http://dx.doi.org/10.2174/1570162X12666141017100733] [PMID: 25323793]
].

A cost effective method of genotypic drug resistance testing using proviral DNA was used in this study, to inform about HIVDR mutation patterns in HIV patients. A similar study carried out in Zimbabwe demonstrated that HIV genotypic testing from whole blood is more affordable in resource limited settings (~$34 per sample excluding indirect costs) in comparison with currently existing methods, with unit cost ranging from $250 -500 [23 HIV Resistance Testing, aidsinfonet.org, The AIDS InfoNet. Available at: http://www.aidsinfonet.org/fact_sheets/view/126. Accessed December 19, 2015., 24 Incorporating Antiretroviral Resistance Testing Into Clinical Practice: Overview of HIV-1 Resistance Assay Methods. Available at: http://www.medscape.org/viewarticle/429693_3. Accessed December 19, 2015.].

Of the 103 samples that were successfully sequenced, six had drug resistance mutations. The most frequently occurring mutation was M184V, which was observed in five out of the six sequences (Table 4). This is consistent with various studies done in Zimbabwe [17Chimukangara B, Gwanzura L, Mitchell R, Katzenstein D, Masimirembwa C. Drug resistance mutations from whole blood proviral DNA among patients on antiretroviral drugs in Zimbabwe. Curr HIV Res 2014; 12(5): 309-16.
[http://dx.doi.org/10.2174/1570162X12666141017100733] [PMID: 25323793]
, 19Derache A, Shin H-S, Balamane M, et al. HIV drug resistance mutations in proviral DNA from a community treatment program. PLoS One 2015; 10(1): e0117430.
[http://dx.doi.org/10.1371/journal.pone.0117430] [PMID: 25635815]
, 20Banks L, Gholamin S, White E, Zijenah L, Katzenstein DA. Comparing peripheral blood mononuclear cell DNA and circulating plasma viral RNA pol genotypes of Subtype C HIV-1. J AIDS Clin Res 2012; 3(2): 141-7.
[PMID: 23019537]
]. M184V causes high level resistance to 3TC [15Götte M, Arion D, Parniak MA, Wainberg MA. The M184V mutation in the reverse transcriptase of human immunodeficiency virus type 1 impairs rescue of chain-terminated DNA synthesis. J Virol 2000; 74(8): 3579-85.
[http://dx.doi.org/10.1128/JVI.74.8.3579-3585.2000] [PMID: 10729133]
, 19Derache A, Shin H-S, Balamane M, et al. HIV drug resistance mutations in proviral DNA from a community treatment program. PLoS One 2015; 10(1): e0117430.
[http://dx.doi.org/10.1371/journal.pone.0117430] [PMID: 25635815]
], a drug that is recommended in all 1st and 2nd line ART regimens in Zimbabwe [5 National Medicine and Therapeutics Policy Advisory Committee (NMTPAC) and the AIDS and TB Directorate, Ministry of Health and Child Care, (2013) Guidelines for Antiretroviral Therapy for the Prevention and Treatment of HIV in Guidelines for Prevention and Treatment of HIV in Zimbabwe. Available at: http://preventcrypto.org/wp-content/uploads/2012/07/Zimbabwe-National-ART-guidelines-2-1.pdf]. However, the M184V mutation causes increased susceptibility to stavudine (d4T) and TDF [15Götte M, Arion D, Parniak MA, Wainberg MA. The M184V mutation in the reverse transcriptase of human immunodeficiency virus type 1 impairs rescue of chain-terminated DNA synthesis. J Virol 2000; 74(8): 3579-85.
[http://dx.doi.org/10.1128/JVI.74.8.3579-3585.2000] [PMID: 10729133]
, 19Derache A, Shin H-S, Balamane M, et al. HIV drug resistance mutations in proviral DNA from a community treatment program. PLoS One 2015; 10(1): e0117430.
[http://dx.doi.org/10.1371/journal.pone.0117430] [PMID: 25635815]
], increases the in vitro susceptibility to zidovudine (AZT) and d4T, delays the appearance of TAMs and reduces viral replicative capacity [19Derache A, Shin H-S, Balamane M, et al. HIV drug resistance mutations in proviral DNA from a community treatment program. PLoS One 2015; 10(1): e0117430.
[http://dx.doi.org/10.1371/journal.pone.0117430] [PMID: 25635815]
-26Pennings PS. HIV drug resistance: problems and perspectives. Infectious Disease Reports 2015. Available at: http://www.ncbi.nlm. nih.gov/pmc/articles/PMC3892620/]. Hence any regimen consisting of TDF, AZT or d4T plus 3TC has been shown to be effective in the presence of the M184V mutation, making 3TC a continued drug of choice despite presence of the M184V mutation.

Four of the viral sequences (67%) had at least one TAM. TAMs are drug resistance mutations which reduce antiviral activity of thymidine analogues d4T and AZT [26Pennings PS. HIV drug resistance: problems and perspectives. Infectious Disease Reports 2015. Available at: http://www.ncbi.nlm. nih.gov/pmc/articles/PMC3892620/]. In this study, TAMs observed were M41L, D67N, K70R, L210W, T215Y and K219Q. Studies have shown TAMs to appear through two pathways in a particular order: TAM-1 (M41L/L210W/T215Y) and TAM-2 (D67N/K70R/T215F/K219Q) [26Pennings PS. HIV drug resistance: problems and perspectives. Infectious Disease Reports 2015. Available at: http://www.ncbi.nlm. nih.gov/pmc/articles/PMC3892620/]. Reverse transcriptase (RT) of HIV-1 Subtype C has been seen to accumulate TAM-2 pathway mutations (e.g. T215F) first, whilst the RT of HIV-1 Subtype B follows TAM-1 pathway (e.g. T215Y) mutations [27Shafer RW, Kantor R, Gonzales MJ. The genetic basis of HIV-1 resistance to reverse transcriptase and protease inhibitors. AIDS Rev 2000; 2(4): 211-28.
[PMID: 19096725]
, 28Marcelin AG, Delaugerre C, Wirden M, et al. Thymidine analogue reverse transcriptase inhibitors resistance mutations profiles and association to other nucleoside reverse transcriptase inhibitors resistance mutations observed in the context of virological failure. J Med Virol 2004; 72(1): 162-5.
[http://dx.doi.org/10.1002/jmv.10550] [PMID: 14635026]
]. However, it remains that the two pathways are not mutually exclusive [29Cunha RD, Abreu CM, Gonzalez LM, et al. Differential in vitro kinetics of drug resistance mutation acquisition in HIV-1 RT of subtypes B and C. PLoS One 2012; 7(10): e46622.
[http://dx.doi.org/10.1371/journal.pone.0046622] [PMID: 23056372]
]. One of the sequences had all TAM-1 mutations, and another had all TAM-2 mutations Table 4 Two of these TAMS: D67N and T215K were also observed in a study recently carried out in Zimbabwe [17Chimukangara B, Gwanzura L, Mitchell R, Katzenstein D, Masimirembwa C. Drug resistance mutations from whole blood proviral DNA among patients on antiretroviral drugs in Zimbabwe. Curr HIV Res 2014; 12(5): 309-16.
[http://dx.doi.org/10.2174/1570162X12666141017100733] [PMID: 25323793]
]. TAMS mainly occur less commonly in patients receiving regimens with TDF and abacavir (ABC) [30Theys K, Deforche K, Libin P, Camacho RJ, Van Laethem K, Vandamme AM. Resistance pathways of human immunodeficiency virus type 1 against the combination of zidovudine and lamivudine. J Gen Virol 2010; 91(Pt 8): 1898-908.
[http://dx.doi.org/10.1099/vir.0.022657-0] [PMID: 20410311]
]. Initiating treatment with ABC and TDF as part of the drug regimen may reduce occurrence of these mutations.

The WHO resistance classification considers an HIVDR prevalence of 5-15% to be moderately high in treatment naïve patients [31Shafer RW, Schapiro JM. HIV-1 drug resistance mutations: An updated framework for the second decade of HAART. AIDS Rev 2008; 10(2): 67-84.
[PMID: 18615118]
]. Of the 103 patient samples analyzed in this study, 17 were ART-naïve and there were no drug resistance mutations observed in any of these samples. Over 5% in treatment naïve patients is reflective of high levels of transmitted resistance which is common in the US and Europe. There are generally 0 to <5% rates of transmitted resistance in sub-Saharan Africa as reported by Soo Yon Rhee et al., 2015 [32Nwobegahay JM, Bessong PO, Masebe TM, Mavhandu LG, Iweriebor BC, Selabe G. Prevalence of antiretroviral drug resistance mutations and HIV-I subtypes among newly-diagnosed drug-naïve persons visiting a voluntary testing and counselling centre in northeastern South Africa. J Health Popul Nutr 2011; 29(4): 303-9.
[http://dx.doi.org/10.3329/jhpn.v29i4.8444] [PMID: 21957668]
].

Among the six patient samples with drug resistance mutations, the CD4 counts ranged from 106 cells/ml to 988 cells/ml, while viral loads ranged from undetectable to 131 copies/ml for four of the six patients who had viral load results. High viral loads were not associated with accumulation of drug resistance mutations (P >0.05) in this study. Moreover, lower CD4 counts and demographic characteristics were not significantly associated with development of resistance mutations (Table 4).

In Zimbabwe, the first line regimen comprises of TDF, 3TC, and EFV. D4T is being phased out with its use being currently limited to cases intolerant of either zidovudine or TDF. Protease inhibitors are favored in the second line regimen and third line regimens for infants [5 National Medicine and Therapeutics Policy Advisory Committee (NMTPAC) and the AIDS and TB Directorate, Ministry of Health and Child Care, (2013) Guidelines for Antiretroviral Therapy for the Prevention and Treatment of HIV in Guidelines for Prevention and Treatment of HIV in Zimbabwe. Available at: http://preventcrypto.org/wp-content/uploads/2012/07/Zimbabwe-National-ART-guidelines-2-1.pdf]. Despite the presence of drug resistance mutations in six of the patient samples, the current recommended drug regimens are still effective in suppressing viral replication, as the mutations did not confer significant levels of resistance to the current recommended regimens. Genotypic testing using proviral DNA is a potential low-cost method that can be used in surveillance monitoring of drug resistance in resource limited settings like Zimbabwe [33Rhee SY, Blanco JL, Jordan MR, et al. Geographic and temporal trends in the molecular epidemiology and genetic mechanisms of transmitted HIV-1 drug resistance: an individual-patient- and sequence-level meta-analysis. PLoS Med 2015; 12(4): e1001810.
[http://dx.doi.org/10.1371/journal.pmed.1001810] [PMID: 25849352]
]. Genotypic testing may also be made cheaper by use of dried blood spots, which are easier to collect, transport, store and process.

CONCLUSION

As drug resistance mutations were detected in 6% of patients, despite the viral load threshold of >200 copies/ml being met, there is, need to monitor treatment experienced patients periodically for HIVDR mutations. The sustainability of the achievements of ART not only relies on close clinical monitoring of disease progression, but in resource limited settings, there is need to avail affordable treatment monitoring methods. Such monitoring methods will help assess the extent and if any, risks to the population of drug resistance, which allows decision making on drug regimens which best, suppress viral replication.

ETHICS APPROVAL AND CONSENT TO PARTICIPATE

Not applicable.

HUMAN AND ANIMAL RIGHTS

Animals did not participate in this research. All human research procedures followed were in accordance with the ethical standards of the committee responsible for human experimentation (institutional and national), and with the Helsinki Declaration of 1975, as revised in 2008.

CONSENT FOR PUBLICATION

Not applicable.

CONFLICT OF INTEREST

The authors confirm that this article content has no conflicts of interest.

ACKNOWLEDGEMENTS

The authors would like to acknowledge the Letten Foundation, Norway, for funding this research and the staff and patients at Newlands clinic for participating in this study, African Institute of Biomedical Science and Technology (AiBST), Harare, Zimbabwe for their expert advice and for use of their laboratory for genotyping work and University of Zimbabwe, College of Health Sciences, Department of Medical Laboratory Sciences for availing laboratory space for sample preparation and storage.

REFERENCES

[1] UNAIDS Global report: UNAIDS report on the global AIDS pandemic (2013) UNAIDS factsheet 2013. Available at: http://www.unaids.org/sites/default/files/en/media/unaids/contentassets/documents/epidemiology/2013/gr2013/UNAIDS_Global_Report_2013_en.pdf
[2] Hamers RL, Wallis CL, Kityo C, et al. HIV-1 drug resistance in antiretroviral-naive individuals in sub-Saharan Africa after rollout of antiretroviral therapy: a multicentre observational study. Lancet Infect Dis 2011; 11(10): 750-9.
[http://dx.doi.org/10.1016/S1473-3099(11)70149-9] [PMID: 21802367]
[3] Ministry of Health and Child Care Report on Zimbabwe National HIV and AIDS Estimates (2013). 2014:1-38. Available at: Ministry+of+Health+and+Child+Care+Report+on+Zimbabwe+National+HIV+and+AIDS+Estimates+2013
[4] Zimbabwe National HIV and AIDS Strategic Plan (ZNASP) 2006-2010 Available at: http://www.safaids.net/files/ZNASP 2006-2010.pdf
[5] National Medicine and Therapeutics Policy Advisory Committee (NMTPAC) and the AIDS and TB Directorate, Ministry of Health and Child Care, (2013) Guidelines for Antiretroviral Therapy for the Prevention and Treatment of HIV in Guidelines for Prevention and Treatment of HIV in Zimbabwe. Available at: http://preventcrypto.org/wp-content/uploads/2012/07/Zimbabwe-National-ART-guidelines-2-1.pdf
[6] Dzangare J, Gonese E, Mugurungi O, et al. Monitoring of early warning indicators for HIV drug resistance in antiretroviral therapy clinics in Zimbabwe. Clin Infect Dis 2012; 54(Suppl. 4): S313-6.
[http://dx.doi.org/10.1093/cid/cir1014] [PMID: 22544194]
[7] Marcelin AG. Resistance to nucleoside reverse transcriptase inhibitors. In: Geretti AM, Ed. Antiretroviral Resistance in Clinical Practise. London: Mediscript 2006. Available at: http://www.ncbi.nlm.nih.gov/books/NBK2241/.
[8] Paraschiv S, Otelea D, Baicus C, Tinischi M, Costache M, Neaga E. Nucleoside reverse transcriptase inhibitor resistance mutations in subtype F1 strains isolated from heavily treated adolescents in Romania. Int J Infect Dis 2009; 13(1): 81-9.
[http://dx.doi.org/10.1016/j.ijid.2008.03.032] [PMID: 18632295]
[9] Bennett DE, Camacho RJ, Otelea D, et al. Drug resistance mutations for surveillance of transmitted HIV-1 drug-resistance: 2009 update. PLoS One 2009; 4(3): e4724.
[http://dx.doi.org/10.1371/journal.pone.0004724] [PMID: 19266092]
[10] Zdanowicz MM. The pharmacology of HIV drug resistance. Am J Pharm Educ 2006; 70(5): 100.
[http://dx.doi.org/10.5688/aj7005100] [PMID: 17149429]
[11] Hamers RL, Sigaloff KC, Kityo C, Mugyenyi P, de Wit TF. Emerging HIV-1 drug resistance after roll-out of antiretroviral therapy in sub-Saharan Africa. Curr Opin HIV AIDS 2013; 8(1): 19-26.
[http://dx.doi.org/10.1097/COH.0b013e32835b7f94]
[12] Wang Y, Xing H, Liao L, et al. The development of drug resistance mutations K103N Y181C and G190A in long term Nevirapine-containing antiviral therapy. AIDS Res Ther 2014; 11: 36.
[http://dx.doi.org/10.1186/1742-6405-11-36] [PMID: 25926857]
[13] Bocket L, Yazdanpanah Y, Ajana F, et al. Thymidine analogue mutations in antiretroviral-naive HIV-1 patients on triple therapy including either zidovudine or stavudine. J Antimicrob Chemother 2004; 53(1): 89-94.
[http://dx.doi.org/10.1093/jac/dkh006] [PMID: 14645320]
[14] Taiwo B. Understanding transmitted HIV resistance through the experience in the USA. Int J Infect Dis 2009; 13(5): 552-9.
[http://dx.doi.org/10.1016/j.ijid.2008.10.008] [PMID: 19136289]
[15] Götte M, Arion D, Parniak MA, Wainberg MA. The M184V mutation in the reverse transcriptase of human immunodeficiency virus type 1 impairs rescue of chain-terminated DNA synthesis. J Virol 2000; 74(8): 3579-85.
[http://dx.doi.org/10.1128/JVI.74.8.3579-3585.2000] [PMID: 10729133]
[16] Chen L, Lee C. Distinguishing HIV-1 drug resistance, accessory, and viral fitness mutations using conditional selection pressure analysis of treated versus untreated patient samples. Biol Direct 2006; 1: 14.
[http://dx.doi.org/10.1186/1745-6150-1-14] [PMID: 16737543]
[17] Chimukangara B, Gwanzura L, Mitchell R, Katzenstein D, Masimirembwa C. Drug resistance mutations from whole blood proviral DNA among patients on antiretroviral drugs in Zimbabwe. Curr HIV Res 2014; 12(5): 309-16.
[http://dx.doi.org/10.2174/1570162X12666141017100733] [PMID: 25323793]
[18] Zimbabwe Paediatric HIVDR Survey Report (2012) Surveillance of initial drug resistant HIV-1 among children under 18 months of age newly diagnosed with HIV 2012. Available at: http://nac.org.zw/sites/default/files/.pdf
[19] Derache A, Shin H-S, Balamane M, et al. HIV drug resistance mutations in proviral DNA from a community treatment program. PLoS One 2015; 10(1): e0117430.
[http://dx.doi.org/10.1371/journal.pone.0117430] [PMID: 25635815]
[20] Banks L, Gholamin S, White E, Zijenah L, Katzenstein DA. Comparing peripheral blood mononuclear cell DNA and circulating plasma viral RNA pol genotypes of Subtype C HIV-1. J AIDS Clin Res 2012; 3(2): 141-7.
[PMID: 23019537]
[21] Zhou DT, Kodogo V, Chokuona KF, Gomo E, Oektedalen O, Stray-Pedersen B. Dyslipidemia and cardiovascular disease risk profiles of patients attending an HIV treatment clinic in Harare, Zimbabwe. HIV AIDS (Auckl) 2015; 7: 145-55.
[http://dx.doi.org/10.2147/HIV.S78523] [PMID: 25999764]
[22] HIV Stanford Database. HIV Stanford Database. California, USA: Palo Alto 2013.
[23] HIV Resistance Testing, aidsinfonet.org, The AIDS InfoNet. Available at: http://www.aidsinfonet.org/fact_sheets/view/126. Accessed December 19, 2015.
[24] Incorporating Antiretroviral Resistance Testing Into Clinical Practice: Overview of HIV-1 Resistance Assay Methods. Available at: http://www.medscape.org/viewarticle/429693_3. Accessed December 19, 2015.
[25] Turner D, Brenner B, Wainberg MA. Multiple effects of the M184V resistance mutation in the reverse transcriptase of human immunodeficiency virus type 1. Clin Diagn Lab Immunol 2003; 10(6): 979-81.
[http://dx.doi.org/10.1128/CDLI.10.6.979-981.2003] [PMID: 14607855]
[26] Pennings PS. HIV drug resistance: problems and perspectives. Infectious Disease Reports 2015. Available at: http://www.ncbi.nlm. nih.gov/pmc/articles/PMC3892620/
[27] Shafer RW, Kantor R, Gonzales MJ. The genetic basis of HIV-1 resistance to reverse transcriptase and protease inhibitors. AIDS Rev 2000; 2(4): 211-28.
[PMID: 19096725]
[28] Marcelin AG, Delaugerre C, Wirden M, et al. Thymidine analogue reverse transcriptase inhibitors resistance mutations profiles and association to other nucleoside reverse transcriptase inhibitors resistance mutations observed in the context of virological failure. J Med Virol 2004; 72(1): 162-5.
[http://dx.doi.org/10.1002/jmv.10550] [PMID: 14635026]
[29] Cunha RD, Abreu CM, Gonzalez LM, et al. Differential in vitro kinetics of drug resistance mutation acquisition in HIV-1 RT of subtypes B and C. PLoS One 2012; 7(10): e46622.
[http://dx.doi.org/10.1371/journal.pone.0046622] [PMID: 23056372]
[30] Theys K, Deforche K, Libin P, Camacho RJ, Van Laethem K, Vandamme AM. Resistance pathways of human immunodeficiency virus type 1 against the combination of zidovudine and lamivudine. J Gen Virol 2010; 91(Pt 8): 1898-908.
[http://dx.doi.org/10.1099/vir.0.022657-0] [PMID: 20410311]
[31] Shafer RW, Schapiro JM. HIV-1 drug resistance mutations: An updated framework for the second decade of HAART. AIDS Rev 2008; 10(2): 67-84.
[PMID: 18615118]
[32] Nwobegahay JM, Bessong PO, Masebe TM, Mavhandu LG, Iweriebor BC, Selabe G. Prevalence of antiretroviral drug resistance mutations and HIV-I subtypes among newly-diagnosed drug-naïve persons visiting a voluntary testing and counselling centre in northeastern South Africa. J Health Popul Nutr 2011; 29(4): 303-9.
[http://dx.doi.org/10.3329/jhpn.v29i4.8444] [PMID: 21957668]
[33] Rhee SY, Blanco JL, Jordan MR, et al. Geographic and temporal trends in the molecular epidemiology and genetic mechanisms of transmitted HIV-1 drug resistance: an individual-patient- and sequence-level meta-analysis. PLoS Med 2015; 12(4): e1001810.
[http://dx.doi.org/10.1371/journal.pmed.1001810] [PMID: 25849352]

Endorsements



"Open access will revolutionize 21st century knowledge work and accelerate the diffusion of ideas and evidence that support just in time learning and the evolution of thinking in a number of disciplines."


Daniel Pesut
(Indiana University School of Nursing, USA)

"It is important that students and researchers from all over the world can have easy access to relevant, high-standard and timely scientific information. This is exactly what Open Access Journals provide and this is the reason why I support this endeavor."


Jacques Descotes
(Centre Antipoison-Centre de Pharmacovigilance, France)

"Publishing research articles is the key for future scientific progress. Open Access publishing is therefore of utmost importance for wider dissemination of information, and will help serving the best interest of the scientific community."


Patrice Talaga
(UCB S.A., Belgium)

"Open access journals are a novel concept in the medical literature. They offer accessible information to a wide variety of individuals, including physicians, medical students, clinical investigators, and the general public. They are an outstanding source of medical and scientific information."


Jeffrey M. Weinberg
(St. Luke's-Roosevelt Hospital Center, USA)

"Open access journals are extremely useful for graduate students, investigators and all other interested persons to read important scientific articles and subscribe scientific journals. Indeed, the research articles span a wide range of area and of high quality. This is specially a must for researchers belonging to institutions with limited library facility and funding to subscribe scientific journals."


Debomoy K. Lahiri
(Indiana University School of Medicine, USA)

"Open access journals represent a major break-through in publishing. They provide easy access to the latest research on a wide variety of issues. Relevant and timely articles are made available in a fraction of the time taken by more conventional publishers. Articles are of uniformly high quality and written by the world's leading authorities."


Robert Looney
(Naval Postgraduate School, USA)

"Open access journals have transformed the way scientific data is published and disseminated: particularly, whilst ensuring a high quality standard and transparency in the editorial process, they have increased the access to the scientific literature by those researchers that have limited library support or that are working on small budgets."


Richard Reithinger
(Westat, USA)

"Not only do open access journals greatly improve the access to high quality information for scientists in the developing world, it also provides extra exposure for our papers."


J. Ferwerda
(University of Oxford, UK)

"Open Access 'Chemistry' Journals allow the dissemination of knowledge at your finger tips without paying for the scientific content."


Sean L. Kitson
(Almac Sciences, Northern Ireland)

"In principle, all scientific journals should have open access, as should be science itself. Open access journals are very helpful for students, researchers and the general public including people from institutions which do not have library or cannot afford to subscribe scientific journals. The articles are high standard and cover a wide area."


Hubert Wolterbeek
(Delft University of Technology, The Netherlands)

"The widest possible diffusion of information is critical for the advancement of science. In this perspective, open access journals are instrumental in fostering researches and achievements."


Alessandro Laviano
(Sapienza - University of Rome, Italy)

"Open access journals are very useful for all scientists as they can have quick information in the different fields of science."


Philippe Hernigou
(Paris University, France)

"There are many scientists who can not afford the rather expensive subscriptions to scientific journals. Open access journals offer a good alternative for free access to good quality scientific information."


Fidel Toldrá
(Instituto de Agroquimica y Tecnologia de Alimentos, Spain)

"Open access journals have become a fundamental tool for students, researchers, patients and the general public. Many people from institutions which do not have library or cannot afford to subscribe scientific journals benefit of them on a daily basis. The articles are among the best and cover most scientific areas."


M. Bendandi
(University Clinic of Navarre, Spain)

"These journals provide researchers with a platform for rapid, open access scientific communication. The articles are of high quality and broad scope."


Peter Chiba
(University of Vienna, Austria)

"Open access journals are probably one of the most important contributions to promote and diffuse science worldwide."


Jaime Sampaio
(University of Trás-os-Montes e Alto Douro, Portugal)

"Open access journals make up a new and rather revolutionary way to scientific publication. This option opens several quite interesting possibilities to disseminate openly and freely new knowledge and even to facilitate interpersonal communication among scientists."


Eduardo A. Castro
(INIFTA, Argentina)

"Open access journals are freely available online throughout the world, for you to read, download, copy, distribute, and use. The articles published in the open access journals are high quality and cover a wide range of fields."


Kenji Hashimoto
(Chiba University, Japan)

"Open Access journals offer an innovative and efficient way of publication for academics and professionals in a wide range of disciplines. The papers published are of high quality after rigorous peer review and they are Indexed in: major international databases. I read Open Access journals to keep abreast of the recent development in my field of study."


Daniel Shek
(Chinese University of Hong Kong, Hong Kong)

"It is a modern trend for publishers to establish open access journals. Researchers, faculty members, and students will be greatly benefited by the new journals of Bentham Science Publishers Ltd. in this category."


Jih Ru Hwu
(National Central University, Taiwan)


Browse Contents



Webmaster Contact: info@benthamopen.net
Copyright © 2019 Bentham Open