The Open Microbiology Journal




ISSN: 1874-2858 ― Volume 13, 2019

A Comparison of Bacterial Composition in Diabetic Ulcers and Contralateral Intact Skin



Viktoria Gontcharova1, Eunseog Youn3, Yan Sun1, Randall D Wolcott2, Scot E Dowd1, 4, *
1 Medical Biofilm Research Institute, 4321 Marsha Sharp Freeway, Lubbock, TX 79407
2 Southwest Regional Wound Care Clinic, 2002 Oxford Ave, Lubbock TX 79410
3 Texas Tech University, Computer Science Department, P.O. Box 43104, Lubbock, TX 79409-3104
4 Research and Testing Laboratory, Lubbock, TX

Abstract

An extensive portion of the healthcare budget is allocated to chronic human infection. Chronic wounds in particular are a major contributor to this financial burden. Little is known about the types of bacteria which may contribute to the chronicity, biofilm and overall bioburden of the wound itself. In this study we compare the bacteriology of wounds and associated intact skin. Wound and paired intact skin swabs (from a contralateral location) were collected. The bacterial diversity was determined using bacterial Tag-encoded FLX amplicon pyrosequencing (bTEFAP). Diversity analysis showed intact skin to be significantly more diverse than wounds on both the species and genus levels (3% and 5% divergence). Furthermore, wounds show heightened levels of anaerobic bacteria, like Peptoniphilus, Finegoldia, and Anaerococcus, and other detrimental genera such as Corynebacterium and Staphylococcus. Although some of these and other bacterial genera were found to be common between intact skin and wounds, notable opportunistic wound pathogens were found at lower levels in intact skin. Principal Component Analysis demonstrated a clear separability of the two groups. The findings of the study not only greatly support the hypothesis of differing bacterial composition of intact skin and wounds, but also contribute additional insight into the ecology of skin and wound microflora. The increased diversity and lowered levels of opportunistic pathogens found in skin make the system highly distinguishable from wounds.

Keywords: Biofilm, skin, bacteria, diversity, pyrosequencing, chronic wounds, bTEFAP, microbiome.


Article Information


Identifiers and Pagination:

Year: 2010
Volume: 4
First Page: 8
Last Page: 19
Publisher Id: TOMICROJ-4-8
DOI: 10.2174/1874285801004010008

Article History:

Received Date: 15/2/2010
Revision Received Date: 22/2/2010
Acceptance Date: 26/2/2010
Electronic publication date: 17/3/2010
Collection year: 2010

Article Metrics:

CrossRef Citations:
0

Total Statistics:

Full-Text HTML Views: 1218
Abstract HTML Views: 822
PDF Downloads: 192
Total Views/Downloads: 2232

Unique Statistics:

Full-Text HTML Views: 549
Abstract HTML Views: 461
PDF Downloads: 142
Total Views/Downloads: 1152
Geographical View

© Gontcharova et al.; Licensee Bentham Open.

open-access license: This is an open access article licensed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted, non-commercial use, distribution and reproduction in any medium, provided the work is properly cited.


* Address correspondence to this author at the Research and Testing Laboratory, 4321 Marsha Sharp Fwy., Lubbock, TX 79407, USA; Tel: 806-789-6879; E-mail: sdowd@pathogenresearch.org




INTRODUCTION

A major and ever increasing portion of the healthcare budget is dedicated to treatment of chronic infections [1Bjarnsholt T, Kirketerp-Moller K, Jensen PO, et al. Why chronic wounds will not heal: a novel hypothesis Wound Repair Regen 2008; 16: 2-10.]. These infections include chronic wounds, and comprise 60-80% of all human infectious diseases [2Costerton JW, Lewandowski Z, Caldwell DE, Korber DR, Lappin-Scott HM. Microbial biofilms Annu Rev Microbiol 1995; 49: 711-45.]. Chronic wounds, by definition are wounds that have a biological or physiological reason for not healing. One of the primarily barriers to healing has now been identified as biofilm phenotype polymicrobial infections [1Bjarnsholt T, Kirketerp-Moller K, Jensen PO, et al. Why chronic wounds will not heal: a novel hypothesis Wound Repair Regen 2008; 16: 2-10.-3Wolcott RD, Rhoads DD. A study of biofilm-based wound management in subjects with critical limb ischaemia J Wound Care 2008; 17: 145-2-54.]. Biofilm is the natural physiological state of bacteria and are typically defined as polymicrobial populations of cells encased in hydrated extracellular polymeric substances and attached to a surface (e.g. tissue). Bacteria found in chronic wounds, therefore, usually exist as biofilm communities [4James GA, Swogger E, Wolcott R, et al. Biofilms in chronic wounds Wound Repair Regen 2008; 16: 37-44.-7Dowd SE, Sun Y, Secor PR, et al. Survey of bacterial diversity in chronic wounds using pyrosequencing, DGGE, and full ribosome shotgun sequencing BMC Microbiol 2008; 8: 43.]. Due to the physiological properties of biofilm phenotype, bacteria comprising the communities become highly resistant to many traditional therapies, thus one of the most successful strategies for the management of the wound is biofilm-based wound care [3Wolcott RD, Rhoads DD. A study of biofilm-based wound management in subjects with critical limb ischaemia J Wound Care 2008; 17: 145-2-54.-8Wolcott RD, Kennedy JP, Dowd SE. Regular debridement is the main tool for maintaining a healthy wound bed in most chronic wounds J Wound Care 2009; 18: 54-6.].

Diabetic ulcers, a subgroup of chronic wounds, occur in about 15% of diabetic patients and often lead to hospitalization and amputation [9CDCDFWC: Consensus Development Conference on Diabetic Foot Wound Care Boston, Massachusetts: American Diabetes Association 1999; 1354-60.]. More than 80,000 amputations occur in the US within the diabetic population per year and account for a threefold increase in risk of death within 18 months [10National Diabetes Information Clearinghouse National Diabetes Statistics 2007 Ref Type: Online Source ]. Major limb amputation is also associated with depression and increased mortality and morbidity rates [11Ismail K, Winkley K, Stahl D, Chalder T, Edmonds M. A cohort study of people with diabetes and their first foot ulcer: the role of depression on mortality Diabetes Care 2007; 30: 1473-9., 12MMWR. History of foot ulcer among persons with diabetes-- United States, 2000-2002 MMWR Morb Mortal Wkly Rep 2003; 52: 1098-2.]. Thus, preventing amputation must be the primary ethical goal of wound care practitioners.

Little is known about the types of bacteria that might contribute to the bioburden in chronic wounds. Several recent studies are now shedding new light on the bacterial populations associated with chronic wounds [4James GA, Swogger E, Wolcott R, et al. Biofilms in chronic wounds Wound Repair Regen 2008; 16: 37-44., 13Wolcott RD, Gontcharova V, Sun Y, Zischkau AM, Dowd SE. Bacterial diversity in surgical site infections: not just aerobic cocci any more J Wound Care 2009; 18: 317-23., 14Dowd SE, Wolcott RD, Sun Y, McKeehan T, Smith E, Rhoads D. Polymicrobial nature of chronic diabetic foot ulcer biofilm infections determined using bacterial tag encoded FLX amplicon pyrosequencing (bTEFAP) PLoS ONE 2008; 3: e3326.], however there is not much information comparing the bacterial diversity of intact skin to that found in chronic wound biofilms. The medical and research communities have realized the diversity and composition of the chronic wounds may be an important influence to the chronicity of the wounds, thus it is important to assess the composition of diabetic ulcers and identify the differentiating qualities between intact skin and the wounds.

Only about 2% of all known bacteria are able to be cultured in the laboratory [15Rowan NJ. Viable but non-culturable forms of food and waterborne bacteria: Quo Vadis? Trends Food Sci Technol 2004; 15: 462.]. Molecular methods allow for chronic wounds and skin samples to be evaluated without the need for culture. Molecular methods are now available which will allow the patient to be diagnosed, treated and re-evaluated in an appropriate timeframe while identifying a wider range of bacteria contributing to the biofilm population [14Dowd SE, Wolcott RD, Sun Y, McKeehan T, Smith E, Rhoads D. Polymicrobial nature of chronic diabetic foot ulcer biofilm infections determined using bacterial tag encoded FLX amplicon pyrosequencing (bTEFAP) PLoS ONE 2008; 3: e3326., 16Wolcott RD, Dowd SE. A rapid molecular method for characterising bacterial bioburden in chronic wounds J Wound Care 2008; 17: 513-6.]. This is an important concept because newer molecular methods can identify even previously uncharacterized bacteria which are difficult or impossible to culture in the laboratory [13Wolcott RD, Gontcharova V, Sun Y, Zischkau AM, Dowd SE. Bacterial diversity in surgical site infections: not just aerobic cocci any more J Wound Care 2009; 18: 317-23.].

Using pyrosequencing 16s ribosomal DNA methods, we assessed the bacterial microflora of diabetic ulcers and intact skin. During this study we sought to characterize the microbiota consistently of chronic wounds (likely contributing to their chronicity) and contrast this with the microbiota of intact skin on the same subjects providing a comparative look at wound and skin microflora within the same individual. This could possibly provide insight into the importance of the diabetic condition and the possibility of the disease itself making a person vulnerable to specific types of chronic wound infections promoted by the subjects own skin.

MATERIALS AND METHODS

Intact Skin and Wound Samples

Debridement and skin swab samples were collected for 53 total samples (23 samples were collected from wounds and 28 from intact skin) at the Southwest Regional Wound Care Center in accordance with Western Institutional Review Board protocol number 20062347. All patients provided written consent. Diabetic subjects with chronic wounds were chosen for this study. All samples were collected using sterile technique and immediately frozen in collection tubes at -80oC until DNA extraction was performed as described previously [13Wolcott RD, Gontcharova V, Sun Y, Zischkau AM, Dowd SE. Bacterial diversity in surgical site infections: not just aerobic cocci any more J Wound Care 2009; 18: 317-23.]. Paired samples were collected from collateral locations on each subject of each other (ex. wound sample collected from left ankle, intact skin sample collected from same location on right ankle).

Wound Sample DNA Extraction and bTEFAP

DNA extractions and the bacterial tag-encoded FLX amplicon pyrosequencing (bTEFAP) were performed by Research and Testing Laboratories (Lubbock, TX; www.researchandtesting.com). Data from the study was deposited in the short read archive of NCBI.

bTEFAP Sequence Processing Pipeline

Scripts written in C# within a Microsoft® .NET (Microsoft Corp, Seattle, WA) development environment were used for all post sequencing processing. Discussion of software code is outside the scope of this report; however, a brief description of the algorithm follows. Quality trimmed sequences obtained from the FLX sequencing run were derived directly from FLX sequencing run output files. Tags were extracted from the multi-FASTA file into individual sample-specific files based upon the tag sequence. Tags which did not have 100% homology to the sample designation were not considered. Sequences which were less than 200 bp after quality trimming were not considered. After parsing the tags into individual FASTA files the resultant individual samples were labeled and concatenated into one file containing all samples. The resulting FASTA formatted file was then chimera checked using a custom algorithm appropriate for high throughput analysis for the 16S database available at http://www.researchandtesting.com/B2C2. Chimeric sequences were removed from the FASTA file to form a final FASTA sequence file. The final file was then evaluated using BLASTn [17Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ. Basic local alignment search tool J Mol Biol 1990; 215: 403-10.] against a database derived from GenBank (http://ncbi.nlm.nih.gov). A post processing algorithm generated best-hit files. The parameters used have been previously evaluated to enable reliable identification at the genus level. Following best-hit processing a secondary post-processing algorithm was used to determine the percent composition per sample.

Statistics

Statistical analysis was performed on percent composition files. Further custom scripts were built to find the most discriminating and the least discriminating bacteria in each taxonomic level between intact and wound samples. Each bacterium was considered as a feature and applied a feature selection (ranking) method. We used the area under the ROC curve (AUC) [18Hand DJ, Till RJ. A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems Mach Learn 2001; 45: 171-86., 19Fawcett T. An introduction to ROC analysis Pattern Recogn Lett 2006; 27: 861-74.] feature selection method [20Theodoridis S, Koutroumbas K. Pattern Recognition. 2nd. San Diego, Ca: Academic Press 2008.]. The analysis focused on the genus and species classifications. For each feature (taxonomic classification in this case), AUC was computed. This area under the curve represents the discrimination capability of the feature. The scores are scaled to [0.5, 1] to consider only the magnitude, not the direction of discrimination. Scores closest to 1 are more discriminating while those close to 0.5 represent bacteria found equally abundantly in both intact and wound samples.

The similarity between the compositions within various groups was performed using the Pearson correlation distances [21Stigler SM. Francis Galton's Account of the Invention of Correlation Stat Sci 1989; 4: 73-86., 22Rodgers JL, Nicewander WA. Thirteen ways to look at the correlation coefficient Am Stat 1988; 42: 59-66.]. This evaluation was performed for distances between intact and wound samples, within wound samples, within intact samples, and between paired samples of intact and wounded skin on an individual.

To assess the separability of the intact skin and wound samples, Principal Component Analysis (PCA) was implemented. Custom scripts tailored for next generation data (Research and Testing Laboratory, Lubbock, TX) were implemented to formulate the environment and NEXUS tree files for a distance matrix based on the UNIFRAC [23Lozupone C, Hamady M, Knight R. UniFrac--an online tool for comparing microbial community diversity in a phylogenetic context BMC Bioinformatics 2006; 7: 371.] formula. This distance matrix was used for Principal Component Analysis and Hierarchical clustering implemented using Python scripts. Samples more similar to each other should appear closer together according to the respective axis reflecting the variation among all samples. This technique is useful in displaying clusters existing within data.

RESULTS

Diversity Analysis

Our group has previously published several research articles on the application of the bTEFAP pyrosequencing approach for the analysis of chronic wound microbiota [7Dowd SE, Sun Y, Secor PR, et al. Survey of bacterial diversity in chronic wounds using pyrosequencing, DGGE, and full ribosome shotgun sequencing BMC Microbiol 2008; 8: 43., 13Wolcott RD, Gontcharova V, Sun Y, Zischkau AM, Dowd SE. Bacterial diversity in surgical site infections: not just aerobic cocci any more J Wound Care 2009; 18: 317-23., 14Dowd SE, Wolcott RD, Sun Y, McKeehan T, Smith E, Rhoads D. Polymicrobial nature of chronic diabetic foot ulcer biofilm infections determined using bacterial tag encoded FLX amplicon pyrosequencing (bTEFAP) PLoS ONE 2008; 3: e3326.]. In the first paper, a broad survey of wounds analyzed by molecular methods indicated a highly diverse composition found in chronic wound samples. While the analysis resulted in interesting findings, the follow up analysis used individual samples instead of a pooled composition from multiple diabetic foot ulcers. The work indicated the absence of any single or discrete individual populations of bacteria acting as the culprit in chronic infections. No unique genus of bacteria was found in all samples, supporting the idea of functionally equivalent pathogroups establishing a highly resistant opportunistically pathogenic biofilm [24Wolcott RD, Rhoads DD, Dowd SE. Biofilms and chronic wound inflammation J Wound Care 2008; 17: 333-41.], contributing to the chronicity of the wound.

Continuing the molecular approach to chronic wound analysis, our group has now performed the comparison of chronic wounds to intact skin. It is the next logical step to not only identifying the major players in wounds, but also identifying the reasons for the intact collateral skin remaining healthy.

Pyrosequencing using the bTEFAP approach based upon titanium chemistry (average read length of 400bp) produced a total of 148,349 sequences between the intact and wound samples. After quality scoring and eliminating sequences <200 nucleotides long, 101,950 sequences were used as the next set for analyses. Chimeric sequences represented ~9% of the total samples and were removed leaving over 93,000 high quality sequence reads among samples. Microbial diversity analysis [25Finkel SE, Kolter R. Evolution of microbial diversity during prolonged starvation Proc Natl Acad Sci USA 1999; 96: 4023-7.-28Sogin ML, Morrison HG, Huber JA, et al. Microbial diversity in the deep sea and the underexplored "rare biosphere" Proc Natl Acad Sci USA 2006; 103: 12115-20.] was performed by clustering sequence tags into groups of defined sequence variation ranging from unique sequences to 10% divergence using DOTUR [29Schloss PD, Handelsman J. Introducing DOTUR, a computer program for defining operational taxonomic units and estimating species richness Appl Environ Microbiol 2005; 71: 1501-6.] as previously described [30Dowd SE, Callaway TR, Wolcott RD, et al. Evaluation of the bacterial diversity in the feces of cattle using 16S rDNA bacterial tag-encoded FLX amplicon pyrosequencing (bTEFAP) BMC Microbiol 2008; 8: 125.]. Clusters acting as OTUs were used as input for calculations with the abundance-based coverage estimator ACE and the Chao1 [31Chao A, Bunge J. Estimating the number of species in a stochastic abundance model Biometrics 2002; 58: 531-9.] estimator of species diversity and richness. Tables 1 and 2 show the microbial diversity estimates obtained with parametric and non-parametric modeling of rarefaction, ACE and Chao1 for intact skin and for samples extracted from wounds. When relatively large genetic distances (5% divergence) are considered these estimates predict that even at the genus level there is significantly less diversity and richness of microbial communities in wounds. As sequence divergence is more stringently analyzed, the significance levels of diversity decrease but remains significant. At the species level (3% divergence), wounds remain less diverse than the intact skin, according to all three approaches, Rarefaction, ACE, and Chao1. Table 3 summarizes the data from Tables 1 and 2 with average values from the data and indicates statistical significance between the intact skin samples. Divergence of 3% and 5% is indicative of sequences differing at the species and genus level, respectively. The student’s t-test results seen in Table 3 indicate significantly higher diversity levels in intact skin when compared to wounds.

Table 1

Diversity and Richness Data for Wound Samples




Table 2

Diversity and Richness Data for Intact Skin Samples




Table 3

P-values (P-val) Corresponding to a Student T-Test Evaluation of Intact Skin and Wound Samples




Table 4

Most and Least Discriminating Genera




Table 5

10 Most Prevalent Genera in Intact Skin and Wounds




Table 6

Escherichia, Shigella and Serratia Counts within Intact Skin and Wound Samples




Composition Analysis

To better perform group comparisons, after the bTEFAP pipeline, the resulting files containing the percent bacterial composition per sample were grouped into "intact" and "wound" groups. This data was analyzed using Area Under the Curve (AUC) [18Hand DJ, Till RJ. A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems Mach Learn 2001; 45: 171-86., 19Fawcett T. An introduction to ROC analysis Pattern Recogn Lett 2006; 27: 861-74.] analysis to identify the important genera within each group. Bacterial genera occurring in at least 20 of the samples (combination of intact and wounded regions) were considered to ensure a representative result and not attest to genera rarely found in the samples. Table 4 displays the most and the least discriminating bacteria from the samples along with the average percentages at which the bacteria were found in intact skin and wounds, Hmean and Wmean, respectively. An AUC value closest to 1 identifies a genus able to separate the wound and intact skin samples the best. AUC values closest to 0.5 represent genera least able to separate intact and wound samples whereas values closer to 1 are the most discriminating. These low AUC scores represent bacteria generally found at low amounts or similar levels in both groups of samples.

The AUC approach produces synonymous results to the student's t-test. Both types of analyses address the question of significant differences among groups. The AUC approach was selected to provide a more intuitive and statistically relevant representation of the significance levels. The bacteria listed in Table 4, although prove to be highly distinguishing genera among intact skin and wound samples, seem to represent relatively low composition percentages within samples. However, even at low percentages, certain bacteria may play a significant role within the detrimental biofilm contributing to the overall ecosystem. Furthermore some of the least discriminating bacteria, such as E. coli, are significant contributors to bacterial environments with noticeably differing levels between the intact skin and wounds. The heightened levels evidently seem to play a role in distinguishing an intact skin and a wound environment although the AUC level may not reflect that (possibly due to high variance between samples).

Further analysis was performed to show the most predominant bacteria in intact skin and wound samples in Table 5. Several genera overlap between the distinguishing Table 4 and predominance Table 5, showing the bacterial genera composing majority of the samples. Chryseobacterium, Segetibacter and Methylophilus are seen in both Table 4 and Table 5, indicating some importance within intact skin samples.

Table 5 further shows that Escherichiaspp. and Shigellaspp. represented genera in wounds. E. coli are one of the most prevalent bacterial species in the surroundings. Although Escherichia were grouped with the least discriminating bacteria, possibly due to a high variance seen within wound samples as mentioned earlier, the wound samples within which the genus was found showed higher levels of Escherichia than intact skin samples. Furthermore, Escherichia and Shigella share many genes and have a similar genome [32Brenner DJ, Fanning GR, Skerman FJ, Falkow S. Polynucleotide sequence divergence among strains of Escherichia coli and closely related organisms J Bacteriol 1972; 109: 953-65.], particularly in the amplification region being analyzed here. During this study, identification of tentative consensus (TC) sequences was performed using alignment principles. When the sequence in question was aligned to a sequence from our custom database, best alignments were considered. Table 6 shows all occurrences of Escherichia, Shigella, and Serratia, a genus also related to Escherichia and Shigella [33Ohnishi Y, Beppu T, Horinouchi S. Two genes encoding serine protease homologues in Serratia marcescens and characterization of their products in Escherichia coli J Biochem 1997; 121: 902-13.], and the counts found in both intact and wound samples. Bacteria belonging to the Escherichia, Shigella and Serratia genera are often responsible for severe skin infections [34Langrock ML, Linde HJ, Landthaler M, Karrer S. Leg ulcers and abscesses caused by Serratia marcescens Eur J Dermatol 2008; 18: 705-.]. These values should all be considered due to the close relation among the genera and therefore possibly synonymous alignment and identification in the region analyzed. The frequency pattern for the three bacterial groups displays a strong favor to the wound samples, supporting the bacterial synonimity and importance.

Comparison Analysis

To ensure the existence of significant differences among skin and wound samples, Principal Component Analysis (PCA) was performed. Fig. (1) shows the resulting analysis for the principal components. The intact skin and wound groups clearly cluster, implying the bacterial diversity and microbial composition of the samples is different and unaffecting of each other. The PCA scores for the three principal components are displayed on the axes. Scores are results of a weight applied to the original data with the result indicating a negative or positive correlation with the component.

Fig. (1)

PCA for intact skin and wound data. The figure display the three main principal components to which the data was reduced to. The axes represent the values for principal components 1, 2 and 3. Points lying in the negative portion of an axis indicate a negative correlation between the principal component and the sample. The two groups are denoted by different colors to demonstrate the separation between classes (intact skin vs. wounds). The ability to linearly separate the classes within the PCA figures indicates intact skin samples are different from wound samples.



Fig. (2)

Hierarchical clustering of healthy skin and wound data. This figure provides further support for the separability between the two classes of samples, healthy skin and wounds. The figure also indicates low correlation between healthy skin and wound samples for the same individual, indicating lack of contamination or other factors possibly affecting bacterial similarity.



Fig. (3)

Correlation Distances for paired intact skin against wound samples. Pearson Correlation distances, ranging from 0 to 2 were normalized to a scale of 0 to 1 where 1 represents the furthest distance, or the least similar samples.



Fig. (4)

Correlation Distances for all against all samples. Pearson Correlation distances, ranging from 0 to 2 were normalized to a scale of 0 to 1 where 1 represents the furthest distance, or the least similar samples.



Hierarchical clustering was also performed on the data with the results shown in Fig. (2). The intact skin and wounds groups are separated at the top level, dividing the samples perfectly. The dendogram supports the previously discussed results indicating the ability to differentiate healthy skin and wounds based on bacterial composition. Furthermore, Fig. (2) also demonstrates the lack of strong similarity between healthy skin and wounds for the same patient. The possibility of contamination is not statistically supported by the results demonstrated in this image.

To further investigate the similarity of healthy skin and wound samples from the same patient, samples with pairs for a corresponding part of the body for an individual were studied to evaluate the extent of similarity in the bacterial composition of the samples. A similarity measure matrix representing all possible pairs was created and can been seen in Fig. (3). The results of the analysis demonstrate no conclusive relationships between an individual's wound and intact skin samples. The image in Fig. (3) shows the relationship between each intact and wound sample based on the Pearson's correlation distance. A distance of zero represents the closest samples, while a distance of two (scaled to 1 for the image) is the furthest. A color spectrum is used to represent these distances, and the closest distances will be the coolest tones, closest to blue, while the furthest ones will be closer to the red colors. If the corresponding wound and intact skin samples were similar, indicating contamination or the flora of intact skin being strongly affected by the flora of the wounds (or vice versa), the blue color would be seen on the diagonal of the heat map matrix. Judgment should be made by complementary indices on the x and y axis, (i.e. sample 1 of the intact skin, corresponds to sample 1 of the wounds and the relationship between them can be seen in the top left corner of the matrix). Similarly, sample 2 would be in position (2, 2), and so on for the rest of the samples. The diagonal, however, is diverse in color, with the average Pearson’s correlation distance of 0.78, showing a relationship between intact skin and wounds in a corresponding location.

A distance analysis was also done on all against all samples, not limiting to corresponding pairs. Fig. (4) shows this data. Unlike Fig. (3), a blue diagonal line can be seen, it represent the distance between the same sample. This forms a logical deduction that sample 1 (whether wound or skin) is going to be identical to sample 1. Fig. (4) is useful for analysis of distances of skin vs. skin, skin vs. wound and wound vs. wound. Within the analysis, there were 28 intact samples and 24 wound samples. The 28x28NW corner of the map is the distance within intact samples, 24x24SE corner is within wound samples, and the rest is between intact and wound samples. The matrix is symmetric so essentially only the upper or lower triangle requires analysis. The sample comparison again does not display an obvious pattern, however, evaluating the NE corner of the figure, the intact/wound region, it is evident the area is primarily in the red tones further supporting the conclusions drawn and discussed in relation to Fig. (3). The correlation distance between all intact skin and wound samples is 0.79. In the SE corner, however, the distances between the wound samples appear to be closer. There is much more blue seen in the figure, showing closer correlations between the wounds. The increased intensity of the red, however, offsets the closer relationships, resulting in an average correlation distance of 0.77. The intact samples, in the NW corner, although do not have as much true blue tones as the wounds, have a greater amount of mid tones, also resulting in a closer correlation that the intact/wound comparisons. The average distance within intact skin samples is 0.70, the closest of all three groups. Group analysis of intact against intact samples shows the lowest distance, suggesting the most similarity. The Pearson correlation distance is in the [0,2] range, thus implying the distances of all three groups, being less than 1, are closer than the average random correlation value.

DISCUSSION

Diversity Analysis

The bacterial microbiota analysis results indicate there is a significantly lower diversity of bacteria found in wounds than in intact skin. More sequences per sample were analyzed within wound data, intuitively indicating more diversity, however intact skin samples proved to be more diverse. This information, along with significance summaries can be seen in Table 3. There is not a multitude of information comparing healthy skin to wounds, however a number of studies have shown the overall diversity of healthy skin to be considerable [35Dekio I, Hayashi H, Sakamoto M, et al. Detection of potentially novel bacterial components of the human skin microbiota using culture-independent molecular profiling J Med Microbiol 2005; 54: 1231-8.-37Gao Z, Tseng CH, Pei Z, Blaser MJ. Molecular analysis of human forearm superficial skin bacterial biota Proc Natl Acad Sci USA 2007; 104: 2927-32.]. The more abundant flora of intact skin may be contributing to its robust environment and protecting the ecosystem from the spread of infection or accumulation of opportunistic and pathogenic populations. Previous studies have indicated the properties of bacterial microflora of intact skin demonstrate advantages to the system [38Roth RR, James WD. Microbial ecology of the skin Annu Rev Microbiol 1988; 42: 441-64., 39Krutmann J. Pre- and probiotics for human skin J Dermatol Sci 2009; 54: 1-5.] and thus support the resistance in healthy skin and the vulnerability to complications witnessed in wounds. The type of diversity data presented within Tables 1-3 is not able to precisely indicate what diversifies the two sets of samples. However, this type of analysis is an established means of evaluating the overall species richness within groups [40Raup DM. Taxonomic diversity estimation using rarefaction Paleobiology 1975; 1: 333-42.].

Composition Analysis

Table 4 indicates bacteria falling into genera like Corynebacterium, Streptococcus and Anaerococcus have been shown to be associated with chronic wounds, and our results coincide with their findings. However, Table 4 also indicates intact skin to also contain Corynebacterium genera as part of the predominant composition. The percentages at which these bacteria are found, in wounded skin are higher indicating Corynebacterium as a significant opportunistic contributor to chronic wounds. Similarly, Streptococcusspp. are often associated with wounds and in this study the genus was only found in 17 of 29 intact skin samples, at an average of only 1.54% (data not shown), compared to ~20% in wounds. This is evidence for elevated levels of certain bacteria normally indigenous potentially contributing to wound biofilm, bioburden and polymicrobial infection.

Returning to Corynebacterium, these bacteria are recognized as opportunistic human pathogens [41Funke G, Von GA, Clarridge JE, III Bernard KA. Clinical microbiology of coryneform bacteria Clin Microbiol Rev 1997; 10: 125-59.]. Corynebacterium genus harbors several species, including Corynebacteriumjeikeium. This is a "lipophilic" and multidrug resistant bacterium of the human skin flora [42Tauch A, Kaiser O, Hain T, et al. Complete genome sequence and analysis of the multiresistant nosocomial pathogen Coryne-bacterium jeikeium K411, a lipid-requiring bacterium of the human skin flora J Bacteriol 2005; 187: 4671-82.]. Corynebacteriumjeikeium shares 69% of its genes with other species of the Corynebacterium genus [42Tauch A, Kaiser O, Hain T, et al. Complete genome sequence and analysis of the multiresistant nosocomial pathogen Coryne-bacterium jeikeium K411, a lipid-requiring bacterium of the human skin flora J Bacteriol 2005; 187: 4671-82.]. This chromosomal backbone allows the bacteria to be toxic and prevalent and possibly drug resistant. This coincides with the fact and indicates the importance of the observation that such Corynebacterium were found at much higher levels in the wounds than intact skin samples.

Anaerobes have often been found in wound samples and are recognized as a major population in chronic wound biofilms [7Dowd SE, Sun Y, Secor PR, et al. Survey of bacterial diversity in chronic wounds using pyrosequencing, DGGE, and full ribosome shotgun sequencing BMC Microbiol 2008; 8: 43., 43Bowler PG, Davies BJ. The microbiology of infected and noninfected leg ulcers Int J Dermatol 1999; 38: 573-8.-47Urbancic-Rovan V, Gubina M. Bacteria in superficial diabetic foot ulcers Diabet Med 2000; 17: 814-5.]. Genera like Finegoldia and Peptoniphilus are part of the anaerobic bacteria group and are some of the most common genera found in the wound samples of this study (Table 5). This data agrees with the previously discussed importance and prevalence of these and other anaerobes [43Bowler PG, Davies BJ. The microbiology of infected and noninfected leg ulcers Int J Dermatol 1999; 38: 573-8., 48Trengove NJ, Stacey MC, McGechie DF, Mata S. Qualitative bacteriology and leg ulcer healing J Wound Care 1996; 5: 277-80.-53Howell-Jones RS, Wilson MJ, Hill KE, et al. A review of the microbiology, antibiotic usage and resistance in chronic skin wounds J Antimicrob Chemother 2005; 55: 143-9.]. Anaerobes have been shown to be a uniting force among various multi species groups found in chronic wound infections [43Bowler PG, Davies BJ. The microbiology of infected and noninfected leg ulcers Int J Dermatol 1999; 38: 573-8.]. Although wounds are generally exposed to air [43Bowler PG, Davies BJ. The microbiology of infected and noninfected leg ulcers Int J Dermatol 1999; 38: 573-8.], this group of bacteria may survive the harmful effects of oxygen by symbiotically existing with aerobic bacteria, a process known as co-aggregation [54Bradshaw DJ, Marsh PD, Watson GK, Allison C. Role of Fusobacterium nucleatum and coaggregation in anaerobe survival in planktonic and biofilm oral microbial communities during aeration Infect Immun 1998; 66: 4729-32., 55Bradshaw DJ, Marsh PD, Allison C, Schilling KM. Effect of oxygen, inoculum composition and flow rate on development of mixed-culture oral biofilms Microbiology 1996; 142: 623-9.]. It has also been shown that oxygen does not reach the internal regions of biofilms, leaving the harmful and prevalent anaerobes unaffected [56Rasmussen K, Lewandowski Z. Microelectrode measurements of local mass transport rates in heterogeneous biofilms Biotechnol Bioeng 1998; 59: 302-9.].

Several genera seen in Table 5, although are found to occur in the top ten bacterial genera, are found in few samples. Although Wautersiellaspp. and Prevotellaspp. are prevalent in intact skin and wound samples, respectively, they are not predominant within those samples. Because so few samples contain the genera, little can be said about their importance.

Table 6 addresses the E. coli composition within wounds. Although humans generally remain unaffected by E. coli presence, opportunistically E. coli can cause serious infections. Intact skin can act as a barrier from E. coli infection. Due to a binding protein present at the surface of the skin, E. coli is unable to survive and colonize [57Bevins CL. An important clue: fingerprints point to psoriasin in defense against E.coli Nat Immunol 2005; 6: 12-3.]. It is evident the wounds have significantly greater bacterial numbers and work is well underway to elucidate these anecdotal observations. Contributing to this is the absence of functional skin barriers, exposed tissue, and therefore in the absence of psoriasin, the binding protein protecting skin, E. coli is able to colonize and grow on the wounds.

Comparison Analysis

The similarity analysis performed on the data using Pearson's methodologies resulted in supportive results for the intact skin and wound samples being somewhat similar. When the analysis was performed on paired samples, specimens extracted from the same individual in corresponding locations (for example a wound on the right ankle and intact skin on the left ankle), the correlation distance was 0.78, while the comparison on unpaired intact/wound samples results in 0.79. Because the paired and unpaired statistics are so close in value, it cannot be concluded that the intact or wounded skin affects the other. Although this number indicates a similarity on a scale of 0 to 2 the average, random distance between any two samples statistically should be 1, it cannot be concluded that an individual wound should be more similar to the corresponding intact location than it should be to any other person's intact skin. Because the Pearson's correlation distance we are dealing with is less than 1, this could imply that the flora of the wound may affect that of the intact skin, or it may be just an artifact of diabetic human flora.

The Pearson's correlation values from the unpaired analysis indicate that intact skin shares the most similarity with other intact skin. A similar statement can be made for wounds. The statistics indicate that although the differentiation can be made by a small margin, intact skin and wound samples are less similar to each other than to other samples within their group. Ultimately we find that the microbiome of chronic wounds is very distinct in composition when comparing intact skin and chronic wounds. It is obvious that the chronic wound environment promotes propagation and accumulations of key opportunistic pathogenic populations supporting the concepts of functionally equivalent pathogroups. Work will continue to more fully understand the microbiome of skin and wounds including efforts to elucidate alternative strategies and hypotheses such as the potentials of probiotic microbiota that may promote wound healing.

ACKNOWLEDGEMENT

Funding: The study was funded by internal research monies of Medical Biofilm Research Institute. Mention of trade names does not represent endorsement by the authors of this work.

REFERENCES

[1] Bjarnsholt T, Kirketerp-Moller K, Jensen PO, et al. Why chronic wounds will not heal: a novel hypothesis Wound Repair Regen 2008; 16: 2-10.
[2] Costerton JW, Lewandowski Z, Caldwell DE, Korber DR, Lappin-Scott HM. Microbial biofilms Annu Rev Microbiol 1995; 49: 711-45.
[3] Wolcott RD, Rhoads DD. A study of biofilm-based wound management in subjects with critical limb ischaemia J Wound Care 2008; 17: 145-2-54.
[4] James GA, Swogger E, Wolcott R, et al. Biofilms in chronic wounds Wound Repair Regen 2008; 16: 37-44.
[5] Percival SL, Bowler P, Woods EJ. Assessing the effect of an antimicrobial wound dressing on biofilms Wound Repair Regen 2008; 16: 52-7.
[6] Wolcott RD, Ehrlich GD. Biofilms and chronic infections JAMA 2008; 299: 2682-4.
[7] Dowd SE, Sun Y, Secor PR, et al. Survey of bacterial diversity in chronic wounds using pyrosequencing, DGGE, and full ribosome shotgun sequencing BMC Microbiol 2008; 8: 43.
[8] Wolcott RD, Kennedy JP, Dowd SE. Regular debridement is the main tool for maintaining a healthy wound bed in most chronic wounds J Wound Care 2009; 18: 54-6.
[9] CDCDFWC: Consensus Development Conference on Diabetic Foot Wound Care Boston, Massachusetts: American Diabetes Association 1999; 1354-60.
[10] National Diabetes Information Clearinghouse National Diabetes Statistics 2007 Ref Type: Online Source
[11] Ismail K, Winkley K, Stahl D, Chalder T, Edmonds M. A cohort study of people with diabetes and their first foot ulcer: the role of depression on mortality Diabetes Care 2007; 30: 1473-9.
[12] MMWR. History of foot ulcer among persons with diabetes-- United States, 2000-2002 MMWR Morb Mortal Wkly Rep 2003; 52: 1098-2.
[13] Wolcott RD, Gontcharova V, Sun Y, Zischkau AM, Dowd SE. Bacterial diversity in surgical site infections: not just aerobic cocci any more J Wound Care 2009; 18: 317-23.
[14] Dowd SE, Wolcott RD, Sun Y, McKeehan T, Smith E, Rhoads D. Polymicrobial nature of chronic diabetic foot ulcer biofilm infections determined using bacterial tag encoded FLX amplicon pyrosequencing (bTEFAP) PLoS ONE 2008; 3: e3326.
[15] Rowan NJ. Viable but non-culturable forms of food and waterborne bacteria: Quo Vadis? Trends Food Sci Technol 2004; 15: 462.
[16] Wolcott RD, Dowd SE. A rapid molecular method for characterising bacterial bioburden in chronic wounds J Wound Care 2008; 17: 513-6.
[17] Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ. Basic local alignment search tool J Mol Biol 1990; 215: 403-10.
[18] Hand DJ, Till RJ. A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems Mach Learn 2001; 45: 171-86.
[19] Fawcett T. An introduction to ROC analysis Pattern Recogn Lett 2006; 27: 861-74.
[20] Theodoridis S, Koutroumbas K. Pattern Recognition. 2nd. San Diego, Ca: Academic Press 2008.
[21] Stigler SM. Francis Galton's Account of the Invention of Correlation Stat Sci 1989; 4: 73-86.
[22] Rodgers JL, Nicewander WA. Thirteen ways to look at the correlation coefficient Am Stat 1988; 42: 59-66.
[23] Lozupone C, Hamady M, Knight R. UniFrac--an online tool for comparing microbial community diversity in a phylogenetic context BMC Bioinformatics 2006; 7: 371.
[24] Wolcott RD, Rhoads DD, Dowd SE. Biofilms and chronic wound inflammation J Wound Care 2008; 17: 333-41.
[25] Finkel SE, Kolter R. Evolution of microbial diversity during prolonged starvation Proc Natl Acad Sci USA 1999; 96: 4023-7.
[26] Hong SH, Bunge J, Jeon SO, Epstein SS. Predicting microbial species richness Proc Natl Acad Sci USA 2006; 103: 117-22.
[27] Ptacnik R, Solimini AG, Andersen T, et al. Diversity predicts stability and resource use efficiency in natural phytoplankton communities Proc Natl Acad Sci USA 2008; 105: 5134-8.
[28] Sogin ML, Morrison HG, Huber JA, et al. Microbial diversity in the deep sea and the underexplored "rare biosphere" Proc Natl Acad Sci USA 2006; 103: 12115-20.
[29] Schloss PD, Handelsman J. Introducing DOTUR, a computer program for defining operational taxonomic units and estimating species richness Appl Environ Microbiol 2005; 71: 1501-6.
[30] Dowd SE, Callaway TR, Wolcott RD, et al. Evaluation of the bacterial diversity in the feces of cattle using 16S rDNA bacterial tag-encoded FLX amplicon pyrosequencing (bTEFAP) BMC Microbiol 2008; 8: 125.
[31] Chao A, Bunge J. Estimating the number of species in a stochastic abundance model Biometrics 2002; 58: 531-9.
[32] Brenner DJ, Fanning GR, Skerman FJ, Falkow S. Polynucleotide sequence divergence among strains of Escherichia coli and closely related organisms J Bacteriol 1972; 109: 953-65.
[33] Ohnishi Y, Beppu T, Horinouchi S. Two genes encoding serine protease homologues in Serratia marcescens and characterization of their products in Escherichia coli J Biochem 1997; 121: 902-13.
[34] Langrock ML, Linde HJ, Landthaler M, Karrer S. Leg ulcers and abscesses caused by Serratia marcescens Eur J Dermatol 2008; 18: 705-.
[35] Dekio I, Hayashi H, Sakamoto M, et al. Detection of potentially novel bacterial components of the human skin microbiota using culture-independent molecular profiling J Med Microbiol 2005; 54: 1231-8.
[36] Bek-Thomsen M, Lomholt HB, Kilian M. Acne is not associated with yet-uncultured bacteria J Clin Microbiol 2008; 46: 3355-60.
[37] Gao Z, Tseng CH, Pei Z, Blaser MJ. Molecular analysis of human forearm superficial skin bacterial biota Proc Natl Acad Sci USA 2007; 104: 2927-32.
[38] Roth RR, James WD. Microbial ecology of the skin Annu Rev Microbiol 1988; 42: 441-64.
[39] Krutmann J. Pre- and probiotics for human skin J Dermatol Sci 2009; 54: 1-5.
[40] Raup DM. Taxonomic diversity estimation using rarefaction Paleobiology 1975; 1: 333-42.
[41] Funke G, Von GA, Clarridge JE, III Bernard KA. Clinical microbiology of coryneform bacteria Clin Microbiol Rev 1997; 10: 125-59.
[42] Tauch A, Kaiser O, Hain T, et al. Complete genome sequence and analysis of the multiresistant nosocomial pathogen Coryne-bacterium jeikeium K411, a lipid-requiring bacterium of the human skin flora J Bacteriol 2005; 187: 4671-82.
[43] Bowler PG, Davies BJ. The microbiology of infected and noninfected leg ulcers Int J Dermatol 1999; 38: 573-8.
[44] Brook I, Frazier EH. Aerobic and anaerobic microbiology of chronic venous ulcers Int J Dermatol 1998; 37(6): 426-8.
[45] Brook I. Role of encapsulated anaerobic bacteria in synergistic infections Crit Rev Microbiol 1987; 14: 171-93.
[46] Mayrand D, McBride BC. Exological relationships of bacteria involved in a simple, mixed anaerobic infection Infect Immun 1980; 27: 44-50.
[47] Urbancic-Rovan V, Gubina M. Bacteria in superficial diabetic foot ulcers Diabet Med 2000; 17: 814-5.
[48] Trengove NJ, Stacey MC, McGechie DF, Mata S. Qualitative bacteriology and leg ulcer healing J Wound Care 1996; 5: 277-80.
[49] Bowler PG, Davies BJ, Jones SA. Microbial involvement in chronic wound malodour J Wound Care 1999; 8: 216-8.
[50] Hansson C, Hoborn J, Moller A, Swanbeck G. The microbial flora in venous leg ulcers without clinical signs of infection. Repeated culture using a validated standardised microbiological technique Acta Derm Venereol 1995; 75: 24-30.
[51] Kontiainen S, Rinne E. Bacteria in decubitus ulcers Infection 1988; 16: 305.
[52] Kontiainen S, Rinne E. Bacteria in ulcera crurum Acta Derm Venereol 1988; 68: 240-4.
[53] Howell-Jones RS, Wilson MJ, Hill KE, et al. A review of the microbiology, antibiotic usage and resistance in chronic skin wounds J Antimicrob Chemother 2005; 55: 143-9.
[54] Bradshaw DJ, Marsh PD, Watson GK, Allison C. Role of Fusobacterium nucleatum and coaggregation in anaerobe survival in planktonic and biofilm oral microbial communities during aeration Infect Immun 1998; 66: 4729-32.
[55] Bradshaw DJ, Marsh PD, Allison C, Schilling KM. Effect of oxygen, inoculum composition and flow rate on development of mixed-culture oral biofilms Microbiology 1996; 142: 623-9.
[56] Rasmussen K, Lewandowski Z. Microelectrode measurements of local mass transport rates in heterogeneous biofilms Biotechnol Bioeng 1998; 59: 302-9.
[57] Bevins CL. An important clue: fingerprints point to psoriasin in defense against E.coli Nat Immunol 2005; 6: 12-3.

Endorsements



"Open access will revolutionize 21st century knowledge work and accelerate the diffusion of ideas and evidence that support just in time learning and the evolution of thinking in a number of disciplines."


Daniel Pesut
(Indiana University School of Nursing, USA)

"It is important that students and researchers from all over the world can have easy access to relevant, high-standard and timely scientific information. This is exactly what Open Access Journals provide and this is the reason why I support this endeavor."


Jacques Descotes
(Centre Antipoison-Centre de Pharmacovigilance, France)

"Publishing research articles is the key for future scientific progress. Open Access publishing is therefore of utmost importance for wider dissemination of information, and will help serving the best interest of the scientific community."


Patrice Talaga
(UCB S.A., Belgium)

"Open access journals are a novel concept in the medical literature. They offer accessible information to a wide variety of individuals, including physicians, medical students, clinical investigators, and the general public. They are an outstanding source of medical and scientific information."


Jeffrey M. Weinberg
(St. Luke's-Roosevelt Hospital Center, USA)

"Open access journals are extremely useful for graduate students, investigators and all other interested persons to read important scientific articles and subscribe scientific journals. Indeed, the research articles span a wide range of area and of high quality. This is specially a must for researchers belonging to institutions with limited library facility and funding to subscribe scientific journals."


Debomoy K. Lahiri
(Indiana University School of Medicine, USA)

"Open access journals represent a major break-through in publishing. They provide easy access to the latest research on a wide variety of issues. Relevant and timely articles are made available in a fraction of the time taken by more conventional publishers. Articles are of uniformly high quality and written by the world's leading authorities."


Robert Looney
(Naval Postgraduate School, USA)

"Open access journals have transformed the way scientific data is published and disseminated: particularly, whilst ensuring a high quality standard and transparency in the editorial process, they have increased the access to the scientific literature by those researchers that have limited library support or that are working on small budgets."


Richard Reithinger
(Westat, USA)

"Not only do open access journals greatly improve the access to high quality information for scientists in the developing world, it also provides extra exposure for our papers."


J. Ferwerda
(University of Oxford, UK)

"Open Access 'Chemistry' Journals allow the dissemination of knowledge at your finger tips without paying for the scientific content."


Sean L. Kitson
(Almac Sciences, Northern Ireland)

"In principle, all scientific journals should have open access, as should be science itself. Open access journals are very helpful for students, researchers and the general public including people from institutions which do not have library or cannot afford to subscribe scientific journals. The articles are high standard and cover a wide area."


Hubert Wolterbeek
(Delft University of Technology, The Netherlands)

"The widest possible diffusion of information is critical for the advancement of science. In this perspective, open access journals are instrumental in fostering researches and achievements."


Alessandro Laviano
(Sapienza - University of Rome, Italy)

"Open access journals are very useful for all scientists as they can have quick information in the different fields of science."


Philippe Hernigou
(Paris University, France)

"There are many scientists who can not afford the rather expensive subscriptions to scientific journals. Open access journals offer a good alternative for free access to good quality scientific information."


Fidel Toldrá
(Instituto de Agroquimica y Tecnologia de Alimentos, Spain)

"Open access journals have become a fundamental tool for students, researchers, patients and the general public. Many people from institutions which do not have library or cannot afford to subscribe scientific journals benefit of them on a daily basis. The articles are among the best and cover most scientific areas."


M. Bendandi
(University Clinic of Navarre, Spain)

"These journals provide researchers with a platform for rapid, open access scientific communication. The articles are of high quality and broad scope."


Peter Chiba
(University of Vienna, Austria)

"Open access journals are probably one of the most important contributions to promote and diffuse science worldwide."


Jaime Sampaio
(University of Trás-os-Montes e Alto Douro, Portugal)

"Open access journals make up a new and rather revolutionary way to scientific publication. This option opens several quite interesting possibilities to disseminate openly and freely new knowledge and even to facilitate interpersonal communication among scientists."


Eduardo A. Castro
(INIFTA, Argentina)

"Open access journals are freely available online throughout the world, for you to read, download, copy, distribute, and use. The articles published in the open access journals are high quality and cover a wide range of fields."


Kenji Hashimoto
(Chiba University, Japan)

"Open Access journals offer an innovative and efficient way of publication for academics and professionals in a wide range of disciplines. The papers published are of high quality after rigorous peer review and they are Indexed in: major international databases. I read Open Access journals to keep abreast of the recent development in my field of study."


Daniel Shek
(Chinese University of Hong Kong, Hong Kong)

"It is a modern trend for publishers to establish open access journals. Researchers, faculty members, and students will be greatly benefited by the new journals of Bentham Science Publishers Ltd. in this category."


Jih Ru Hwu
(National Central University, Taiwan)


Browse Contents



Webmaster Contact: info@benthamopen.net
Copyright © 2019 Bentham Open