An alternative methodology for the prediction of adherence to anti HIV treatment
© Thompson et al; licensee BioMed Central Ltd. 2009
Received: 10 October 2008
Accepted: 01 June 2009
Published: 01 June 2009
Successful treatment of HIV-positive patients is fundamental to controlling the progression to AIDS. Causes of treatment failure are either related to drug resistance and/or insufficient drug levels in the blood. Severe side effects, coupled with the intense nature of many regimens, can lead to treatment fatigue and consequently to periodic or permanent non-adherence. Although non-adherence is a recognised problem in HIV treatment, it is still poorly detected in both clinical practice and research and often based on unreliable information such as self-reports, or in a research setting, Medication Events Monitoring System caps or prescription refill rates. To meet the need for having objective information on adherence, we propose a method using viral load and HIV genome sequence data to identify non-adherence amongst patients.
Presentation of the hypothesis
With non-adherence operationally defined as a sharp increase in viral load in the absence of mutation, it is hypothesised that periods of non-adherence can be identified retrospectively based on the observed relationship between changes in viral load and mutation.
Testing the hypothesis
Spikes in the viral load (VL) can be identified from time periods over which VL rises above the undetectable level to a point at which the VL decreases by a threshold amount. The presence of mutations can be established by comparing each sequence to a reference sequence and by comparing sequences in pairs taken sequentially in time, in order to identify changes within the sequences at or around 'treatment change events'. Observed spikes in VL measurements without mutation in the corresponding sequence data then serve as a proxy indicator of non-adherence.
Implications of the hypothesis
It is envisaged that the validation of the hypothesised approach will serve as a first step on the road to clinical practice. The information inferred from clinical data on adherence would be a crucially important feature of treatment prediction tools provided for practitioners to aid daily practice. In addition, distinct characteristics of biological markers routinely used to assess the state of the disease may be identified in the adherent and non-adherent groups. This latter approach would directly help clinicians to differentiate between non-responding and non-adherent patients.
Whilst the first cases of AIDS were identified in the USA [1, 2], and shortly after in Europe [3, 4] it is now known that the disease originated from sub-Saharan Africa , which currently holds two thirds of the world's 33.2 million people living with HIV. Recent estimates also suggest that Africa has 1.7 million of the global 2.5 million individuals newly infected during 2007 . During 1983, 3,064 people in the US were found to have AIDS, of which a third died ; the number infected had risen to 20,745 by 1987 . The rapid spread of HIV over the early pre-treatment years is testament to the aggressive nature of the disease and the importance of using effective drugs to combat this infection. However, a recent analysis showed that life expectancy at age 20 years had increased by over 13 years since the introduction of combination antiretroviral therapy and currently life expectancy of HIV patients at age 20 is up to two thirds that of the general non-HIV population .
At present, HIV is treated with a combination of drugs known as highly active anti-retroviral therapy (HAART) or combined anti-retroviral therapy, which works on the principle of using a combination of different classes of drugs to simultaneously impact a range of viral targets. The extent to which patients adhere to their therapy regime is pivotal to treatment success. Although adherence-nonadherence occurs on a continuum, in the case of HIV treatment exceptionally high levels of adherence (> 95%) to HAART are required to suppress viral replication .
Treatment change decisions for patients with AIDS who are undergoing HAART are commonly based on clinical treatment history data, ideally including VL, CD4 and genotype information with adherence assumed, based on practical experience or self-declared. Thus designing successful treatment regimes requires an accurate understanding of factors affecting or affected by patients' adherence.
The importance of adherence
The side effects from HAART drugs affect most patients and can be debilitating. Since HIV causes long-term infection, patients often become fatigued by the constant necessity to take medication and from their severe side effects. Whilst these drugs are highly effective when taken correctly, incorrect use can lead to the development of resistance. Contrastingly, adherence levels which are too low to generate resistance do not decrease or delay the progression to AIDS , but a 10% improvement in adherence can lead to a 28% decrease in the risk of developing AIDS .
Whilst research has shown that 100% adherence is not necessary for viral suppression, accumulation of drug resistance increases with adherence where patients have incomplete viral suppression [10, 11]. It has been observed that adherent patients have longer periods of successful treatment and lower mortality rates than patients who are less adherent [11, 13], but patients with lower levels of adherence carry fewer resistant strains [10, 11]. This drug dependent adherence/resistance relationship is typically stronger for protease inhibitors (PI) than for other drug classes [11, 13, 14]. For example within a population of patients on a single-PI therapy, maximum drug resistance occurs at around 80% adherence . In addition, poor adherence in patients with discordant responses (exhibiting a positive response to treatment in VL but not CD4, or vice versa) has been associated with increased mortality, as these patients are thought to be less able to produce complete responses to treatment .
The literature provides a wealth of possible methodologies to improve patient adherence. Whilst work in Africa has improved adherence through the instigation of workplace clinics , work elsewhere has suggested that improving patients knowledge and understanding of their disease and its treatment, either by nursing staff or community-led through pharmacies, has a positive impact on adherence levels. There is evidence to suggest that the impact upon adherence is minimal when this information is supplied by clinicians. This effect may be due to the impact of the patient-'provider' interaction upon a patient's confidence to adhere. A recent pilot study showed that mobile phone reminders were effective in encouraging patients to consistently maintain high levels of adherence throughout the study period . However, the researchers found that adherence waned following the study and that longer monitoring periods may be more beneficial to improving long-term adherence.
Modelling of patient data suggests that patients who feel confident in their ability to adhere to their treatments are more likely to adhere and maintain undetectable VL levels . This notion has been supported by recent patient studies . It has been observed that patients' prognosis is likely to improve , through the development of strong patient to care provider relationships and individualised treatment. More recently it has been shown that hospitalisation of patients whilst initialising treatment significantly improves their levels of long-term adherence . Johnson et al. suggests that adherence behaviour can be influenced by a minimal educational effort prior to the commencement of retroviral therapy  although there is some concern over the long term efficacy when the information content is low.
The ability of patients to understand both their disease and its treatment has a major effect on adherence; by supplying information in a (primarily) pictographic rather than written form, researchers were able to demonstrate improved understanding and compliance by patients with literacy issues . Patients who received didactic interventions were more likely to report high levels of adherence and to achieve undetectable VL level. Self-reporting did not inflate the effect of such interventions, yet objective measures of adherence tend to inflate effect size . For comprehensive reviews of behavioural interventions in HIV treatment and management there are a number of published articles available, including Munro et al.  and Strathdee & Patterson .
Evidence of adherence or lack of adherence
Given its importance, a plethora of literature focuses on assessment of adherence, typically using medical variables (CD4 counts, VL measures, plasma drug levels, biologic surrogate markers and presence of the antiretroviral medication in the body), inventory-type indicators (pill counts, pharmacy refills, electronic medication monitors), self-reports (patient diaries) or questionnaires on behavior or psychological assessments of factors assumed to predispose the risks for nonadherence . However, a considerable threat to validity is embedded in each of these assessments: In real-life situations and observational studies, medical variables are likely to be confounded by other unmeasured factors (such as co-infection, nonadherence, drug use). The validity and reliability of self-reported information are questionable.
As yet there is no 'gold standard' for adherence measurement in HIV patients and recent research  has suggested that the use of multiple measures will be of greater benefit than the continued search for a single defining adherence measure. Current methods can be divided into two forms: i) subjective, such as various self-report and interview based methods and ii) semi-objective, such as the use of MEMS caps and prescription refill rates; however, their link to actual behaviour is dubious.
It is apparent that the use of plasma drug levels to directly measure drug concentrations would be the most accurate and objective way of measuring adherence , however using such a method outside the context of a clinical trial has logistical and cost implications, even if patients were to agree to having blood taken regularly for this additional purpose.
Short-term changes in VL (a single low but detectable VL, immediately preceded and followed by undetectable VL measurements) have been shown to be associated with short term decreases in adherence, associated with the development of resistance and/or subsequent treatment failure . In previous work, in order to simplify the analysis it has often been assumed that adherence is a 'constant' state influenced by a short list of factors, and therefore patients were assumed to be either adherent or non-adherent. However Lazo et al.  recently showed that adherence to treatment is dynamic in nature and the factors affecting increases in adherence are not the same as those affecting decreases in adherence. Recently it has been shown that many patients who miss treatments often do so because they 'simply forgot' .
Presentation of the hypothesis
The importance of having accurate information on adherence is underscored by the fact that in order to achieve successful treatments, physicians must have accurate and reliable information on the effectiveness and efficacy of the prescribed treatment regime. To meet the need for having objective information on adherence, a method is proposed using VL and HIV genome sequence data to observe adherence amongst patients.
Previous work has shown that VL is strongly predicted by patient adherence, whereas drug resistance is a weaker predictor of VL. Bangsberg et al.  have suggested that the strength of the relationship may vary between clinical settings, drug regimen and even study population. Through modelling factors affecting variation in VL, Llabre et al.  demonstrated that adherence explains about half of a patient's VL variability. Previously, Moore et al. have shown that poor responses to treatments may not be related to the development of drug resistance mutations .
Many studies have used current data from patients to establish the relationships between VL and adherence (examples include [15–17, 19, 22, 23, 33–37]). It is therefore postulated that the strength of the relationship between adherence and VL is such that where there is no evidence of mutation, levels of adherence can be estimated through patterns of change in VL. The challenge in this approach arises from the need to identify whether the observed changes in VL are due to developed drug resistance or non-adherence. Hence the hypothesis is presented that periods of non-adherence can be retrospectively observed through changes in VL.
It is suggested that the adherence hypothesis could be validated by analysing the rate of change in VL, in the context of observed mutations within the HIV genome. It seems likely that a gradual increase in VL would result from something other than non-adherence, such as low level or intermittent adherence. Non-adherence would be likely to give rise to a sharp increase (high rate of change) in VL, which would appear as 'spikes' in the VL time series. The 'spikes' could then be classified into the 'likelihood of adherence/non-adherence' groupings based upon the rate of change of VL and the presence of mutation.
Testing the hypothesis
The preliminary work relating to testing this hypothesis requires longitudinal data that includes VL and sequence data from patients. VL points should be collated to produce pairs of VL measurements relating to the start and end points of an increase in log10 (VL) of greater than 2 log – In keeping with the clinical practice underlying the EuResist modelling work, this magnitude of change is suggested as it would give a large enough change to avoid inclusion of insignificant fluctuations in VL . These pairs of time points can then be associated with a HIV sequence collected shortly beforehand, such as within a few months of the first time point in the VL pair.
The HIV pol sequences should be compared to a reference pol sequence and if possible to a previously collected sequence. For information on HIV genomic sequencing that will be used to test the hypothesis, see the background documents of the EuResist prediction engine . In order to identify a sequence as being mutated it is necessary to identify changes relative to both the reference sequence and a prior sequence, this will ensure that mutations in the sequence are not incorrectly associated with the current treatment. Direct comparison of each sequence with the reference sequence using tools such as BLAST  and FASTA  would facilitate the removal of mutation sequences occurring outside the time frame of interest in order to identify mutations present within each treatment change episode .
The rate of change in log10 (VL) is defined as the increase in log10(VL) divided by the time period over which it occurred. For example, for spike 1 the rate would be (5.2–1.8) divided by (number of days between 1 June 1998 and 1 Oct 1998). It is clear from the graph in Fig 1 that slope 2 is too shallow to be considered a spike but if sequence B were found to be unmutated and the slope at spike 1 was to exceed an as yet undetermined threshold value, the possibility that this patient had been non-adherent during the treatment period could be assessed.
Implications of the hypothesis
Whilst clearly preliminary work to validate this hypothesis needs to be undertaken, if validated the information gained could be used to corroborate and clarify verbal adherence discussions between patients and care-providers, enabling care-providers to recognise adherence problems more accurately and identify opportunities to provide appropriate (re-) education, assistance or regimen change, to minimise disease progression.
If established, this approach will clearly allow for the level of adherence to drug therapy regimes to be monitored. Additionally, such an analysis would facilitate a more accurate assessment of the progression of the patient in terms of their disease status relative to treatment stratagem with a known integrity continuum, resulting in improved treatment and better life expectancy of HIV infected patients.
In clinical practice, removed from research studies utilising various methods to detail adherence in patients, clinicians routinely rely on verbal discussions to identify periods of non-adherence. With a clear expectation for adherence, it is plausible that some (or many) patients are unwilling to openly admit non-adherence, leading to inadvertently misleading their treating physicians. The utilisation of VL data, with knowledge of the presence (or lack) of drug resistant mutations, should allow clinicians to form a more accurate picture of the adherence levels of their patients. This will allow treatment change events and clinical management alterations to be made that may prevent or reduce the occurrence of patient non-adherence to the therapeutic regime. It should be noted however, that the levels of accuracy in this type of analysis are likely to be dependent on the time periods between VL measurements, which are typically every six months in patients with HIV. The limitations of this hypothesis as applied to clinical practice include the access to and costs of sequencing.
Therefore, it is envisaged that the hypothesised approach will serve as a first step on the road to clinical practice. The information on adherence inferred from clinical data is a crucially important feature of treatment prediction models provided for practitioners to aid daily practice. In addition, distinct characteristics of biological markers routinely used to assess the state of the disease may be identified in the adherent and non-adherent groups. This latter approach would directly help clinicians to differentiate between non-responding and non-adherent patients.
IRT is a PhD student, PB is a Principal Lecturer in Statistics, JDP is a Principal Lecturer in Computing, AP is a Reader in Public Health, MDF is a Reader in Medical Microbiology. EuResist is a research consortium funded under the EC's FP6 IST programme (for member institutions and researchers, see http://www.euresist.org).
The authors would like to particularly thank Maurizio Zazzi [ARCA], Anders Sönnerborg [Karolinska], Rolf Kaiser [Arevir] for their data and Yardena Peres [IBM, Israel] for the integration of these data; all other partners within the EuResist project for input and discussion at various points throughout this work, including other members from Informa S.r.I.(Rome, Italy), Università degli Studi di Siena (University of Siena, Italy), Karolinska Institutet (Karolinska Medical University, Stockholm, Sweden), Universität zu Köln (University of Cologne, Cologne, Germany), IBM Israel – Science and Technology LTD (Haifa, Israel), Max Planck-Institut für Informatik (Max-Planck-Institute for Informatics, Saarbrücken, Germany), Központi Fizikai Kutató Intézet – Részecske-és Magfizikai Kutatóintézet (Central Research Institute for Physics – Research Institute for Particle and Nuclear Physics, Budapest, Hungary).
- Hymes KB, Cheung T, Greene JB, Prose NS, Marcus A, Ballard H, William DC, Laubenstein LJ: Kaposi's sarcoma in homosexual men-a report of eight cases. Lancet. 1981, 2: 598-600.View ArticlePubMedGoogle Scholar
- Centers for Disease Control (CDC): Pneumocystis pneumonia–Los Angeles. MMWR Morb Mortal Wkly Rep. 1981, 30 (21): 250-252.Google Scholar
- Thomsen HK, Jacobsen M, Malchow-Moller A: Kaposi sarcoma among homosexual men in Europe. Lancet. 1981, 2: 688-View ArticlePubMedGoogle Scholar
- Landesman SH, Ginzburg HM, Weiss SH: The AIDS epidemic. N Engl J Med. 1985, 312: 521-525.View ArticlePubMedGoogle Scholar
- Gao F, Bailes E, Robertson DL, Chen Y, Rodenburg CM, Michael SF, Cummins LB, Arthur LO, Peeters M, Shaw GM, Sharp PM, Hahn BH: Origin of HIV-1 in the chimpanzee Pan troglodytes troglodytes. Nature. 1999, 397: 436-441.View ArticlePubMedGoogle Scholar
- UNAIDS: AIDS epidemic update 07. 2008.Google Scholar
- Centers for Disease Control (CDC): Acquired Immunodeficiency Syndrome (AIDS) weekly surveillance report- United States. 1983.Google Scholar
- Curran JW, Jaffe HW, Hardy AM, Morgan WM, Selik RM, Dondero TJ: Epidemiology of HIV infection and AIDS in the United States. Science. 1988, 239: 610-616.View ArticlePubMedGoogle Scholar
- Antiretroviral Therapy Cohort Collaboration: Life expectancy of individuals on combination antiretroviral therapy in high-income countries: a collaborative analysis of 14 cohort studies. Lancet. 2008, 372: 293-299.View ArticleGoogle Scholar
- Lucas GM: Antiretroviral adherence, drug resistance, viral fitness and HIV disease progression: a tangled web is woven. J Antimicrob Chemother. 2005, 55: 413-416.View ArticlePubMedGoogle Scholar
- Bangsberg DR, Charlebois ED, Grant RM, Holodniy M, Deeks SG, Perry S, Conroy KN, Clark R, Guzman D, Zolopa A, Moss A: High levels of adherence do not prevent accumulation of HIV drug resistance mutations. AIDS. 2003, 17: 1925-1932.View ArticlePubMedGoogle Scholar
- Walsh JC, Pozniak AL, Nelson MR, Mandalia S, Gazzard BG: Virologic rebound on HAART in the context of low treatment adherence is associated with a low prevalence of antiretroviral drug resistance. J Acquir Immune Defic Syndr. 2002, 30: 278-287.View ArticlePubMedGoogle Scholar
- Bangsberg DR, Porco TC, Kagay C, Charlebois ED, Deeks SG, Guzman D, Clark R, Moss A: Modeling the HIV protease inhibitor adherence-resistance curve by use of empirically derived estimates. J Infect Dis. 2004, 190: 162-165.View ArticlePubMedGoogle Scholar
- Bangsberg DR, Deeks SG: Is average adherence to HIV antiretroviral therapy enough?. J Gen Intern Med. 2002, 17 (10): 812-813.PubMed CentralView ArticlePubMedGoogle Scholar
- Moore DM, Hogg RS, Yip B, Wood E, Tyndall M, Braitstein P, Montaner JS: Discordant immunologic and virologic responses to highly active antiretroviral therapy are associated with increased mortality and poor adherence to therapy. J Acquir Immune Defic Syndr. 2005, 40: 288-293.View ArticlePubMedGoogle Scholar
- Charalambous S, Innes C, Muirhead D, Kumaranayake L, Fielding K, Pemba L, Hamilton R, Grant A, Churchyard GJ: Evaluation of a workplace HIV treatment programme in South Africa. AIDS. 2007, 21 (Suppl 3): S73-78.View ArticlePubMedGoogle Scholar
- Puccio JA, Belzer M, Olson J, Martinez M, Salata C, Tucker D, Tanaka D: The use of cell phone reminder calls for assisting HIV-infected adolescents and young adults to adhere to highly active antiretroviral therapy: a pilot study. AIDS Patient Care STDS. 2006, 20: 438-444.View ArticlePubMedGoogle Scholar
- Johnson MO, Chesney MA, Goldstein RB, Remien RH, Catz S, Gore-Felton C, Charlebois E, Morin SF, National Institute of Mental Health Healthy Living Project Team: Positive provider interactions, adherence self-efficacy, and adherence to antiretroviral medications among HIV-infected adults: A mediation model. AIDS Patient Care STDS. 2006, 20: 258-268.PubMed CentralView ArticlePubMedGoogle Scholar
- Molassiotis A, Morris K, Trueman I: The importance of the patient-clinician relationship in adherence to antiretroviral medication. Int J Nurs Pract. 2007, 13: 370-376.View ArticlePubMedGoogle Scholar
- Lattuada E, Lanzafame M, Gottardi M, Corsini F, Concia E, Vento S: Initial hospitalization and adherence to highly active antiretroviral therapy. Clin Infect Dis. 2008, 46: 957-958.View ArticlePubMedGoogle Scholar
- Johnson MO, Charlebois E, Morin SF, Remien RH, Chesney MA, National Institute of Mental Health Healthy Living Project Team: Effects of a behavioral intervention on antiretroviral medication adherence among people living with HIV: the healthy living project randomized controlled study. J Acquir Immune Defic Syndr. 2007, 46: 574-580.PubMed CentralView ArticlePubMedGoogle Scholar
- Kalichman SC, Cherry J, Cain D: Nurse-delivered antiretroviral treatment adherence intervention for people with low literacy skills and living with HIV/AIDS. J Assoc Nurses AIDS Care. 2005, 16: 3-15.View ArticlePubMedGoogle Scholar
- Simoni JM, Pearson CR, Pantalone DW, Marks G, Crepaz N: Efficacy of interventions in improving highly active antiretroviral therapy adherence and HIV-1 RNA viral load. A meta-analytic review of randomized controlled trials. J Acquir Immune Defic Syndr. 2006, 43 (Suppl 1): S23-35.PubMed CentralView ArticlePubMedGoogle Scholar
- Munro S, Lewin S, Swart T, Volmink J: A review of health behaviour theories: how useful are these for developing interventions to promote long-term medication adherence for TB and HIV/AIDS?. BMC Public Health. 2007, 7 (147): 104-119.PubMed CentralView ArticlePubMedGoogle Scholar
- Strathdee SA, Patterson TL: Behavioral interventions for HIV-positive and HCV-positive drug users. AIDS Behav. 2006, 10: 115-130.View ArticlePubMedGoogle Scholar
- Chesney MA: The elusive gold standard. Future perspectives for HIV adherence assessment and intervention. J Acquir Immune Defic Syndr. 2006, 43 (Suppl 1): S149-155.View ArticlePubMedGoogle Scholar
- Rakhmanina NY, Anker van den JN, Soldin SJ: Therapeutic drug monitoring of antiretroviral therapy. AIDS Patient Care STDS. 2004, 18: 7-14.View ArticlePubMedGoogle Scholar
- Podsadecki TJ, Vrijens BC, Tousset EP, Rode RA, Hanna GJ: Decreased adherence to antiretroviral therapy observed prior to transient human immunodeficiency virus type 1 viremia. J Infect Dis. 2007, 196: 1773-1778.View ArticlePubMedGoogle Scholar
- Lazo M, Gange SJ, Wilson TE, Anastos K, Ostrow DG, Witt MD, Jacobson LP: Patterns and predictors of changes in adherence to highly active antiretroviral therapy: longitudinal study of men and women. Clin Infect Dis. 2007, 45: 1377-1385.View ArticlePubMedGoogle Scholar
- Barfod TS, Sorensen HT, Nielsen H, Rodkjaer L, Obel N: 'Simply forgot' is the most frequently stated reason for missed doses of HAART irrespective of degree of adherence. HIV Med. 2006, 7: 285-290.View ArticlePubMedGoogle Scholar
- Bangsberg DR, Hecht FM, Charlebois ED, Zolopa AR, Holodniy M, Sheiner L, Bamberger JD, Chesney MA, Moss A: Adherence to protease inhibitors, HIV-1 viral load, and development of drug resistance in an indigent population. AIDS. 2000, 14: 357-366.View ArticlePubMedGoogle Scholar
- Llabre MM, Weaver KE, Duran RE, Antoni MH, McPherson-Baker S, Schneiderman N: A measurement model of medication adherence to highly active antiretroviral therapy and its relation to viral load in HIV-positive adults. AIDS Patient Care STDS. 2006, 20: 701-711.View ArticlePubMedGoogle Scholar
- Nicca D, Moody K, Elzi L, Spirig R: Comprehensive clinical adherence interventions to enable antiretroviral therapy: a case report. J Assoc Nurses AIDS Care. 2007, 18: 44-53.View ArticlePubMedGoogle Scholar
- Kalichman SC, Cain D, Cherry C, Kalichman M, Pope H: Pillboxes and antiretroviral adherence: prevalence of use, perceived benefits, and implications for electronic medication monitoring devices. AIDS Patient Care STDS. 2005, 19: 833-839.View ArticlePubMedGoogle Scholar
- Bouhnik AD, Chesney M, Carrieri P, Gallais H, Moreau J, Moatti JP, Obadia Y, Spire B, MANIF 2000 Study Group: Nonadherence among HIV-infected injecting drug users: the impact of social instability. J Acquir Immune Defic Syndr. 2002, 31 (Suppl 3): S149-153.View ArticlePubMedGoogle Scholar
- Oyugi JH, Byakika-Tusiime J, Charlebois ED, Kityo C, Mugerwa R, Mugyenyi P, Bangsberg DR: Multiple validated measures of adherence indicate high levels of adherence to generic HIV antiretroviral therapy in a resource-limited setting. J Acquir Immune Defic Syndr. 2004, 36: 1100-1102.View ArticlePubMedGoogle Scholar
- Samet JH, Sullivan LM, Traphagen ET, Ickovics JR: Measuring Adherence Among HIV-Infected Persons: Is MEMS Consummate Technology?. AIDS and Behavior. 2001, 5: 21-30.View ArticleGoogle Scholar
- Altmann A, Rosen-Zvi M, Prosperi M, Aharoni E, Neuvirth H, Schulter E, Buch J, Struck D, Peres Y, Incardona F, Sonnerborg A, Kaiser R, Zazzi M, Lengauer T: Comparison of classifier fusion methods for predicting response to anti HIV-1 therapy. PLoS ONE. 2008, 3: e3470-PubMed CentralView ArticlePubMedGoogle Scholar
- EuResist prediction system. http://engine.euresist.org
- Tatusova TA, Madden TL: BLAST 2 Sequences, a new tool for comparing protein and nucleotide sequences. FEMS Microbiol Lett. 1999, 174: 247-250.View ArticlePubMedGoogle Scholar
- Pearson WR: Rapid and sensitive sequence comparison with FASTP and FASTA. Methods Enzymol. 1990, 183: 63-98.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.