A comparative analysis of HIV drug resistance interpretation based on short reverse transcriptase sequences versus full sequences
© Steegen et al; licensee BioMed Central Ltd. 2010
Received: 4 August 2010
Accepted: 15 October 2010
Published: 15 October 2010
As second-line antiretroviral treatment (ART) becomes more accessible in resource-limited settings (RLS), the need for more affordable monitoring tools such as point-of-care viral load assays and simplified genotypic HIV drug resistance (HIVDR) tests increases substantially. The prohibitive expenses of genotypic HIVDR assays could partly be addressed by focusing on a smaller region of the HIV reverse transcriptase gene (RT) that encompasses the majority of HIVDR mutations for people on ART in RLS. In this study, an in silico analysis of 125,329 RT sequences was performed to investigate the effect of submitting short RT sequences (codon 41 to 238) to the commonly used virco®TYPE and Stanford genotype interpretation tools.
Pair-wise comparisons between full-length and short RT sequences were performed. Additionally, a non-inferiority approach with a concordance limit of 95% and two-sided 95% confidence intervals was used to demonstrate concordance between HIVDR calls based on full-length and short RT sequences.
The results of this analysis showed that HIVDR interpretations based on full-length versus short RT sequences, using the Stanford algorithms, had concordance significantly above 95%. When using the virco®TYPE algorithm, similar concordance was demonstrated (>95%), but some differences were observed for d4T, AZT and TDF, where predictions were affected in more than 5% of the sequences. Most differences in interpretation, however, were due to shifts from fully susceptible to reduced susceptibility (d4T) or from reduced response to minimal response (AZT, TDF) or vice versa, as compared to the predicted full RT sequence. The virco®TYPE prediction uses many more mutations outside the RT 41-238 amino acid domain, which significantly contribute to the HIVDR prediction for these 3 antiretroviral agents.
This study illustrates the acceptability of using a shortened RT sequences (codon 41-238) to obtain reliable genotype interpretations by virco®TYPE and Stanford algorithms. Implementation of this simplified protocol could significantly reduce the cost of both resistance testing and ARV treatment monitoring in RLS.
In most developed countries, HIV treatment monitoring guidelines recommend regular viral load (VL) testing and HIV drug resistance (HIVDR) testing in the case of virologic failure and prior to treatment initiation [1, 2]. In contrast, current clinical practice in resource-limited settings (RLS) is predominantly based on clinical staging and/or CD4 measurements . However, the latest WHO recommendations promote strategic introduction of VL monitoring as well as greater access to CD4 testing for treatment initiation. In 2003 WHO and UNAIDS initiated a public health approach to HIV management by recommending standardized antiretroviral (ARV) treatment regimens in order to improve the access to HIV treatment in RLS . This approach has been successful and the number of patients on treatment in low- and middle-income countries has since increased 10-fold to more than 4 million at the end of 2008 . Despite these joint efforts, laboratory tools to monitor patients on treatment are still lacking in many parts of the world, due to the lack of infrastructure and financial resources.
Several studies have shown that CD4 measurements are inaccurate in predicting treatment failure [7–11], which has resulted in the aforementioned WHO recommendations. Therefore it is of utmost importance to develop simple and affordable alternatives to the currently available VL and HIVDR tests that could be better implemented in RLS. In the context of these challenges a public-private consortium, aiming to bring an affordable HIV monitoring algorithm to Africa (ART-A: affordable resistance testing for Africa) was established in 2008 with partners in South-Africa, Luxembourg, the Netherlands and Belgium . The overall aim of the ART-A project is to develop a more affordable HIV treatment monitoring system which can be universally applied for both individual patient management and public health purposes. In order to achieve this, the project will look at the use of dried blood spots and combine this with a cost-effective qualitative VL testing and subtype-independent confirmatory HIVDR genotyping with automated base-calling software to reduce operator errors in identifying pure mutations and mixture mutations. One strategy to reduce the costs of HIVDR testing is to focus on a partial region of the HIV-1 reverse transcriptase (RT) from codon 41 to 238. This region covers all HIVDR mutations recognized by the IAS . This approach can be justified because 98% of the patients on treatment in RLS receive a first-line drug regimen based on RT-inhibitors only . Moreover, the mutations, commonly present in patients failing a first-line drug regimen in RLS (M41L, D67N, K65R, K70R, K103N, V106A/M, Y181C, M184V, G190A, L210W, T215Y/F and K219Q/E) are all present in the shorter RT sequence [8, 14–17].
In this study, the potential effect on the prediction of HIVDR by submitting a short RT sequence from amino acid 41 to 238 to the virco®TYPE and Stanford resistance interpretation algorithms was investigated through an in silico analysis. It was not our intention to compare the performance of virco®TYPE versus Stanford.
Materials and methods
Amplification of a short RT sequence useful in HIVDR testing
As of today, HIV resistance testing is based on amplifying and sequencing of the viral protease and reverse transcription genes. This requires multiple rounds of amplification and at least 6-8 sequencing reactions. For RLS, we assumed that a cost-reduction could be implemented by sequencing a short RT region. Amplification of this short RT region (codon 41-238) is feasible using a one-step single round amplification followed by a simplified sequencing protocol. Proof of principle for this cost-reduction approach is available .
Virco database analysis
A total of 125,323 full length RT sequences (codon 1-400) were retrieved from the Virco database. For all these sequences, virco®TYPE interpretations were generated for the paired full-length RT (codon 1-400) and short RT sequences (codon 41-238) on 8 FDA-approved RT inhibitors commonly used in RLS  (lamivudine = 3TC, abacavir = ABC, zidovudine = AZT, stavudine = d4T, didanosine = ddI, tenofovir = TDF, efavirenz = EFV and nevirapine = NVP). A similar approach on non-B subtypes (n = 17,131) was used for the Stanford HIVDR interpretation algorithm.
virco®TYPE HIVDR interpretation tool
virco ® TYPE calculates the phenotypic drug susceptibility from a genotype, based on a linear regression model . The phenotypic drug susceptibility is expressed as a fold change (FC) i.e. the ratio of inhibitory concentration 50% (IC50) of a patient-derived sample to the IC50 value of a reference strain (IIIB). virco ® TYPE provides a data-driven identification of mutations affecting FC and the magnitude of their effect . The calculated FC per drug is interpreted using cut-off values. The virco®TYPE report uses clinical cut-offs (CCOs), where available . Clinical cut-offs are used to facilitate the interpretation of fold change and drug resistance. They represent thresholds on the fold change continuum to indicate loss in clinical drug activity due to resistance. These cut-offs are determined based on observational studies in treated patients. When the calculated FC falls below the lower CCO, a maximal response (MA) to treatment with that drug is predicted, whereas a minimal response (MI) is expected if the FC falls above the higher CCO value. A calculated FC that falls between the lower and higher CCO predicts reduced response (RE). When CCOs are not available for a particular drug (EFV and NVP), biological cut-offs (BCOs) are used. A biological cut-off is based on laboratory observations of viruses derived from treatment naïve patients, and gives an indication of the normal range of in vitro susceptibility of wild-type viruses. The virus is predicted to be susceptible (S) or resistant (R) to a specific drug when the calculated FC is below or above the BCO, respectively .
In this analysis virco®TYPE VPT4.3.00 was used, with the clinical and biological cut-offs currently in use on the virco®TYPE report . The optimal sequence length for virco®TYPE analysis is from codon 1 to 99 of the protease region and from codon 1 to 400 of the RT region. The minimal accepted sequence lengths are from codon 10 to 95 and from codon 41 to 238 for protease and RT respectively. Any missing sequence length should be filled with "***" or a reference strain sequence. The virco®TYPE linear regression model then calculated the resistance profile.
In this study the output from full RT sequences (codon 1-400) were compared to the resistance prediction of short RT sequences (codon 41-238), whereby the protease gene and RT codon 1-40 were replaced by the HXB2 reference strain sequence.
Stanford HIVDR interpretation tool
The Stanford HIV database interpretation algorithm is a qualitative HIVDR interpretation tool that assigns a mutation penalty score to each HIV mutation that is, according to published studies, associated with drug resistance. The total score for a drug is derived by adding up the scores of each mutation associated with HIVDR to that drug. The interpretation tool subsequently reports one of the following levels of inferred drug resistance: susceptible (S), potential low-level resistant (pLR), low-level resistant (LR), intermediate resistant (I) and high-level resistant (R) . To simplify the analysis, pLR was regarded as susceptible and LR was interpreted as intermediate. Stanford algorithm version 5.0.0 was used in this analysis.
In contract to virco®TYPE, Stanford has no restrictions on the sequence length input. For the Stanford analysis the output from full RT sequences (codon 1-400) were compared to the resistance prediction of short RT sequences (codon 41-238).
Pair wise comparisons between HIVDR calls generated from full RT and short RT
The HIVDR call changes between full RT and short RT were analyzed per drug in two groups: group 1: sequences that were attributed a 'susceptible' profile (MA or S), based on virco®TYPE analysis of the full RT sequence; and group 2: sequences that were attributed a 'resistant' profile (RE, MI or R), based on virco®TYPE analysis of the full RT sequence.
Sequences interpreted by virco®TYPE
The virco ® TYPE interpretation based on a full length RT sequence (codon 1-400) was compared to the prediction based on the shortened RT sequence (codon 41-238).
Less than 1.3% major call changes were detected when all sequences from the 'susceptible' group were analyzed. However, 2.6% of the subtype G sequences showed major changes for EFV (Figure 3b).
The analyses for subtype F1 (3TC, ABC and TDF) and subtype G (d4T) were inconclusive. This can be explained by the smaller sample size for subtype F1 (N = 745) and G (N = 560) as compared to the other subtypes (N >1000).
In the other analyses, comparisons between the HIVDR calls based on short and full length RT sequences were concordant in at least 95% of the cases, except for d4T in subtype A1, C, CRF01_AE and F1, with concordance values of 90.87% (95% CI 90.25-91.49%), 94.58% (95% CI 94.30-94.86%), 94.25% (95% CI 93.78-94.72%), 92.02% (95% CI 90.80-93.25%) respectively. Of note, all discordances were caused by minor call changes.
The highest number of major call changes in group 2 were seen among the subtype D samples for NVP (2.7%) and EFV (6.3%), see Figure 4b for more details.
Due to small sample sizes the analyses were inconclusive for the following groups: d4T (subtype A1, D and F1), subtype G (ABC) and CRF01_AE (ABC). Non-inferiority analysis in the remaining groups revealed an inferior HIVDR prediction when using short RT sequences for ABC in subtype A1 sequences, d4T in CRF01_AE, EFV in subtype D, AZT and TDF for all subtypes. As previously observed, all discordances were caused by minor call changes, with the exception of TDF on subtype A1 and B sequences, whereby just a small subset of call changes was of the major type (0.22% and 0.02%, respectively).
Sequences interpreted by Stanford
The Stanford HIVDR interpretation algorithm was applied only to the non-B sequences (n = 17,131). Neither minor nor major call changes were observed for 3TC, ABC, d4T ddI and TDF. The HIVDR calls for the remaining drugs (AZT, EFV and NVP) changed only in a few cases, with all changes being minor. For AZT, 7 sequences (0.04%) gave a different result when the short RT sequence was submitted to Stanford. The HIVDR level only changed in two sequences (0.01%) for EFV and in 13 sequences (0.08%) for NVP.
There is an increased need for affordable and robust HIV monitoring tools in RLS, including point-of-care VL assays and simplified HIVDR testing protocols. Attempts are being made to simplify currently available technologies in order to make them more accessible for RLS. This study evaluated the use of reducing the sequence length used to interpret HIVDR patterns.
The use of the shorter RT sequences in the virco®TYPE HIVDR interpretation tool was not inferior to the full RT sequence for most drugs. An inferior HIVDR interpretation in more than 5% of the cases was detected only for d4T (subtype A1, C, F1 and CRF01_AE) in the group of 'sensitive' sequences. These HIVDR interpretation changes were caused by minor changes: from fully susceptible as predicted by the full RT sequence to reduced susceptibility as predicted by the short RT sequence. Moreover, recent WHO treatment guidelines recommend to phase out the use of d4T as preferred component of first-line treatment . Therefore the clinical impact of HIVDR interpretation for d4T will be limited. In the 'resistant' group, the HIVDR prediction for AZT and TDF is of concern, as more than 5% of the sequences yielded a different HIVDR call for all subtypes when the short RT sequence was submitted to virco®TYPE. However, all call changes were minor (from 'reduced response' to 'minimal response', or vice versa), except for TDF for subtype A1 and B samples (0.22% and 0.02% major call changes, respectively). It is therefore unlikely that these HIVDR interpretation changes will have a major clinical impact. Because there is no clinical cut-off available for the NNRTIs NVP and EFV, only major call changes could be observed. The resistance call changes for those two drugs were in most cases limited to less than 3%, which is under our 5% cut-off. Moreover, the clinical relevance for the resistance prediction of these drugs is limited because they are not recommended in second line regimens.
Amino acid positions outside RT codon 41-238 contributing to the HIVDR interpretation algorithms. ROI: region of interest
RT codon 1-40
7, 8, 13, 35, 36, 40 (n = 6)
3, 13, 21, 33, 35, 39, 40 (n = 7)
3, 13, 33, 35, 36, 40 (n = 6)
3, 4, 33, 35, 36, 39, 40 (n = 7)
4, 7, 13, 21, 33, 40 (n = 6)
16, 20, 22, 27, 28, 31, 33, 34 (n = 8)
21, 31, 35 (n = 3)
RT codon 239-400
240, 248, 277, 313 (n = 4)
334, 348 (n = 2)
333 (n = 1)
240, 242, 244, 245, 282, 296, 297, 313, 334, 335, 350, 357, 359, 360, 375, 377, 386, 395 (n = 18)
334, 348, 357, 359 (n = 4)
348, 359, 360, 395 (n = 4)
242, 245, 249, 277, 297, 329, 334, 335, 353, 357, 359, 395 (n = 12)
318 (n = 1)
240, 241, 243, 244, 245, 250, 251, 257, 271, 272, 274, 282, 283, 286, 292, 297, 313, 317, 318,
329, 333, 334, 335, 338, 339, 348, 353, 356, 357, 358, 365, 366, 369, 370, 371, 375, 376, 377,
379, 381, 382, 385, 386, 390, 393, 394, 395, 400 (n = 48)
318 (n = 1)
244, 245, 248, 250, 272, 283, 286, 293, 297, 313, 317, 318, 329, 333, 334, 335, 338, 339, 348, 353,
356, 357, 358, 365, 366, 369, 370, 371, 374, 375, 376, 377, 379, 382, 385, 386, 390, 393, 394, 395,
399, 400 (n = 42)
Overall this study shows that the use of a shorter RT sequence genotype results in >95% concordance with results obtained from full length RT sequences obtained from two routinely used interpretation systems, virco®TYPE and Stanford. The results provide initial validation that the simpler shorter genotype can be considered for use in a new ARV-treatment monitoring system for use in RLS.
Nevertheless, this study also has some limitations. Firstly, despite a good representation of non-B subtypes (n= 17,131) in the dataset used, the majority of sequences in this database are subtype B, which is less relevant for RLS. To accommodate this limitation, further analysis on the effect of sequencing a short RT fragment for HIVDR testing of RLS samples accessing first-line regimens will be done in collaboration between ART-A and the PASER (PharmAccess African Studies to Evaluate Resistance) network . Secondly, the treatment data of the patients from which these sequences were derived is missing and therefore we could not make a clear differentiation between the resistance interpretations in a treatment naïve group versus a treatment exposed group. This issue will also be addressed in the future study (mentioned above) as treatment naïve and treatment failing patients will be included. Thirdly, this simplified resistance assay only focuses on assessing resistance in the RT gene, which is relevant for RLS at the moment as most of the patients receive a combination ARV regimen of RT inhibitors only. However, when protease inhibitors will become more readily available in RLS there will be a need to include the protease gene as well.
Although this simplified HIVDR interpretation algorithm still requires a lab infrastructure, skilled personnel and investment in major equipment, it also has several advantages. Firstly, amplification of the short RT region is feasible using a one-step single round amplification protocol , which reduces the risk for contamination, minimizes hands-on work and cuts down the reagent cost as only one amplification primer set is needed. Secondly, the sequencing is also simplified by reducing the number of primers from 8 (in Virco's in-house assay) to only 2. Thirdly the analysis time of the obtained short RT sequence is also reduced compared to the analysis of a full RT sequence. The obtained short RT sequence can subsequently be submitted to either Stanford or virco®TYPE. However, the biological starting material for this simplified HIVDR algorithm is plasma, which might pose a problem in RLS, as cold-chain transport and deep frozen storage is still a challenge in many places. Therefore, the ART-A team is currently investigating the feasibility of using dried blood spots as a source material to overcome this issue.
In conclusion, this comparative analysis has shown that HIVDR interpretation, based on shorter RT sequence, is not inferior compared to the use of full RT sequences for most of the commonly used HIV RT inhibitors in RLS.
This work is supported by a grant of the Netherlands Organisation for Scientific Research/Science for Global Development (NWO/WOTRO), under the Netherlands African Partnership for Capacity Development and clinical Interventions against Poverty related Diseases (NACCAP) for the Affordable Resistance Test for Africa (ART-A) project (grant: W.07.05.204.00).
- DHHS: Guidelines for the use of antiretroviral agents in HIV-infected adults and adolescents. 2008,
- EACS: Guidelines for the Clinical Management and Treatment of HIV Infected Adults in Europe 2008. 2008,
- WHO: Antiretroviral therapy for HIV infection in adults and adolescents: towards universal access. Recommendations for a public health approach. 2006, Geneva: World Health Organization,
- WHO: New WHO Recommendations: Antiretroviral therapy for adults and adolescents. Geneva: WHO,2009
- WHO: Scaling up antiretroviral therapy in resource-limited settings: Treatment guidelines for a public health approach. 2003, Geneva: World Health Organization,
- WHO/UNAIDS/UNICEF: Towards Universal Access: Scaling up priority HIV/AIDS interventions in the health sector. Progress report 2009. 2009, Geneva: WHO,
- Chaiwarith R, Wachirakaphan C, Kotarathititum W, Praparatanaphan J, Sirisanthana T, Supparatpinyo K: Sensitivity and specificity of using CD4+ measurement and clinical evaluation to determine antiretroviral treatment failure in Thailand. Int J Infect Dis. 2007, 11: 413-416. 10.1016/j.ijid.2006.11.003View ArticlePubMed
- Hosseinipour MC, van Oosterhout JJ, Weigel R, Phiri S, Kamwendo D, Parkin N: The public health approach to identify antiretroviral therapy failure: high-level nucleoside reverse transcriptase inhibitor resistance among Malawians failing first-line antiretroviral therapy. AIDS. 2009, 23: 1127-1134. 10.1097/QAD.0b013e32832ac34ePubMed CentralView ArticlePubMed
- Mee P, Fielding KL, Charalambous S, Churchyard GJ, Grant AD: Evaluation of the WHO criteria for antiretroviral treatment failure among adults in South Africa. AIDS. 2008, 22: 1971-1977. 10.1097/QAD.0b013e32830e4cd8View ArticlePubMed
- Moore DM, Awor A, Downing R, Kaplan J, Montaner JS, Hancock J: CD4+ T-cell count monitoring does not accurately identify HIV-infected adults with virologic failure receiving antiretroviral therapy. J Acquir Immune Defic Syndr. 2008, 49: 477-484. 10.1097/QAI.0b013e318186eb18View ArticlePubMed
- Reynolds SJ, Nakigozi G, Newell K, Ndyanabo A, Galiwongo R, Boaz I: Failure of immunologic criteria to appropriately identify antiretroviral treatment failure in Uganda. AIDS. 2009, 23: 697-700. 10.1097/QAD.0b013e3283262a78PubMed CentralView ArticlePubMed
- PharmAccess: Amsterdam; 2009,http://www.arta-africa.org
- Johnson VA, Brun-Vezinet F, Clotet B, Gunthard HF, Kuritzkes DR, Pillay D: Update of the drug resistance mutations in HIV-1: December 2009. Top HIV Med. 2009, 17: 138-145.PubMed
- Barth RE, van der Loeff MF, Schuurman R, Hoepelman AI, Wensing AM: Virological follow-up of adult patients in antiretroviral treatment programmes in sub-Saharan Africa: a systematic review. Lancet Infect Dis. 2010, 10: 155-166. 10.1016/S1473-3099(09)70328-7View ArticlePubMed
- Marconi VC, Sunpath H, Lu Z, Gordon M, Koranteng-Apeagyei K, Hampton J: Prevalence of HIV-1 drug resistance after failure of a first highly active antiretroviral therapy regimen in KwaZulu Natal, South Africa. Clin Infect Dis. 2008, 46: 1589-1597. 10.1086/587109PubMed CentralView ArticlePubMed
- Orrell C, Walensky RP, Losina E, Pitt J, Freedberg KA, Wood R: HIV type-1 clade C resistance genotypes in treatment-naive patients and after first virological failure in a large community antiretroviral therapy programme. Antivir Ther. 2009, 14: 523-531.PubMed CentralPubMed
- Wallis CL, Mellors JW, Venter WD, Sanne I, Stevens W: Varied patterns of HIV-1 drug resistance on failing first-line antiretroviral therapy in South Africa. J Acquir Immune Defic Syndr. 2010, 53: 480-484. 10.1097/QAI.0b013e3181bc478bView ArticlePubMed
- Steegen K, Bronze M, Van Craenenbroeck E, Stevens W, Rinke de Wit TF, Stuyver LJ: An affordable genotypic HIV drug resistance protocol for truncated reverse transcriptase compatible to the vircoTYPE prediction tool (O_4). 3rd International Workshop on HIV Treatment, Pathogenesis and Prevention Research in Resource-poor Settings. 2009, Lusaka, Zambia,
- Vermeiren H, Van Craenenbroeck E, Alen P, Bacheler L, Picchio G, Lecocq P: Prediction of HIV-1 drug susceptibility phenotype from the viral genotype using linear regression modeling. J Virol Methods. 2007, 145: 47-55. 10.1016/j.jviromet.2007.05.009View ArticlePubMed
- Winters B, Van Craenenbroeck E, Van der Borght K, Lecocq P, Villacian J, Bacheler L: Clinical cut-offs for HIV-1 phenotypic resistance estimates: update based on recent pivotal clinical trial data and a revised approach to viral mixtures. J Virol Methods. 2009, 162: 101-108. 10.1016/j.jviromet.2009.07.023View ArticlePubMed
- Verlinden Y, Vermeiren H, Lecocq P, Bacheler L, McKenna P, Vanpachtenbeke M: Assessment of the Antivirogram® performance over time including a revised definition of biological test cut-off values. XIVth International HIV Drug Resistance Workshop. 2005, Québec City, Québec, Canada,
- Stanford: Palo Alto, California: Stanford University; 1998, http://hivdb.stanford.edu/
- PharmAccess: Amsterdam; http://www.pharmaccess.org/Default.asp?Page=126
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.