Comparison of six methods to estimate adherence in an ART-naïve cohort in a resource-poor setting: which best predicts virological and resistance outcomes?
- Catherine Orrell1, 6Email author,
- Karen Cohen2,
- Rory Leisegang2,
- David R. Bangsberg3, 4, 5,
- Robin Wood†1 and
- Gary Maartens†2
© The Author(s) 2017
Received: 1 September 2016
Accepted: 1 March 2017
Published: 4 April 2017
Incomplete adherence to antiretroviral therapy (ART) results in virologic failure and resistance. It remains unclear which adherence measure best predicts these outcomes. We compared six patient-reported and objective adherence measures in one ART-naïve cohort in South Africa.
We recruited 230 participants from a community ART clinic and prospectively collected demographic data, CD4 count and HIV-RNA at weeks 0, 16 and 48. We quantified adherence using 3-day self-report (SR), clinic-based pill count (CPC), average adherence by pharmacy refill (PR-average), calculation of medication-free days (PR-gaps), efavirenz therapeutic drug monitoring (TDM) and an electronic adherence monitoring device (EAMD). Associations between adherence measures and virologic and genotypic outcomes were modelled using logistic regression, with the area under the curve (AUC) from the receiver operator characteristic (ROC) analyses derived to assess performance of adherence measures in predicting outcomes.
At week 48 median (IQR) adherence was: SR 100% (100–100), CPC 100% (95–107), PR-average 103% (95–105), PR-gaps 100% (95–100) and EAMD 86% (59–94), and efavirenz concentrations were therapeutic (>1 mg/L) in 92%. EAMD, PR-average, PR-gaps and CPC best predicted virological outcome at week 48 with AUC ROC of 0.73 (95% CI 0.61–0.83), 0.73 (95% CI 0.61–0.85), 0.72 (95% CI 0.59–0.84) and 0.64 (95% CI 0.52–0.76) respectively. EAMD, PR-gaps and PR-average were highly predictive of detection of resistance mutations at week 48, with AUC ROC of 0.92 (95% CI 0.87–0.97), 0.86 (0.67–1.0) and 0.83 (95% CI 0.65–1.0) respectively. SR and TDM were poorly predictive of outcomes at week 48.
EAMD and both PR measures predicted resistance and virological failure similarly. Pharmacy refill data is a pragmatic adherence measure in resource-limited settings where electronic monitoring is unavailable.
Trial registration The trial was retrospectively registered in the Pan African Clinical Trials Registry, number PACTR201311000641402, on the 13 Sep 2013 (www.pactr.org). The first participant was enrolled on the 12th July 2012. The last patient last visit (week 48) was 15 April 2014
KeywordsHIV Antiretroviral therapy Adherence Electronic monitoring Virological outcome HIV-1 resistance Genotyping
Adherence is critical to realising the clinical and prevention benefits of ART [1–3]. Despite this, there is no gold standard identifying adherence levels and patterns that place individuals at risk for virologic failure and/or drug resistance [4–6].
A variety of ART adherence measures have been used in both observational and intervention studies. Self-report is the most frequently used method, but is often imprecise and overestimates adherence, similar to clinic-based pill count [4–7]. Pharmacy refill data also overestimate adherence, but have been consistently associated with virological failure and mortality [8–10]. Electronic drug monitoring methods have been closely associated with virologic failure, despite underestimating adherence due to storage and ingestion of medications outside of the device (pocket-doses) [6, 11, 12]. Therapeutic drug concentration monitoring has been associated with virologic outcomes, though its precision relative to other adherence monitoring approaches is poorly understood [3, 13, 14].
Our study compared a variety of adherence measures, three widely accessible to clinicians in a resource-poor setting: self-report (SR), clinic-based pill count (CPC) and pharmacy refill data (PR-average); and three requiring additional technology or calculation: therapeutic drug monitoring (TDM), calculation of medication free days or gaps (PR-gaps) and real-time electronic drug monitoring. All adherence measures were collected in a prospective ART-naïve cohort starting first-line ART, in order to explore which measure best predicted virological or resistance outcome at 16 and 48 weeks into treatment.
Participants and setting
This study is a sub-study of a randomised controlled trial recruited at the Hannan Crusaid Treatment Centre, an outpatient antiretroviral treatment centre in Cape Town, South Africa. This site and the study have been described elsewhere [19, 20]. The cohort included ART-naïve adults and adolescents (≥12 years) starting first-line ART. Participants were eligible for the parent study if they had their own mobile phone, signed an informed consent, and had either a baseline CD4 count below 350 cells/µl or a stage 3 or 4 AIDs-defining illness in keeping with the national HIV guidelines for starting ART . All patients on the parent study with viral load data available at week 16 or week 48 were included in this sub-study.
Standard of care (SoC)
All participants received three group counsellor-driven treatment preparedness sessions prior to commencing ART [21, 22]. They were visited at home by a community care worker to confirm address and ascertain home circumstances. All participants commenced a non-nucleoside reverse transcriptase inhibitor (NNRTI)-based first-line ART regimen. SoC visit frequency and procedures are detailed in Additional file 1: Table S1. Counts of pill returns were done at each scheduled clinic visit. Those with a raised HIV-RNA (>1000 copies/ml) or non-optimal clinic-based pill count adherence (<90%) received additional adherence support, which included tailored counselling, monthly drug dispensing and follow-up home-visits. Participants were traced by phone and home visit if they were more than 4 weeks late in attending a scheduled clinic visit.
Study design and procedures
The parent study was a randomised controlled trial, with primary outcome at 48 weeks, investigating the impact of mobile phone message reminders when missed doses were detected by a real-time electronic adherence monitoring device (EAMD) on adherence to ART . This device has been used in other resource-limited settings [23, 24]. This sub-study includes data from participants without reference to study arm.
Baseline demographic, clinical treatment and psychosocial characteristics of participants
With VL at week 16
With VL at week 48
Female sex: n (%)
Age in years: mean (SD)
Height (cm): mean (SD)
Weight (kg): median (IQR)
BMI: median (IQR)
WHO stage: n (%)
CD4 count (cells/mm3): median (IQR)
Log HIV-RNA (copies/ml): median (IQR)
NNRTI at start: n (%)
NRTI at starta: n (%)
HADS depression score of 8 or above (borderline or case)b: n (%)
HADS anxiety score of 8 or above (borderline or case)b: n (%)
Non-disclosure: n (%)
CAGE score ≥ 2: n (%)
Demographic and psychosocial details, including age, gender, weight, height as well as assessments for depression, anxiety and alcohol use, were collected at screening. The 14-question Hospital Anxiety and Depression Score (HADS) was used to assess anxiety and depression and the CAGE score used to assess alcoholism [25, 26]. Blood was drawn for CD4 cell count (FACS Count™, Beckton Dickinson, NJ, USA) and HIV-RNA (HIV-1 RNA 3.0 assay®, Bayer Healthcare, Leverkusen, Germany) at baseline, 16 week and 48 week visits. Mid-dose efavirenz concentrations were determined at weeks 16 and 48. The time of blood draw, and the self-reported time of most recent ART dosing were recorded.
For pill counts, average pharmacy refill data and self-recall, the data used was that typically available to clinic staff during a consultation with a patient.
Three-day self-recall (SR)
At weeks 16 and 48, study staff asked each participant: “Did you swallow your pills yesterday/2 days ago/3 days ago?” Percent doses taken over 3 days was calculated from the participants’ responses. Study staff were not part of the clinical team. Data were only available if a participant attended the study visit.
Clinic-based pill count (CPC)
Participants were instructed to bring any remaining tablets to each study visit. CPC adherence was calculated using the difference between the number of tablets dispensed and the number returned and dividing by the number of days between the date of dispensing and the current visit date (adjusted for the number of doses per day). At week 16 this would give adherence over the previous 1 month period (last dispensing visit was the SoC visit a week 12) and at week 48 adherence over the previous 2 month period (last dispensing visit was the SoC visit at week 40). For the analyses, only the tablet count related to dosing efavirenz, nevirapine or, for those who switched to second-line, lopinavir/r dosing was used.
Pharmacy refill: average method (PR-average)
An electronic dispensing system (iDART) was used at the site to record the date of ART dispensed and the quantity given to each participant [27, 28]. Obvious errors, such as date and dispensing duplications were removed. A cumulative PR-average measure was obtained at week 16 and week 48 visits by dividing the number of days of efavirenz, nevirapine or lopinavir/r tablets each patient received between study randomisation date and the visit date, by the number of days they were in care over the same period. This method averages adherence across the whole period in question.
Pharmacy refill: gaps method (PR-gaps)
This measure used pharmacy dispensing quantities and refill visit dates to determine the number of medication-free days (days when the participant could not have had medication in hand) in each dispensing period. The number of medication-free days are subtracted from the number of days in the period, and the result divided by the number of days in the period (up to week 16 or up to week 48) to give an adherence percentage . This method identifies days when it was not possible for a patient to have taken medication; and might be expected to yield lower but potentially more accurate median adherence values than the average method.
Therapeutic drug measuring (TDM)
At weeks 16 and 48 visits a sample was taken to quantify mid-dosing interval efavirenz concentrations. Mid-dosing interval samples were drawn in the morning, after dosing the previous evening. Self-reported time of the evening dose was recorded. Samples were kept cold (4 °C) until transfer to the laboratory within 2–3 h of blood draw. Samples were centrifuged at 3500 revolutions/min for 10 min and plasma pipetted into cryovials which were labelled and frozen at −80 °C. Efavirenz concentrations were analysed using a validated LC–MS/MS method. The therapeutic range for mid-dose EFV concentrations is 1–4 mg/L.
All participants received the EAMD on study entry to record daily ART dosing times. The device (Wisepill®) held a week of medication in an internal and removable seven compartment pill box container. Participants were trained to fill these pill boxes themselves and replace them once a week at the same time as they dosed. On opening, a signal was sent via the mobile-phone network to a secure central computer, thus recording tablet taking or treatment interruptions in real time. An adherent day was defined as any recorded EAMD opening from 06h00am on that day to 05h59am the following day. Days with battery voltage <3660 V or no heartbeat were censored (dead battery days). The daily EAMD data for each participant were downloaded from the Wisepill® server. Cumulative adherence data for EAMD was calculated as the number of adherent days divided by the number of days in care, from date of randomisation to either weeks 16 or 48.
HIV-1 drug resistance
Genotype resistance tests were done on those with HIV RNA >500 copies/ml (the minimum HIV-RNA for amplification) at weeks 16 or 48. Nucleic acid was extracted with the NucliSens EasyMag automated extraction system (bioMérieux, Boxtel, The Netherlands). Genotyping was performed by RT-PCR followed by a nested PCR and sequencing of the complete PR gene and RT codons 1–262 (HXB2 numbering: HIV-1 nucleotide positions 2250–4229) and using gene-specific sequencing primers . Participants with one or more major resistance mutation as defined by the 2014 IAS update of drug resistance in HIV-1, causing resistance to ≥1 of the three drugs in their regimen were classified as resistant .
Data were analysed using Stata 13.0 (Stata Corporation, College Station, USA). Descriptive statistics (number, percentage, median and interquartile ranges) were used to summarise the baseline characteristics of the participant group and to tabulate the adherence data.
All available adherence data were used from each individual who had a HIV-RNA drawn within a 4 week window around week 16 (weeks 12–20) or a 16 week window around week 48 (weeks 32–64) in a per-protocol analysis from the time they entered care until the date of the respective viral load.
Univariate and multivariable logistic regression models were used to explore each adherence measure’s relationship to virological failure and genotypic resistance at weeks 16 and 48. Both outcomes were binary, categorised as described above. The data for each adherence variable was continuous, although models were repeated using categorical variables (binary or quartiles) to assess linearity. For the TDM models, the log10 values of EFV mid-dose drug concentrations were used, as log10 values shift the distribution curve of the EFV concentration values toward normal for regression modelling.
Other variables included in the models (age, baseline CD4 cell count and baseline HIV-RNA) were specified prior to the analysis. Receiver Operator Characteristics (ROC) were generated to view the overall predictive power of the univariate and multivariable models. The area under the curve derived from the ROC (AUC ROC), with 95% confidence intervals, was used to compare the prediction of virological failure or resistance by each adherence measure. AUC ROCs were compared using non-parametric methods.
Efavirenz-based ART was initiated in 228 participants and the remaining two started twice-daily nevirapine-based ART. Both regimens were given with two background nucleoside reverse transcriptase inhibitors. Tenofovir/3TC were used in 97.8% (Table 1). The majority of participants were taking three tablets once a day during the study period.
Retention in care (Fig. 1)
At the end of the study 186 participants remained in care (80.8%) at the study site and a further 16 (7.0%) had transferred to care elsewhere. Eight participants (3.5%) had died and 19 (8.3%) were lost to follow up i.e. had not attended the clinic for more than 12 weeks and were not known to have transferred out or to have died. One participant withdrew consent.
Median adherence percentage with inter-quartile range at each study visit, by adherence measure
Self-report (%): median (IQR)
Pill count (%): median (IQR)
Average pharmacy refill (%): median (IQR)a
Gaps pharmacy refill (%): median(IQR)a
EAMD adherence (%): median (IQR)a
EFV concentration (mg/L): median(IQR)
Viral suppression: n (%)
The subjective measure, SR, gave the highest adherence with the most individuals reporting 100% adherence (median 100%, IQR 100–100%). CPC, PR-gaps and PR-average also gave perfect or close to perfect adherence at week 16 and 48, but widened inter-quartile ranges highlighted some variations within the participants. Cumulative adherence by EAMD showed the lowest median adherence at both visits: 93% (IQR 74–98%) at week 16 and 86% (IQR 59–94%) at week 48. Median efavirenz concentrations were 2.3 (IQR 1.6–4.4) mg/L at week 16, and 2.1 (IQR 1.5–3.4) mg/L at week 48, within the currently recognised therapeutic range of 1.0–4.0 mg/L at both time points.
At week 16, 160 participants had HIV-RNA available within the 12–20 week window and 146 (91.2%) were suppressed to ≤400 copies/ml (Table 1). At week 48, 180 had a HIV-RNA available, of whom 153 (85.0%) were suppressed to ≤40 copies/ml (Table 1). Three participants switched to second-line therapy between weeks 32 and 48 of the study.
Virological failure prediction models
The table below presents odds ratios (OR) or adjusted odds ratios (aOR) with 95% confidence intervals (CI) for failure or resistance given a 10% increase in the adherence variable (or a 1 log increase in EFV concentration) in each logistic regression model
OR (95% CI)
aOR (95% CI)
Virological failure (>40 copies/ml) at week 48
Resistance (presence of ≥1 major mutation) at week 48
Virological failure (>400 copies/ml) at week 16
Resistance (presence of ≥1 major mutation) at week 16
At week 16, analyses showed that both PR-average and PR-gaps were predictive of failure, in both univariate and multivariable models. Log10 EFV concentration also reached significance in the univariate model (for every 10 times or 1 log increase in EFV concentration, the odds of failure reduced by 83%), but the other adherence measures, including EAMD, did not significantly predict failure at week 16 (Table 3).
Twelve of the fourteen participants whose HIV-RNA was >400 copies/ml at week 16 were successfully amplified when sent for HIV-1 resistance genotyping. Two participants had no major resistance mutations. Eight (66.7%) participants expressed the K65R mutation-conferring resistance to tenofovir, and three the M184 V mutation- conferring resistance to lamivudine/emtricitabine. All 10 who expressed resistance had NNRTI mutations, including L100I, K101E, K103N, V106M, Y181C, Y188C/Y/L, G190A/G/S and H221HY. Despite only efavirenz and nevirapine being used, mutations conferring resistance to etravirine and rilpivirine were noted in three participants: one each of V90I, E138A and V179D.
Twenty-seven participants had a HIV RNA of >40 copies/ml at week 48. Eleven of the fourteen (51.9%) who had HIV RNA >500 copies/ml had resistance genotyping successfully completed. One had no major resistance mutations. Two (18%) participants expressed the K65R mutation and four (36%) the M184 V mutation. As at week 16, the majority of the remaining mutations, in all 11 who expressed resistance, were NNRTI mutations, including L100I, K101E, K103N, V106M, Y181C, G190A, H221HY and F227L. Again, mutations to etravirine and rilpivirine were noted in 3 participants: one with E138A and two with V179D.
Resistance prediction models
As for virological failure, each adherence variable was modelled against the risk of resistance using both univariate and multivariate logistic regression models for prediction. Adherence as quantified by EAMD, PR-average, PR-gaps, TR and log10 EFV concentration were all significantly predictive of resistance in both univariate and multivariable analyses at week 48 (Table 3). SR was non-significant in either model. Reduced age and decreased CD4 cell count at baseline significantly increased the odds of resistance in all multivariable models (data not shown). AUC ROC values were obtained to allow for inter-measure comparison of resistance prediction at weeks 48 and 16. While cumulative EAMD best predicted resistance with the narrowest confidence intervals (AUC ROC 0.92, 95% CI 0.87–0.97), it was not significantly better than either PR measure (PR-average AUC ROC 0.86, 95% CI 0.67–1.0; PR-gaps AUC ROC 0.83, 95% CI 0.65–1.00) at week 48.
In contrast, only PR-average predicted resistance at week 16 (AUC ROC 0.72, 95% CI 0.57–0.90) (Table 3). Reduced age and decreased CD4 cell count at baseline significantly increased the odds of resistance in all multivariable models at week 16. All data on which theses analyses are based are available in Additional file 2.
We found high levels of adherence using both short-term and cumulative measures. Three-day SR yielded the highest adherence estimate, but was not a significant predictor of either viral suppression or resistance. This is consistent with findings which show that while short-term SR measures are widely utilised and useful for clinical intervention , they overestimate adherence, likely due to recall and social desirability bias [34–37], and are unreliable measures for research purposes.
In contrast, four of the five objective adherence measures effectively predicted virological failure: CPC, PR-average, PR-gaps and EAMD data. Cumulative PR measures (PR-average and PR-gap) were among the best predictors of virological failure and resistance at 48 and, of note, PR-average was the only predictor of resistance at week 16. PR-average has previously been reported to be a reliable predictor of virological outcomes and mortality [3, 8, 9], while our group demonstrated that short term PR-gap can predict failure on second-line ART . Software to calculate PR-average or PR-gaps could easily be added to electronic dispensing systems, which are widely used in resource-limited settings. Programmatic review of adherence using PR methods could be implemented immediately.
CPC is not widely recommended as it is subject to “pill dumping” and can be complex to perform in a large clinic . Nonetheless, CPC, which is a standard of care procedure in our clinic, performed well in this study and was predictive of virological failure and resistance at week 48.
While EAMD data were among the best at predicting outcome in this study at week 48, EAMDs are not routinely used in clinical care. However, recent data shows EAMD can reduce costs associated with HIV-RNA monitoring and real-time devices can detect early virologic rebound before established failure [3, 38, 39]. With the availability of newer, more affordable real-time technologies, electronic strategies should be reconsidered .
By altering the distribution of efavirenz concentrations through the use of log values in the regression model, we found that the log values of mid-dose EFV concentration were predictive of resistance at week 48, with wide confidence intervals, but not of failure. Most drug concentrations were therapeutic, possibly reflecting white coat pre-visit dosing, leaving few with concentrations below therapeutic where virological failure would be more likely. The few participants with sub-therapeutic concentrations limit the interpretation of this data. Larger studies including more participants with sub-therapeutic EFV concentrations are needed to adequately explore the ability of TDM to predict virological failure and resistance.
Most participants remaining in care at weeks 16 and 48 had virological suppression. The majority of those who had detectable HIV RNA also had resistance that would compromise at least one drug in their antiretroviral regimen, even at 16 weeks. Only the PR-average method predicted this early resistance. Using early pharmacy refill data to predict failure is practical and easy to achieve both for an individual and on a programmatic level. EAMD data was highly predictive of resistance at week 48, as were both PR measures and, to a lesser extent CPC.
It is interesting that while many of the adherence measures are predictive of viral or resistance outcomes at week 48, far fewer are predictive at week 16. This might suggest that measures of adherence which cover a longer period of dosing are more accurate e.g. cumulative EAMD, PR methods and CPC over 2-months. Conversely, adherence data collected over a shorter window were not predictive e.g. 3-day self-report, spot EFV concentrations and CPC over 1 month.
The prospective collection of multiple adherence measures in a single cohort is the strength of our study as it has allowed direct comparison of these measures—a comparison rarely achieved [13, 16]. Our study was based on maximum use of existing adherence data and used a per protocol approach to analysis, with those who did not have virological data at weeks 16 or 48 treated as missing for the predictive models. Losses to care in this cohort were similar to those previously reported at this site. All participants had data included in the cumulative adherence measures [41, 42].
Both genotyping and viral load testing are costly and funding to conduct baseline resistance testing and confirmatory viral loads at week 48 was not available. This is a study limitation. In addition, SR data was only collected as a 3-day recall at each visit and CPC data were only available for the 1 or 2 months preceding the week 16 or 48 visit and not over the complete study period. These measures may have performed better being collected over a longer or cumulative period of time.
Adherence as measured by CPC, PR measures and EAMD were the best predictors of resistance and virological failure in this prospective study. Pill counting can be implemented at any clinic, and pharmacy refill data is already widely available and an immediately implementable option, particularly in resource-poor settings. Consideration should also be given to the use of electronic measures as adherence monitoring strategies as costs reduce .
CO, KC, DB, RW and GM conceptualised the study. CO ran the study and collected/collated the data. CO, RL and KC analysed the data. CO wrote the original manuscript and all authors read and contributed to each version. All authors had full access to the study data. All authors have approved this final version. All authors read and approved the final manuscript.
Heidi Freislich, Monica Vogt, Christie Heiberg, Alienah Mpahleni, Nomsa Ngwenya and Speech Mzamo for their time and dedication throughout the study. Cathy Kalombo, Liz Seabe and their teams at the HCTC. Anna Arnaudo for her proficient editing skills. Jennifer Norman and the team at the Clinical Pharmacology Laboratory, Division of Clinical Pharmacology, Dept. of Medicine, UCT for the drug assays. Lloyd Marshall and the team at Wisepill. Gert van Zyl and Mathilda Claassen, National Health Laboratory Service, Tygerberg, for HIV drug resistance genotyping. Funding for this work was provided by the European and Developing Countries Clinical Trials Partnership (EDCTP; TA.2011.40200.015) and the Discovery Foundation.
The authors declare that they have no competing interests.
Availability of data and materials
The dataset supporting the conclusions of this article is included with the article. Please contact author for further data requests.
The University of Cape Town Faculty of Health Science Research Ethics Committee gave approval to conduct this study. Each participant provided written informed consent.
The Discovery Foundation supported CO through an Academic Fellowship Award in 2013 and EDCTP awarded CO a senior fellowship from 2012 to 2014: TA.2011.40200.015. The sponsors of the study had no role in the design and implementation of this study, nor in manuscript preparation.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Paterson DL, Swindells S, Mohr J, Brester M, Vergis EN, Squier C, et al. Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Ann Intern Med. 2000;133(1):21–30.View ArticlePubMedGoogle Scholar
- Bangsberg DR, Perry S, Charlebois ED, Clark RA, Roberston M, Zolopa AR, et al. Non-adherence to highly active antiretroviral therapy predicts progression to AIDS. AIDS. 2001;15(9):1181–3.View ArticlePubMedGoogle Scholar
- Thompson MA, Mugavero MJ, Amico KR, Cargill VA, Chang LW, Gross R, et al. Guidelines for improving entry into and retention in care and antiretroviral adherence for persons with HIV: evidence-based recommendations from an International Association of Physicians in AIDS Care panel. Ann Intern Med. 2012;156(11):817–33.View ArticlePubMedPubMed CentralGoogle Scholar
- Glass T, Cavassini M. Asking about adherence—from flipping the coin to strong evidence. Swiss Med Wkly. 2014;144:w14016.PubMedGoogle Scholar
- Marcellin F, Spire B, Carrieri MP, Roux P. Assessing adherence to antiretroviral therapy in randomized HIV clinical trials: a review of currently used methods. Expert Rev Anti Infect Ther. 2013;11(3):239–50.View ArticlePubMedGoogle Scholar
- Gill CJ, Hamer DH, Simon JL, Thea DM, Sabin LL. No room for complacency about adherence to antiretroviral therapy in sub-Saharan Africa. AIDS. 2005;19(12):1243–9.View ArticlePubMedGoogle Scholar
- Williams AB, Amico KR, Bova C, Womack JA. A proposal for quality standards for measuring medication adherence in research. AIDS Behav. 2013;17(1):284–97.View ArticlePubMedPubMed CentralGoogle Scholar
- Bisson GP, Gross R, Bellamy S, Chittams J, Hislop M, Regensberg L, et al. Pharmacy refill adherence compared with CD4 count changes for monitoring HIV-infected adults on antiretroviral therapy. PLoS Med. 2008;5(5):e109.View ArticlePubMedPubMed CentralGoogle Scholar
- Nachega JB, Hislop M, Dowdy DW, Lo M, Omer SB, Regensberg L, et al. Adherence to highly active antiretroviral therapy assessed by pharmacy claims predicts survival in HIV-infected South African adults. J Acquir Immune Defic Syndr. 2006;43(1):78–84.View ArticlePubMedGoogle Scholar
- Court R, Leisegang R, Stewart A, Sunpath H, Murphy R, Winternheimer P, et al. Short term adherence tool predicts failure on second line protease inhibitor-based antiretroviral therapy: an observational cohort study. BMC Infect Dis. 2014;14(1):664.View ArticlePubMedPubMed CentralGoogle Scholar
- Marcellin F, Spire B, Carrieri MP, Roux P. Assessing adherence to antiretroviral therapy in randomized HIV clinical trials: a review of currently used methods. Expert Rev Anti-Infect Ther. 2013;11(3):239–50.View ArticlePubMedGoogle Scholar
- Haberer JE, Kiwanuka J, Nansera D, Muzoora C, Hunt PW, So J, et al. Realtime adherence monitoring of antiretroviral therapy among HIV-infected adults and children in rural Uganda. AIDS. 2013;27(13):2166–8.View ArticlePubMedGoogle Scholar
- Liu X, Ma Q, Zhang F. Therapeutic drug monitoring in highly active antiretroviral therapy. Expert Opin Drug Saf. 2010;9(5):743–58.View ArticlePubMedGoogle Scholar
- Kredo T, Van der Walt JS, Siegfried N, Cohen K. Therapeutic drug monitoring of antiretrovirals for people with HIV. Cochrane Database Syst Rev. 2009. (3):CD007268. doi:https://doi.org/10.1002/14651858.CD007268.pub2.
- Liu H, Golin CE, Miller LG, Hays RD, Beck CK, Sanandaji S, et al. A comparison study of multiple measures of adherence to HIV protease inhibitors. Ann Intern Med. 2001;134(10):968–77.View ArticlePubMedGoogle Scholar
- Oyugi JH, Byakika-Tusiime J, Charlebois ED, Kityo C, Mugerwa R, Mugyenyi P, et al. Multiple validated measures of adherence indicate high levels of adherence to generic HIV antiretroviral therapy in a resource-limited setting. J Acquir Immune Defic Syndr. 2004;36(5):1100–2.View ArticlePubMedGoogle Scholar
- Muller AD, Jaspan HB, Myer L, Hunter AL, Harling G, Bekker LG, et al. Standard measures are inadequate to monitor pediatric adherence in a resource-limited setting. AIDS Behav. 2011;15(2):422–31.View ArticlePubMedGoogle Scholar
- Bangsberg DR, Hecht FM, Charlebois ED, Zolopa AR, Holodniy M, Sheiner L, et al. Adherence to protease inhibitors, HIV-1 viral load, and development of drug resistance in an indigent population. AIDS. 2000;14(4):357–66.View ArticlePubMedGoogle Scholar
- Ncaca LN, Kranzer K, Orrell C. Treatment interruption and variation in tablet taking behaviour result in viral failure: a case-control study from Cape Town, South Africa. PLoS ONE. 2011;6(8):e23088.View ArticlePubMedPubMed CentralGoogle Scholar
- Orrell C, Mauff K, Bangsberg D, Maartens G, Wood R. A randomised controlled trial of real-time electronic adherence monitoring with text message dosing reminders in people starting first-line antiretroviral therapy. J Acquir Immune Defic Syndr. 2015;70(5):495–502.View ArticlePubMedGoogle Scholar
- Orrell C, Kaplan R, Wood R, Bekker LG. Virological breakthrough: a risk factor for loss to followup in a large community-based cohort on antiretroviral therapy. AIDS Res Treat. 2011;2011:469127.PubMedPubMed CentralGoogle Scholar
- Orrell C, Harling G, Lawn SD, Kaplan R, McNally M, Bekker LG, et al. Conservation of first-line antiretroviral treatment regimen where therapeutic options are limited. Antivir Ther. 2007;12(1):83–8.PubMedGoogle Scholar
- Haberer JE, Kahane J, Kigozi I, Emenyonu N, Hunt P, Martin J, et al. Real-time adherence monitoring for HIV antiretroviral therapy. AIDS Behav. 2010;14(6):1340–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Sabin LL, Bachman DeSilva M, Gill CJ, Zhong L, Vian T, Wubin X, et al. Improving adherence to antiretroviral therapy with triggered real time text message reminders: the China through technology study (CATS). J Acquir Immune Defic Syndr. 2015;69(5):551–9.View ArticlePubMedPubMed CentralGoogle Scholar
- National Insititute on Alcohol Abuse and Alcoholism. CAGE questionnaire. http://pubs.niaaa.nih.gov/publications/inscage.htm. 2002.
- Herrmann C. International experiences with the Hospital Anxiety and Depression Scale—a review of validation data and clinical results. J Psychosom Res. 1997;42(1):17–41.View ArticlePubMedGoogle Scholar
- Nglazi MD, Kaplan R, Wood R, Bekker LG, Lawn SD. Identification of losses to follow-up in a community-based antiretroviral therapy clinic in South Africa using a computerized pharmacy tracking system. BMC Infect Dis. 2010;10:329.View ArticlePubMedPubMed CentralGoogle Scholar
- Orrell C, Dipenaar R, Killa N, Tassie JM, Harries AD, Wood R. Simplifying HIV cohort monitoring–pharmacy stock records minimize resources necessary to determine retention in care. J Acquir Immune Defic Syndr. 2013;62(3):e106–8.View ArticlePubMedGoogle Scholar
- van Leth F, Phanuphak P, Ruxrungtham K, Baraldi E, Miller S, Gazzard B, et al. Comparison of first-line antiretroviral therapy with regimens including nevirapine, efavirenz, or both drugs, plus stavudine and lamivudine: a randomised open-label trial, the 2NN Study. Lancet. 2004;363(9417):1253–63.View ArticlePubMedGoogle Scholar
- Puls R, Amin J, Losso M, Phanuphak P, Nwizu C, Orrell C, et al. Efficacy of 400 mg efavirenz versus standard 600 mg dose in HIV-infected, antiretroviral-naive adults (ENCORE1): a randomised, double-blind, placebo-controlled, non-inferiority trial. Lancet. 2014;383(9927):1474–82.View ArticlePubMedGoogle Scholar
- van Zyl GU, Claassen M, Engelbrecht S, Laten JD, Cotton MF, Theron GB, et al. Zidovudine with nevirapine for the prevention of HIV mother-to-child transmission reduces nevirapine resistance in mothers from the Western Cape, South Africa. J Med Virol. 2008;80(6):942–6.View ArticlePubMedGoogle Scholar
- Wensing AM, Calvez V, Gunthard HF, Johnson VA, Paredes R, Pillay D, et al. 2014 Update of the drug resistance mutations in HIV-1. Top Antivir Med. 2014;22(3):642–50.PubMedPubMed CentralGoogle Scholar
- Wu P, Johnson BA, Nachega JB, Wu B, Ordonez CE, Hare AQ, et al. The combination of pill count and self-reported adherence is a strong predictor of first-line ART failure for adults in South Africa. Curr HIV Res. 2014;12(5):366–75.View ArticlePubMedPubMed CentralGoogle Scholar
- Lester RT, Ritvo P, Mills EJ, Kariri A, Karanja S, Chung MH, et al. Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial. Lancet. 2010;376(9755):1838–45.View ArticlePubMedGoogle Scholar
- Hardy H, Kumar V, Doros G, Farmer E, Drainoni ML, Rybin D, Myung D, Jackson J, Backman E, Stanic A, Skolnik PR. Randomized controlled trial of a personalized cellular phone reminder system to enhance adherence to antiretroviral therapy. AIDS Patient Care STDS. 2011;25(3):153–61. doi:https://doi.org/10.1089/apc.2010.0006.PubMedPubMed CentralGoogle Scholar
- Da Costa TM, Barbosa BJP, E Costa DAG, Sigulem D, De Fátima Marin H, Filho AC, et al. Results of a randomized controlled trial to assess the effects of a mobile SMS-based intervention on treatment adherence in HIV/AIDS-infected Brazilian women and impressions and satisfaction with respect to incoming messages. Int J Med Inform. 2012;81(4):257–69.View ArticlePubMedPubMed CentralGoogle Scholar
- Maduka O, Tobin-West CI. Adherence counseling and reminder text messages improve uptake of antiretroviral therapy in a tertiary hospital in Nigeria. Niger J Clin Pract. 2013;16(3):302–8. doi:https://doi.org/10.4103/1119-3077.113451.View ArticlePubMedGoogle Scholar
- Petersen ML, LeDell E, Schwab J, Sarovar V, Gross R, Reynolds N, et al. Super learner analysis of electronic adherence data improves viral prediction and may provide strategies for selective HIV RNA monitoring. J Acquir Immune Defic Syndr. 2015;69(1):109–18.View ArticlePubMedPubMed CentralGoogle Scholar
- Haberer JE, Musinguzi N, Boum Y 2nd, Siedner MJ, Mocello AR, Hunt PW, et al. Duration of antiretroviral therapy adherence interruption is associated with risk of virologic rebound as determined by real-time adherence monitoring in rural Uganda. J Acquir Immune Defic Syndr. 2015;70(4):386–92.View ArticlePubMedPubMed CentralGoogle Scholar
- Phillips AN, Cambiano V, Nakagawa F, Bansi-Matharu L, Sow PS, Ehrenkranz P, et al. Cost effectiveness of potential ART adherence monitoring interventions in Sub-Saharan Africa. PLoS ONE. 2016;11(12):e0167654.View ArticlePubMedPubMed CentralGoogle Scholar
- Nglazi MD, Kaplan R, Orrell C, Myer L, Wood R, Bekker LG, et al. Increasing transfers-out from an antiretroviral treatment service in South Africa: patient characteristics and rates of virological non-suppression. PLoS ONE. 2013;8(3):e57907.View ArticlePubMedPubMed CentralGoogle Scholar
- Nglazi MD, Lawn SD, Kaplan R, Kranzer K, Orrell C, Wood R, et al. Changes in programmatic outcomes during 7 years of scale-up at a community-based antiretroviral treatment service in South Africa. J Acquir Immune Defic Syndr. 2011;56(1):e1–8.View ArticlePubMedPubMed CentralGoogle Scholar