Performance and trend for quality of service in a large HIV/AIDS treatment program in Nigeria
AIDS Research and Therapy volume 16, Article number: 29 (2019)
As antiretroviral therapy (ART) programs expand access, there is an increase in burden to a healthcare system. These results are reduced provider-patient contact time and poor programmatic and patient outcomes. Quality management offers providers a standardized approach for addressing the appropriateness of care to be applied in resource-limited settings. This study aimed to determine the trend of performance on HIV/AIDS quality management indicators of health facilities providing ART over a period of 5 years.
The annual performance scores of quality of care (QoC) indicators of 31 health facilities providing ART was extracted from a database covering a period of 5 years (from October 2008 to September 2012). The data are percentages that indicate scores of each health facility assessed based on compliance to National ART guidelines categorized into several indicator domains. A Chi square statistic for the trend, as well as test for departure from the trend line was determined. The p value associated with each indicator provides the significant level for testing an alternative hypothesis that the rate of change over the period considered for that indicator does not equal to zero. The slope of the regression line also gives the magnitude of the rate of change for each indicator by healthcare level across the review period.
Generally, performance trends showed improvement across most indicator domains. The highest improvement occurred for “3 month loss to follow-up” and “1 year no-visit”, with scores declining from 37 to 3%, and 42% to 12% respectively. However, there was a sharp decline in performance between 2010 and 2012 in weight monitoring of patients (p < 0.01), adherence assessment to ARVs (p < 0.01) and hematocrit measurements (p = 0.01). The aggregate rate of change β, as obtained from the slope of the trend line is highly significant (p < 0.01) for all the quality of care indicators considered, whether improving or declining.
Periodic assessment to determine HIV/AIDS quality of care can guide rapid scale-up of services to achieve universal coverage in resource-limited settings. Determining trends to understand patterns is very useful for improving programmatic and patient outcomes.
Sub-Saharan Africa had a massive scale-up of antiretroviral therapy (ART) coverage from 3.9 million people at the end of 2009 to about 21.7 million as of the end of 2017, accounting for about 70.5% of the global number of people receiving HIV treatment in that year . Nigeria has an estimated 3.6 million infected with HIV as of 2010 with 1.4 million of the infected in need of ART, but only about 350,000 had access to lifesaving drugs. By 2017, 3.1 million are infected and 1.04 million are on life-saving ART. Therefore, it is still is an important target to scale-up ART services and implement a continuous quality improvement (CQI) system for standard service delivery necessary to stem the tide and achieve epidemic control [2,3,4].
The burden of HIV/AIDS epidemic and limited access to ART facilitated the re-emergence of disease conditions such as pulmonary tuberculosis (PTB), in addition to poor quality of life attributable to health and socio-economic challenges associated with limited access to ART [5, 6]. However, with increasing access to ART and reduction in morbidity and mortality from HIV/AIDs, the average life expectancy in Nigeria rose from 48 years in 2000 to 54 years in 2018 .
Standard ART improves the quality of life (QoL) of HIV/AIDS patients [8,9,10]. However, improvement of QoL following ARV treatment does not depend only on access and availability of the lifesaving drugs; it also depends on the appropriate execution of recommended components of care including prevention and treatment of opportunistic infections, adherence to treatment and routine monitoring of laboratory investigations, and the clinical follow-up of patients [11,12,13,14]. HIV/AIDS requires comprehensive health services similar to those needed for cancer, diabetes, and cardiovascular care .
The delivery of HIV/AIDS services in Nigeria started in 2002 with no defined guidelines or clinical standards. However, with increasing access to ARV through international programs like the United States President’s Emergency Plan for AIDS Relief (PEPFAR) and Global Fund for AIDS, Tuberculosis, and Malaria (GFATM), clinical practice guidelines are developed to assist care providers in the delivery of standard care needed by HIV/AIDS patients, but compliance from both caregivers and care recipient has become a huge challenge. A study to identify determinants of nonadherence to ART in Southeast Nigeria found 75% of the respondents not fully adhering to their drug regimen .
Global HIV/AIDS programs including PEPFAR and GFATM have worked to develop results-based performance indicators to track achievements towards meeting program goals concerning funding. However, program-level indicators remain incomplete, and a carefully selected set of measures assessing the processes of care delivery collected at 6 to 12-month intervals, would provide important data to guide quality improvement efforts for standard care delivery of HIV care services [17, 18].
The introduction and implementation of HIV quality-Nigeria (HIVQUAL-N) was supported by the United States Centers for Disease Control and Prevention (CDC) to promote the delivery of appropriate care and treatment to HIV infected individuals through understanding of the human resource and infrastructure needs, as well as the challenges involved to implement a comprehensive ART program that focuses on adherence to National guidelines for delivery of HIV/AIDS services. This paper reports the application of HIVQUAL, a system developed by New York State Department of Health, AIDS Institute (NYSDOH-AI) to evaluate performance on quality management in one of the largest HIV treatment programs in sub-Saharan Africa (sSA) [19,20,21].
The objective of this analysis is to determine the performance and trend of quality of care in a large HIV prevention and treatment program in Nigeria.
AIDS Care and Treatment in Nigeria (ACTION) program is the largest HIV care and treatment program in Nigeria funded by PEPFAR through the Institute of Human Virology, University of Maryland (IHV-UMD). In the beginning, ACTION program activities, as well as the implementation of HIVQUAL occurred mainly at tertiary health centers where majority of people living with HIV/AIDS (PLWHA) access care and treatment services.
Quality of care indicators development
The Nigerian HIV quality of care indicators were jointly developed by US CDC, New York State Department of Health AIDS Institute (NYSDoH-AI) supported through PEPFAR/Health Resource Services Administration (HRSA) as HEALTHQUAL, IHV-UMD, Nigeria Federal Ministry of Health (FMoH) and other stakeholders, to monitor health facility-level performance that define optimal patient and program level outcomes.
Data on these indicators are collected annually. For the purpose of this evaluation, selected HIV/AIDS quality indicators (weight monitoring, treatment adherence assessments, anemia screening, liver function tests (LFT), hepatitis B, C screening, and HIV/AIDS care and support assessment, nutritional assessment, no clinic visit within 1 year, loss to follow-up and tuberculosis screening) were considered. The definition of each quality of care indicator is given in Appendix 1.
Data collection and description
Four years of annual performance scores of quality of HIV/AIDS care indicators were computed from assessments of 28 tertiary and 3 secondary health facilities providing comprehensive HIV/AIDS care and treatment under the ACTION program. The selection of tertiary centers for HIV care by the ACTION program was to ease access for PLWHA. However, ART services were gradually expanded to several secondary and primary health centers to improve access. Annual audit of sampled patients charts are normally randomly selected at each facility using probability proportional to size sampling that is predetermined to give a 90% confidence interval with a maximum error margin of 16% when using the least number of records. Such audit assessments were conducted in 2008, 2009, 2010, and 2012. Due to program transition between UMB-IHV and IHVN, quality audit assessment was not conducted in 2011. To enable trend evaluation and comparison of scores of quality indicators over the years, only health facilities that collected three or more data points were included.
Performance scores were proportions of patients in the audit samples with appropriate care documented based on specific measures of the selected indicators to indicate facility’s compliance with National HIV/AIDS ART guidelines. The numerator of each indicator represents the number of patients’ charts with documented evidence of compliance to requirements for HIV/AIDS clinical management, while the denominator is the proportionate to size total sample.
The ptrend command of StataIC 13 statistical software was used to determine trends of performance over the review period. ptrend calculates a Chi square statistic for the trend, as well as test for departure from the trend line. Trend analysis assumes a linear relationship with time; it can detect significant variations over time and identify areas for audit investigation to find solutions, but provides little insight into the root causes of variations. Also, trend analysis does not give normal or baseline benchmarks from which performance can be measured and compared over some time.
The p-value associated with each indicator provides the significant level for testing an alternative hypothesis that the rate of change over the period considered for that indicator does not equal to zero. The slope of the regression line also gives the magnitude of the rate of change for each indicator by healthcare level across the review period, which allows for comparison across the different levels of care. The 95% confidence interval (CI) for each of the quality indicators were computed by sites and year.
The performance scores for the selected quality indicators across all facilities evaluated are summarized in Table 1. The aggregate percentage scores of quality indicators over the period under review indicate a significant improvement in all domains. Better improvements are seen in percentage of 3 months loss to follow-up from 46% [95% CI 43.8–47.4] in 2008 to 12% [95% CI 10.6–12.8] in 2012, and severe reduction of patients spending 1 year without visit: from 31% [95% CI 29.8–32.8] to 3% [95% CI 2.3–5.0] in the same time period. However, there is decrease in performance between 2010 and 2012 in weight monitoring, adherence assessment, and anemia screening. The trend for each indicator is graphically illustrated in Appendix 2.
Performance comparison of tertiary and secondary health facilities
The baseline performance scores for most of the indicators were lower for secondary health facilities compared to tertiary except for hepatitis B screening, HIV/AIDS care and support assessment, and 1 year without clinical visit as shown in Table 2. Across both tiers of the health care system, quality performance scores improved from baseline in 2008 to 2010. After 2010, there are declines in weight monitoring, adherence assessment, and hematocrit measurements. Compared to tertiary health facilities, the secondary facilities not only improved favorably but also surpass the highly specialized tertiary sites in almost all indicator domains except on HBV screening and hematocrit measurements.
The aggregated mean change in slope from 2008 to 2012 was higher for care and support assessment: 0.06 (ptrend < 0.01); 3 months lost to follow up: 0.05 (ptrend < 0.01). However, mean change of slopes for the secondary facilities over the 5 years was higher compared to tertiary facilities for liver function test (0.04 vs. 0.01), nutritional assessment (0.08 vs. 0.4), 1 year no visit (− 0.04 vs. − 0.01) and tuberculosis screening (0.04 vs. 0.02). There is no difference in the mean change in slope between the two tiers for most of the quality indicators evaluated (Table 3).
The approach adopted to evaluate HIV/AIDS quality management implementation in this study is the first of its kind in Nigeria. The assessment compared annual performance and trends of quality of services provided by HIV programs at clinic levels over a period of 5 years. To our knowledge, no similar analysis has been conducted in sub-Saharan Africa (sSA). Tertiary health facilities provide specialty services and represent the most specialized level in the healthcare delivery system. Our findings show that even though secondary health facilities may not provide as much high quality of services at the early years of an HIV program, they catch up and even surpass tertiary levels but over time as the program matures,
Improvement across all indicators from baseline in 2008 to 2010 was likely the result of planned activities designed to address deficiencies identified during the first two successive HIVQUAL-N cycles. The HIVQUAL-N project implemented by IHV-UMB suffered a setback in 2011 following funding challenges and transition to a local IHV-Nigeria. The resultant delayed financial and technical support explain the decline in scores for weight monitoring, adherence assessment, and hematocrit monitoring, and only marginal improvement in the other areas in 2012. This is because these activities are conducted at clinic-level where the workload is often enormous. Indicators measured outside the HIV/AIDS clinics demonstrated better improvement over the same period.
The decline in loss to follow-up, especially from a peak of 42% in 2010 in tertiary health facilities, to 12%, corresponds with findings from a longitudinal analysis of risk factors of patient retention and adherence to ARVs where the loss to follow-up rate was reported as 26% .
Generally, it is observed that scores for most of the quality indicators are almost at par between tertiary and secondary levels of care from 2008 to 2010. However, by the last review in 2012, the secondary level of healthcare recorded better improvement than the tertiary level in every quality indicator except for anemia screening (hematocrit measurement) and hepatitis serology, where the difference in scores is also marginal. These findings have programmatic implications for decentralizing HIV/AIDS services to more peripheral health centers such as secondary and primary facilities.
Other studies have shown that the quality of care is preserved when decentralization occurs. A study of patients’ demographic and clinical characteristics and level of care associated with loss to follow-up and mortality in adult patients on first-line ART in Nigerian hospitals, also found that retention of patients is better at secondary health facilities compared to tertiary over a period of 36 months . A report from South Africa found that decentralization to lower clinic levels provided greater proximity and acceptability of services leading to faster enrollment of access to ART and better retention with loss to follow-up reduction from 19 to 2% . Another study in Malawi demonstrated the feasibility of district-wide access to ART in a setting with limited resources for health. Expansion and decentralization of HIV/AIDS service-capacity to primary care level, combined with task shifting, resulted in increased access to HIV services with good program outcomes despite staff shortages .
The application of HIVQUAL model to measure of HIV/AIDS quality of service appears adoptable in a resource-limited setting and should be expanded to cover not only treatment, care and support services, but also prevention services, especially elimination of mother to child transmission of HIV and community ART services and palliative care. Similarly, performance measurements for quality indicators should be conducted on a regular schedule in order to consolidate and build upon improvements achieved. It has been shown in this study that temporary breach of a schedule pattern as can be caused by a lack of or inadequate funding and technical support, can cause tremendous setbacks and compromise all gains recorded. This strongly underscores the value of continuous measurement as a stimulus to driving improvement in clinics to sustain gains in performance.
Availability of data and materials
The datasets generated and/or analysed in the study are not publicly available due to institutional policy but are available from the corresponding author on reasonable request.
AIDS Care and Treatment in Nigeria
Acquired Immuno-Deficiency Syndrome
continuous quality improvement
Federal Ministry of Health
Global Fund for AIDS, Tuberculosis, and Malaria
human immune-deficiency virus
human immune-deficiency virus quality
human immune-deficiency virus quality-Nigeria
Health Resources Services Administration
Institute of Human Virology/University of Maryland Baltimore
Institute of Human Virology Nigeria
liver function test
National Health Research Ethics Committee
New York State Department of Health-AIDS Institute
Presidents’ Emergency Plan for AIDS Relief
President’s Emergency Plan for AIDS Relief
People living with Human Immunodeficiency Virus
quality of care
quality of life
UNAIDS. UNAIDS Data Tables. 2017. http://aidsinfo.unaids.org/.
Idigbe EO, Adewole TA, Eisen G, Kanki P, Odunukwe NN, et al. Management of HIV-1 infection with a combination of nevirapine, stavudine, and lamivudine: a preliminary report on the Nigerian antiretroviral program. J Acquir Immune Defic Syndr. 2005;40:65–9.
Mocroft A, Lundgren JD. Starting highly active antiretroviral therapy: why, when and response to HAART. J Antimicrob Chemother. 2004;54:10–3.
Monjok E, Smesny A, Okokon IB, Mgbere O, Essien EJ. Adherence to antiretroviral therapy in Nigeria: an overview of research studies and implications for policy and practice. HIV/AIDS. 2010;2:69–76.
Dube MP, Sattler FR. Inflammation and complications of HIV disease. J Infect Dis. 2010;201:1783–5.
Brooks JT, Kaplan JE, Holmes KK, Benson C, Pau A, et al. HIV-associated opportunistic infections-going, going, but not gone: the continued need for prevention and treatment guidelines. Clin Infect Dis. 2009;48:609–11.
Nigeria Population (2018-02-24). http://worldpopulationreview.com/countries/Nigeria/.
Gakhar H, Kamali A, Holodniy M. Health-related quality of life assessment after antiretroviral therapy: a review of the literature. Drugs. 2013;73:651–72.
Brent RJ. The effects of HIV medications on the quality of life of older adults in New York City. Health Econ. 2012;21:967–76.
Mekuria LA, Sprangers MA, Prins JM, Yalew AW, Nieuwkerk PT. Health-related quality of life of HIV-infected adults receiving combination antiretroviral therapy in Addis Ababa. AIDS Care. 2015;27:934–45.
Jia H, Uphold CR, Wu S, Chen GJ, Duncan PW. Predictors of changes in health-related quality of life among men with HIV infection in the HAART era. AIDS Patient Care STDs. 2005;19:395–405.
Wood E, Hogg RS, Yip B, Harrigan PR, O’Shaughnessy MV, et al. Effect of medication adherence on survival of HIV-infected adults who start highly active antiretroviral therapy when the CD4+ cell count is 0.200 to 0.350 × 10(9) cells/L. Ann Intern Med. 2003;139:810–6.
Palella FJ Jr, Deloria-Knoll M, Chmiel JS, Moorman AC, Wood KC, et al. Survival benefit of initiating antiretroviral therapy in HIV-infected persons in different CD4+ cell strata. Ann Intern Med. 2003;138:620–6.
Liu C, Weber K, Robison E, Hu Z, Jacobson LP, et al. Assessing the effect of HAART on change in quality of life among HIV-infected women. AIDS Res Ther. 2006;3:6.
Kitahata MM, Tegger MK, Wagner EH, Holmes KK. Comprehensive health care for people infected with HIV in developing countries. BMJ. 2002;325:954–7.
Uzochukwu BS, Onwujekwe OE, Onoka AC, Okoli C, Uguru NP, et al. Determinants of non-adherence to subsidized anti-retroviral treatment in southeast Nigeria. Health Policy Plan. 2009;24:189–96.
Ahonkhai AA, Bassett IV, Ferris TG, Freedberg KA. Improving HIV outcomes in resource-limited countries: the importance of quality indicators. BMC Health Serv Res. 2012;12:427.
Hanna M, Minga A, Fao P, Borand L, Diouf A, et al. Development of a checklist of quality indicators for clinical trials in resource-limited countries: the French National Agency for Research on AIDS and Viral Hepatitis (ANRS) experience. Clin Trials. 2013;10:300–18.
Charurat M, Oyegunle M, Benjamin R, Habib A, Eze E, et al. Patient retention and adherence to antiretrovirals in a large antiretroviral therapy program in Nigeria: a longitudinal analysis for risk factors. PLoS ONE. 2010;5:e10584.
Odafe S, Idoko O, Badru T, Aiyenigba B, Suzuki C, et al. Patients’ demographic and clinical characteristics and level of care associated with lost to follow-up and mortality in adult patients on first-line ART in Nigerian hospitals. J Int AIDS Soc. 2012;15:17424.
Bedelu M, Ford N, Hilderbrand K, Reuter H. Implementing antiretroviral therapy in rural communities: the Lusikisiki model of decentralized HIV/AIDS care. J Infect Dis. 2007;196(Suppl 3):S464–8.
Bemelmans M, van den Akker T, Ford N, Philips M, Zachariah R, et al. Providing universal access to antiretroviral therapy in Thyolo, Malawi through task shifting and decentralization of HIV/AIDS care. Trop Med Int Health. 2010;15:1413–20.
I wish to acknowledge Nwaneka Okereke and Chinenye Ugoji for providing access to the data used in this study.
This research was supported by the United States National Institute of Health, Fogarty program and Institute of Human Virology, University of Maryland School of Medicine. All findings, contents and conclusions from this paper do not represent the view or official position of NIH, PEPFAR or University of Maryland Baltimore.
Ethics approval and consent to participate
The study was approved by the University of Maryland Baltimore, School of Medicine, as well as a program-wide Institutional Review Board approval of National Human Research Ethics Committee (NHREC). The data analysed and presented in the manuscript were originally collected in the medical record of each of the facilities involved as part of routine medical care/program activities. Informed consent was not required from patients since recording of data into the medical charts/database was routine for regular medical care and program implementation.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Aliyu, A., El-Kamary, S., Brown, J. et al. Performance and trend for quality of service in a large HIV/AIDS treatment program in Nigeria. AIDS Res Ther 16, 29 (2019). https://doi.org/10.1186/s12981-019-0242-2