Skip to main content

Performance and trend for quality of service in a large HIV/AIDS treatment program in Nigeria

Abstract

Background

As antiretroviral therapy (ART) programs expand access, there is an increase in burden to a healthcare system. These results are reduced provider-patient contact time and poor programmatic and patient outcomes. Quality management offers providers a standardized approach for addressing the appropriateness of care to be applied in resource-limited settings. This study aimed to determine the trend of performance on HIV/AIDS quality management indicators of health facilities providing ART over a period of 5 years.

Methods

The annual performance scores of quality of care (QoC) indicators of 31 health facilities providing ART was extracted from a database covering a period of 5 years (from October 2008 to September 2012). The data are percentages that indicate scores of each health facility assessed based on compliance to National ART guidelines categorized into several indicator domains. A Chi square statistic for the trend, as well as test for departure from the trend line was determined. The p value associated with each indicator provides the significant level for testing an alternative hypothesis that the rate of change over the period considered for that indicator does not equal to zero. The slope of the regression line also gives the magnitude of the rate of change for each indicator by healthcare level across the review period.

Results

Generally, performance trends showed improvement across most indicator domains. The highest improvement occurred for “3 month loss to follow-up” and “1 year no-visit”, with scores declining from 37 to 3%, and 42% to 12% respectively. However, there was a sharp decline in performance between 2010 and 2012 in weight monitoring of patients (p < 0.01), adherence assessment to ARVs (p < 0.01) and hematocrit measurements (p = 0.01). The aggregate rate of change β, as obtained from the slope of the trend line is highly significant (p < 0.01) for all the quality of care indicators considered, whether improving or declining.

Conclusion

Periodic assessment to determine HIV/AIDS quality of care can guide rapid scale-up of services to achieve universal coverage in resource-limited settings. Determining trends to understand patterns is very useful for improving programmatic and patient outcomes.

Background

Sub-Saharan Africa had a massive scale-up of antiretroviral therapy (ART) coverage from 3.9 million people at the end of 2009 to about 21.7 million as of the end of 2017, accounting for about 70.5% of the global number of people receiving HIV treatment in that year [1]. Nigeria has an estimated 3.6 million infected with HIV as of 2010 with 1.4 million of the infected in need of ART, but only about 350,000 had access to lifesaving drugs. By 2017, 3.1 million are infected and 1.04 million are on life-saving ART. Therefore, it is still is an important target to scale-up ART services and implement a continuous quality improvement (CQI) system for standard service delivery necessary to stem the tide and achieve epidemic control [2,3,4].

The burden of HIV/AIDS epidemic and limited access to ART facilitated the re-emergence of disease conditions such as pulmonary tuberculosis (PTB), in addition to poor quality of life attributable to health and socio-economic challenges associated with limited access to ART [5, 6]. However, with increasing access to ART and reduction in morbidity and mortality from HIV/AIDs, the average life expectancy in Nigeria rose from 48 years in 2000 to 54 years in 2018 [7].

Standard ART improves the quality of life (QoL) of HIV/AIDS patients [8,9,10]. However, improvement of QoL following ARV treatment does not depend only on access and availability of the lifesaving drugs; it also depends on the appropriate execution of recommended components of care including prevention and treatment of opportunistic infections, adherence to treatment and routine monitoring of laboratory investigations, and the clinical follow-up of patients [11,12,13,14]. HIV/AIDS requires comprehensive health services similar to those needed for cancer, diabetes, and cardiovascular care [15].

The delivery of HIV/AIDS services in Nigeria started in 2002 with no defined guidelines or clinical standards. However, with increasing access to ARV through international programs like the United States President’s Emergency Plan for AIDS Relief (PEPFAR) and Global Fund for AIDS, Tuberculosis, and Malaria (GFATM), clinical practice guidelines are developed to assist care providers in the delivery of standard care needed by HIV/AIDS patients, but compliance from both caregivers and care recipient has become a huge challenge. A study to identify determinants of nonadherence to ART in Southeast Nigeria found 75% of the respondents not fully adhering to their drug regimen [16].

Global HIV/AIDS programs including PEPFAR and GFATM have worked to develop results-based performance indicators to track achievements towards meeting program goals concerning funding. However, program-level indicators remain incomplete, and a carefully selected set of measures assessing the processes of care delivery collected at 6 to 12-month intervals, would provide important data to guide quality improvement efforts for standard care delivery of HIV care services [17, 18].

The introduction and implementation of HIV quality-Nigeria (HIVQUAL-N) was supported by the United States Centers for Disease Control and Prevention (CDC) to promote the delivery of appropriate care and treatment to HIV infected individuals through understanding of the human resource and infrastructure needs, as well as the challenges involved to implement a comprehensive ART program that focuses on adherence to National guidelines for delivery of HIV/AIDS services. This paper reports the application of HIVQUAL, a system developed by New York State Department of Health, AIDS Institute (NYSDOH-AI) to evaluate performance on quality management in one of the largest HIV treatment programs in sub-Saharan Africa (sSA) [19,20,21].

The objective of this analysis is to determine the performance and trend of quality of care in a large HIV prevention and treatment program in Nigeria.

Methods

AIDS Care and Treatment in Nigeria (ACTION) program is the largest HIV care and treatment program in Nigeria funded by PEPFAR through the Institute of Human Virology, University of Maryland (IHV-UMD). In the beginning, ACTION program activities, as well as the implementation of HIVQUAL occurred mainly at tertiary health centers where majority of people living with HIV/AIDS (PLWHA) access care and treatment services.

Quality of care indicators development

The Nigerian HIV quality of care indicators were jointly developed by US CDC, New York State Department of Health AIDS Institute (NYSDoH-AI) supported through PEPFAR/Health Resource Services Administration (HRSA) as HEALTHQUAL, IHV-UMD, Nigeria Federal Ministry of Health (FMoH) and other stakeholders, to monitor health facility-level performance that define optimal patient and program level outcomes.

Data on these indicators are collected annually. For the purpose of this evaluation, selected HIV/AIDS quality indicators (weight monitoring, treatment adherence assessments, anemia screening, liver function tests (LFT), hepatitis B, C screening, and HIV/AIDS care and support assessment, nutritional assessment, no clinic visit within 1 year, loss to follow-up and tuberculosis screening) were considered. The definition of each quality of care indicator is given in Appendix 1.

Data collection and description

Four years of annual performance scores of quality of HIV/AIDS care indicators were computed from assessments of 28 tertiary and 3 secondary health facilities providing comprehensive HIV/AIDS care and treatment under the ACTION program. The selection of tertiary centers for HIV care by the ACTION program was to ease access for PLWHA. However, ART services were gradually expanded to several secondary and primary health centers to improve access. Annual audit of sampled patients charts are normally randomly selected at each facility using probability proportional to size sampling that is predetermined to give a 90% confidence interval with a maximum error margin of 16% when using the least number of records. Such audit assessments were conducted in 2008, 2009, 2010, and 2012. Due to program transition between UMB-IHV and IHVN, quality audit assessment was not conducted in 2011. To enable trend evaluation and comparison of scores of quality indicators over the years, only health facilities that collected three or more data points were included.

Performance scores were proportions of patients in the audit samples with appropriate care documented based on specific measures of the selected indicators to indicate facility’s compliance with National HIV/AIDS ART guidelines. The numerator of each indicator represents the number of patients’ charts with documented evidence of compliance to requirements for HIV/AIDS clinical management, while the denominator is the proportionate to size total sample.

Data analysis

The ptrend command of StataIC 13 statistical software was used to determine trends of performance over the review period. ptrend calculates a Chi square statistic for the trend, as well as test for departure from the trend line. Trend analysis assumes a linear relationship with time; it can detect significant variations over time and identify areas for audit investigation to find solutions, but provides little insight into the root causes of variations. Also, trend analysis does not give normal or baseline benchmarks from which performance can be measured and compared over some time.

The p-value associated with each indicator provides the significant level for testing an alternative hypothesis that the rate of change over the period considered for that indicator does not equal to zero. The slope of the regression line also gives the magnitude of the rate of change for each indicator by healthcare level across the review period, which allows for comparison across the different levels of care. The 95% confidence interval (CI) for each of the quality indicators were computed by sites and year.

Results

The performance scores for the selected quality indicators across all facilities evaluated are summarized in Table 1. The aggregate percentage scores of quality indicators over the period under review indicate a significant improvement in all domains. Better improvements are seen in percentage of 3 months loss to follow-up from 46% [95% CI 43.8–47.4] in 2008 to 12% [95% CI 10.6–12.8] in 2012, and severe reduction of patients spending 1 year without visit: from 31% [95% CI 29.8–32.8] to 3% [95% CI 2.3–5.0] in the same time period. However, there is decrease in performance between 2010 and 2012 in weight monitoring, adherence assessment, and anemia screening. The trend for each indicator is graphically illustrated in Appendix 2.

Table 1 Aggregated scores of HIV/AIDS quality indicators of health facilities from 2008 to 2012

Performance comparison of tertiary and secondary health facilities

The baseline performance scores for most of the indicators were lower for secondary health facilities compared to tertiary except for hepatitis B screening, HIV/AIDS care and support assessment, and 1 year without clinical visit as shown in Table 2. Across both tiers of the health care system, quality performance scores improved from baseline in 2008 to 2010. After 2010, there are declines in weight monitoring, adherence assessment, and hematocrit measurements. Compared to tertiary health facilities, the secondary facilities not only improved favorably but also surpass the highly specialized tertiary sites in almost all indicator domains except on HBV screening and hematocrit measurements.

Table 2 Percentage scores of HIV/AIDS quality indicators by health facility type from 2008 to 2012

The aggregated mean change in slope from 2008 to 2012 was higher for care and support assessment: 0.06 (ptrend < 0.01); 3 months lost to follow up: 0.05 (ptrend < 0.01). However, mean change of slopes for the secondary facilities over the 5 years was higher compared to tertiary facilities for liver function test (0.04 vs. 0.01), nutritional assessment (0.08 vs. 0.4), 1 year no visit (− 0.04 vs. − 0.01) and tuberculosis screening (0.04 vs. 0.02). There is no difference in the mean change in slope between the two tiers for most of the quality indicators evaluated (Table 3).

Table 3 Rate of change of (β) HIV/AIDS quality indicators trend for tertiary and secondary health facilities over the 5-year review period

Discussion

The approach adopted to evaluate HIV/AIDS quality management implementation in this study is the first of its kind in Nigeria. The assessment compared annual performance and trends of quality of services provided by HIV programs at clinic levels over a period of 5 years. To our knowledge, no similar analysis has been conducted in sub-Saharan Africa (sSA). Tertiary health facilities provide specialty services and represent the most specialized level in the healthcare delivery system. Our findings show that even though secondary health facilities may not provide as much high quality of services at the early years of an HIV program, they catch up and even surpass tertiary levels but over time as the program matures,

Improvement across all indicators from baseline in 2008 to 2010 was likely the result of planned activities designed to address deficiencies identified during the first two successive HIVQUAL-N cycles. The HIVQUAL-N project implemented by IHV-UMB suffered a setback in 2011 following funding challenges and transition to a local IHV-Nigeria. The resultant delayed financial and technical support explain the decline in scores for weight monitoring, adherence assessment, and hematocrit monitoring, and only marginal improvement in the other areas in 2012. This is because these activities are conducted at clinic-level where the workload is often enormous. Indicators measured outside the HIV/AIDS clinics demonstrated better improvement over the same period.

The decline in loss to follow-up, especially from a peak of 42% in 2010 in tertiary health facilities, to 12%, corresponds with findings from a longitudinal analysis of risk factors of patient retention and adherence to ARVs where the loss to follow-up rate was reported as 26% [19].

Generally, it is observed that scores for most of the quality indicators are almost at par between tertiary and secondary levels of care from 2008 to 2010. However, by the last review in 2012, the secondary level of healthcare recorded better improvement than the tertiary level in every quality indicator except for anemia screening (hematocrit measurement) and hepatitis serology, where the difference in scores is also marginal. These findings have programmatic implications for decentralizing HIV/AIDS services to more peripheral health centers such as secondary and primary facilities.

Other studies have shown that the quality of care is preserved when decentralization occurs. A study of patients’ demographic and clinical characteristics and level of care associated with loss to follow-up and mortality in adult patients on first-line ART in Nigerian hospitals, also found that retention of patients is better at secondary health facilities compared to tertiary over a period of 36 months [20]. A report from South Africa found that decentralization to lower clinic levels provided greater proximity and acceptability of services leading to faster enrollment of access to ART and better retention with loss to follow-up reduction from 19 to 2% [21]. Another study in Malawi demonstrated the feasibility of district-wide access to ART in a setting with limited resources for health. Expansion and decentralization of HIV/AIDS service-capacity to primary care level, combined with task shifting, resulted in increased access to HIV services with good program outcomes despite staff shortages [22].

The application of HIVQUAL model to measure of HIV/AIDS quality of service appears adoptable in a resource-limited setting and should be expanded to cover not only treatment, care and support services, but also prevention services, especially elimination of mother to child transmission of HIV and community ART services and palliative care. Similarly, performance measurements for quality indicators should be conducted on a regular schedule in order to consolidate and build upon improvements achieved. It has been shown in this study that temporary breach of a schedule pattern as can be caused by a lack of or inadequate funding and technical support, can cause tremendous setbacks and compromise all gains recorded. This strongly underscores the value of continuous measurement as a stimulus to driving improvement in clinics to sustain gains in performance.

Availability of data and materials

The datasets generated and/or analysed in the study are not publicly available due to institutional policy but are available from the corresponding author on reasonable request.

Abbreviations

ACTION:

AIDS Care and Treatment in Nigeria

AIDS:

Acquired Immuno-Deficiency Syndrome

ART:

anti-retroviral therapy

ARV:

anti-retroviral

CI:

confidence interval

CQI:

continuous quality improvement

FMoH:

Federal Ministry of Health

GFTAM:

Global Fund for AIDS, Tuberculosis, and Malaria

HIV:

human immune-deficiency virus

HIVQUAL:

human immune-deficiency virus quality

HIVQUAL-N:

human immune-deficiency virus quality-Nigeria

HRSA:

Health Resources Services Administration

IHV/UMB:

Institute of Human Virology/University of Maryland Baltimore

IHVN:

Institute of Human Virology Nigeria

LFT:

liver function test

NHREC:

National Health Research Ethics Committee

NYSDOH-AI:

New York State Department of Health-AIDS Institute

PEPFAR:

Presidents’ Emergency Plan for AIDS Relief

SSA:

sub-Saharan Africa

p:

p-value

PEPFAR:

President’s Emergency Plan for AIDS Relief

PLHIV:

People living with Human Immunodeficiency Virus

QoC:

quality of care

QoL:

quality of life

References

  1. UNAIDS. UNAIDS Data Tables. 2017. http://aidsinfo.unaids.org/.

  2. Idigbe EO, Adewole TA, Eisen G, Kanki P, Odunukwe NN, et al. Management of HIV-1 infection with a combination of nevirapine, stavudine, and lamivudine: a preliminary report on the Nigerian antiretroviral program. J Acquir Immune Defic Syndr. 2005;40:65–9.

    Article  CAS  Google Scholar 

  3. Mocroft A, Lundgren JD. Starting highly active antiretroviral therapy: why, when and response to HAART. J Antimicrob Chemother. 2004;54:10–3.

    Article  CAS  Google Scholar 

  4. Monjok E, Smesny A, Okokon IB, Mgbere O, Essien EJ. Adherence to antiretroviral therapy in Nigeria: an overview of research studies and implications for policy and practice. HIV/AIDS. 2010;2:69–76.

    PubMed  Google Scholar 

  5. Dube MP, Sattler FR. Inflammation and complications of HIV disease. J Infect Dis. 2010;201:1783–5.

    Article  CAS  Google Scholar 

  6. Brooks JT, Kaplan JE, Holmes KK, Benson C, Pau A, et al. HIV-associated opportunistic infections-going, going, but not gone: the continued need for prevention and treatment guidelines. Clin Infect Dis. 2009;48:609–11.

    Article  Google Scholar 

  7. Nigeria Population (2018-02-24). http://worldpopulationreview.com/countries/Nigeria/.

  8. Gakhar H, Kamali A, Holodniy M. Health-related quality of life assessment after antiretroviral therapy: a review of the literature. Drugs. 2013;73:651–72.

    Article  Google Scholar 

  9. Brent RJ. The effects of HIV medications on the quality of life of older adults in New York City. Health Econ. 2012;21:967–76.

    Article  Google Scholar 

  10. Mekuria LA, Sprangers MA, Prins JM, Yalew AW, Nieuwkerk PT. Health-related quality of life of HIV-infected adults receiving combination antiretroviral therapy in Addis Ababa. AIDS Care. 2015;27:934–45.

    Article  Google Scholar 

  11. Jia H, Uphold CR, Wu S, Chen GJ, Duncan PW. Predictors of changes in health-related quality of life among men with HIV infection in the HAART era. AIDS Patient Care STDs. 2005;19:395–405.

    Article  Google Scholar 

  12. Wood E, Hogg RS, Yip B, Harrigan PR, O’Shaughnessy MV, et al. Effect of medication adherence on survival of HIV-infected adults who start highly active antiretroviral therapy when the CD4+ cell count is 0.200 to 0.350 × 10(9) cells/L. Ann Intern Med. 2003;139:810–6.

    Article  Google Scholar 

  13. Palella FJ Jr, Deloria-Knoll M, Chmiel JS, Moorman AC, Wood KC, et al. Survival benefit of initiating antiretroviral therapy in HIV-infected persons in different CD4+ cell strata. Ann Intern Med. 2003;138:620–6.

    Article  Google Scholar 

  14. Liu C, Weber K, Robison E, Hu Z, Jacobson LP, et al. Assessing the effect of HAART on change in quality of life among HIV-infected women. AIDS Res Ther. 2006;3:6.

    Article  Google Scholar 

  15. Kitahata MM, Tegger MK, Wagner EH, Holmes KK. Comprehensive health care for people infected with HIV in developing countries. BMJ. 2002;325:954–7.

    Article  Google Scholar 

  16. Uzochukwu BS, Onwujekwe OE, Onoka AC, Okoli C, Uguru NP, et al. Determinants of non-adherence to subsidized anti-retroviral treatment in southeast Nigeria. Health Policy Plan. 2009;24:189–96.

    Article  CAS  Google Scholar 

  17. Ahonkhai AA, Bassett IV, Ferris TG, Freedberg KA. Improving HIV outcomes in resource-limited countries: the importance of quality indicators. BMC Health Serv Res. 2012;12:427.

    Article  Google Scholar 

  18. Hanna M, Minga A, Fao P, Borand L, Diouf A, et al. Development of a checklist of quality indicators for clinical trials in resource-limited countries: the French National Agency for Research on AIDS and Viral Hepatitis (ANRS) experience. Clin Trials. 2013;10:300–18.

    Article  Google Scholar 

  19. Charurat M, Oyegunle M, Benjamin R, Habib A, Eze E, et al. Patient retention and adherence to antiretrovirals in a large antiretroviral therapy program in Nigeria: a longitudinal analysis for risk factors. PLoS ONE. 2010;5:e10584.

    Article  Google Scholar 

  20. Odafe S, Idoko O, Badru T, Aiyenigba B, Suzuki C, et al. Patients’ demographic and clinical characteristics and level of care associated with lost to follow-up and mortality in adult patients on first-line ART in Nigerian hospitals. J Int AIDS Soc. 2012;15:17424.

    Article  Google Scholar 

  21. Bedelu M, Ford N, Hilderbrand K, Reuter H. Implementing antiretroviral therapy in rural communities: the Lusikisiki model of decentralized HIV/AIDS care. J Infect Dis. 2007;196(Suppl 3):S464–8.

    Article  Google Scholar 

  22. Bemelmans M, van den Akker T, Ford N, Philips M, Zachariah R, et al. Providing universal access to antiretroviral therapy in Thyolo, Malawi through task shifting and decentralization of HIV/AIDS care. Trop Med Int Health. 2010;15:1413–20.

    Article  Google Scholar 

Download references

Acknowledgements

I wish to acknowledge Nwaneka Okereke and Chinenye Ugoji for providing access to the data used in this study.

Funding

This research was supported by the United States National Institute of Health, Fogarty program and Institute of Human Virology, University of Maryland School of Medicine. All findings, contents and conclusions from this paper do not represent the view or official position of NIH, PEPFAR or University of Maryland Baltimore.

Author information

Authors and Affiliations

Authors

Contributions

AA and MC are the principal investigators for the study. They contributed to the study design, data collection, and analysis as well as drafted the initial and revised manuscripts. All the remaining authors contributed to the data collection, data analysis and made critical inputs into the revision and finalization of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Nicaise Ndembi.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the University of Maryland Baltimore, School of Medicine, as well as a program-wide Institutional Review Board approval of National Human Research Ethics Committee (NHREC). The data analysed and presented in the manuscript were originally collected in the medical record of each of the facilities involved as part of routine medical care/program activities. Informed consent was not required from patients since recording of data into the medical charts/database was routine for regular medical care and program implementation.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1

See Table 4.

Table 4 Quality of care indicators for performance evaluation in HIV Quality Nigeria project

Appendix 2

See Fig. 1.

Fig. 1
figure 1

Health facilities performance trends of HIV/AIDS quality indicators in HIVQUAL Nigeria from 2008 to 2012

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Aliyu, A., El-Kamary, S., Brown, J. et al. Performance and trend for quality of service in a large HIV/AIDS treatment program in Nigeria. AIDS Res Ther 16, 29 (2019). https://doi.org/10.1186/s12981-019-0242-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12981-019-0242-2

Keywords