Evidence Report/Technology Assessment: Number 13

Determinants of Disability in Patients With Chronic Renal Failure

Summary


Under its Evidence-based Practice Program, the Agency for Healthcare Research and Quality (AHRQ) is developing scientific information for other agencies and organizations on which to base clinical guidelines, performance measures, and other quality improvement tools. Contractor institutions review all relevant scientific literature on assigned clinical care topics and produce evidence reports and technology assessments, conduct research on methodologies and the effectiveness of their implementation, and participate in technical assistance activities.

Overview / Reporting the Evidence / Review of Published Evidence / Analysis of USRDS Data / Findings / Future Research / Availability of Full Report


Overview

The purpose of this report is to evaluate the U.S. Social Security Administration's (SSA's) current Listing of Impairments ("Listings") for determining disability in individuals with chronic renal failure (CRF). Renal failure occurs when the kidneys lose their ability to filter wastes from the blood. It can occur as a result of chronic conditions such as primary kidney disease (e.g., glomerulonephritis), diabetes, hypertension, and heart disease. Renal failure can also be acute, occurring from a sudden injury or illness, such as a blow to the abdomen, bacterial infection, or drug overdose.

This report focuses on CRF, which is much more common than acute renal failure. When the severity of CRF reaches the point at which the patient can no longer function without a kidney transplant or dialysis, this is functionally defined as end-stage renal disease (ESRD).

Approximately 110 out of every 100,000 people are diagnosed with ESRD. The United States Renal Data System (USRDS) has estimated that more than 300,000 individuals in the United States had ESRD as of 1997. Determining the prevalence of CRF is more difficult because many people who suffer from earlier stages of the disease have either not been diagnosed or have not sought treatment; therefore, reliable prevalence statistics are not available.

SSA's current Listings consider every patient requiring dialysis or kidney transplantation as a result of CRF to be unable to perform gainful activity for at least 12 consecutive months, and therefore "disabled" at the third step in SSA's sequential disability evaluation process. Our goal was to determine if there were alternative criteria that might be more predictive of inability to work.

This report focuses solely on those patients undergoing dialysis; patients with a renal transplant have not been considered in this report. Our goal was to determine whether the CRF criteria for disability status, last revised in 1979, are still applicable, as newer treatment modalities may have allowed some patients to continue normal daily activities within the limitations of their disease. Our approach was to analyze the scientific evidence in the published literature that pertained to the ability of patients with CRF to maintain or resume their working status. We specifically sought evidence about what physiological and functional status measurements could predict an individual's inability to work.

Information in the published literature was too sparse to answer the questions addressed in this report. We then examined data from the USRDS, a nationwide registry of dialysis centers. Our goal was to perform multivariate statistical analyses on the raw data in order to identify the best physiological and functional predictors of inability to work. Because of difficulties measuring inability to work directly, we used vocational status and self-reported ability to work as indirect measurements.

To test the validity and reliability of these data, we performed numerous different original statistical analyses, including:

Although USRDS data provided a lot of interesting and useful information and demonstrated adequate construct and external validity, the reliability of any disability-related complex multivariate analyses of these data was considered suspect. This is due to a large amount of missing data, as many patients did not answer certain essential questions. We therefore were unable to answer the questions that SSA asked. We do, however, present data about the vocational characteristics of patients with ESRD and an illustrative complex statistical analysis, which may help focus future research.

Return to Contents

Reporting the Evidence

The key question posed by SSA for this report was:

Do the current criteria cited in SSA's Listing of Impairments for CRF correlate with an inability to work for 12 consecutive months?

Measurement of "inability to work" creates difficulties in answering this question. Inability to work is a concept that is difficult to measure quantitatively, and therefore has not been directly addressed in either the published literature or the USRDS. Surrogate measures such as self-reported ability to work and work status have been used in the literature instead.

Therefore, SSA's followup questions to the above key question are:

This evidence report is epidemiological in nature, assessing physiologic and functional predictors of inability to work in a quantitative fashion. We do not seek to compare the effectiveness of any therapeutic interventions, modalities, or technologies, because treatment efficacy is only a very indirect measure of a patient's true state of health. The population of interest in this report included all patients with CRF, including those with ESRD. However, due to limitations in the data available, we focused primarily on patients with ESRD.

Due to the above-mentioned difficulties in directly measuring inability to work, the outcomes of interest are indirect measures of inability to work. We therefore focused on three different indirect outcome measurements: self-reported ability to work, work status, and functional status (as measured by the Kidney Disease Quality-of-Life Questionnaire).

This project was divided into two phases:

Return to Contents

Phase 1: Review of Published Evidence

Methodology

Electronic database searches. We searched 27 databases for relevant information (each database from the date of its inception). All records in these databases were considered:

The search strategies employed a number of free-text keywords as well as controlled vocabulary terms including (but not limited to) the following concepts:

In general, the searches were restricted to studies examining human subjects. Case reports were excluded.

World Wide Web searches. Searches of the World Wide Web were also conducted using various search engines including (but not limited to) AltaVista, Hotbot, Infoseek, Magellan, and Yahoo!®. Pertinent Web sites included:

Kidney Disease

Disability and Rehabilitation

Hand searches of journal and nonjournal literature. Nonjournal publications and conference proceedings from professional organizations, private agencies, and government agencies maintained in ECRI's collections were routinely reviewed.

Other mechanisms. Other mechanisms were used to retrieve additional relevant information, including review of bibliographies/reference lists from peer-reviewed and gray literature. (Gray literature includes reports, studies, etc. produced by local government agencies, private organizations, educational facilities, and corporations, etc., that do not appear in the peer-reviewed literature.)

Summary

These searches identified 3,492 documents, books, and World Wide Web resources. A research analyst reviewed the search results to identify relevant documents and to ensure that all relevant information was retrieved using such search strategies. Input from technical experts and members of an internal review committee also helped revise the search strategies. Through these processes, new searches were conducted, and a total of 503 documents were ordered and read in full. Fourteen studies were identified that contained any analysis of predictors of employment in individuals with CRF. All of these 14 studies pertained solely to adult ESRD patients and attempted to correlate physiological, functional, and psychological factors with employment status.

Through careful analysis of these studies, we determined that there are limitations to all of the published literature that preclude its analysis for answering SSA's key and followup questions:

Because of these limitations, there are currently no published data available to either support or refute SSA's current Listings. As a result, we proceeded to Phase 2 of this project—an evaluation of whether individual patient data from the USRDS database are sufficient to answer the key questions of this project.

Return to Contents

Phase 2: Analysis of USRDS Data

Methodology

The USRDS collects patient and facility data from every Medicare-approved dialysis facility in the United States. This registry is sponsored by the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) and the Health Care Financing Administration (HCFA), and from 1995 to 1999 was coordinated by the University of Michigan. We were primarily interested in a subset of these data, a special study known as the Dialysis Morbidity and Mortality Study (DMMS) Wave 2. This was a prospective, longitudinal study that tracked 4,026 incident dialysis patients in 1996 and 1997, measuring physiological, functional, and quality-of-life variables. This patient subset was advantageous for our purposes because its time frame approximated the time frame of interest for SSA (1 year from onset of ESRD).

Therefore, it seemed possible that these data could be used in a de novo regression analysis to determine the best predictors of inability to work, as measured indirectly by the variables "self-reported ability to work full time" and "work status." The purpose of the regression analysis would be to identify a set of diagnostic criteria that would maximize the accurate inclusion of truly disabled patients with ESRD while minimizing the inappropriate inclusion of patients who are able to work.

To determine if such an analysis was warranted, we conducted numerous validity and reliability tests on the data. It was important to determine whether the patients in the database were similar enough to the general population of dialysis patients for results to be generalizable ("external validity"); that the variables measured were internally consistent, such that similar measures produced similar results ("construct validity"); and that any analysis of the data would produce consistent results that could be reproduced by other researchers.

To assess this database in these ways, numerous different statistical calculations were employed, including, but not limited to, the following:

Overall, to assess the validity and reliability of this database, more than 500 de novo analyses were conducted. The results of these analyses were reviewed by three physicians in the fields of nephrology and pathology, as well as by several biostatisticians.

We also performed an analysis to determine whether a regression analysis done on one random half of the database would find the same results as a regression analysis done on the other random half of the database. This was an important consideration because, although the database initially followed 4,026 patients, this was reduced to 546 eligible patients. Many were excluded because they were over age 65, lost to followup, or did not fully complete the 1-year followup questionnaire. The final group of patients eligible for our main analysis comprised only 546 individuals, with fragmented data availability, thus reducing the statistical power of any complex multivariate analyses.

Return to Contents

Findings

Return to Contents

Future Research

Although the DMMS Wave 2 was a well-designed epidemiological study, its purpose was not to assess disability. Furthermore, only 42 percent of patients completed the entire followup patient questionnaire. Studying disability by using data such as the DMMS Wave 2 requires one to "follow" a large number of patients who were working at the time they began dialysis until the time they completed the followup questionnaire. However, both the number of patients initially working and the number of initially working patients who completed the followup questionnaire were relatively small.

Limitations in existing research that should be addressed by future researchers include the use of univariate statistics, retrospective study design, and a focus on demographic and social variables. It would be most useful, for the purposes of answering the questions addressed here, for a study to collect multiple variables longitudinally such that, as did DMMS Wave 2, the independent variables are measured at time 1 and the dependent/outcome variable at time 2. An analysis that includes laboratory and physiologic measurements is essential. Information about each individual's Social Security disability status is also essential in order to evaluate the Listings.

Return to Contents

Availability of Full Report

The full evidence report from which this summary was taken was prepared for the Agency for Healthcare Research and Quality by ECRI under contract No. 290-97-0020. Printed copies may be obtained free of charge from the AHRQ Publications Clearinghouse by calling 1-800-358-9295. Requesters should ask for Evidence Report/Technology Assessment No. 13, Determinants of Disability in Patients With Chronic Renal Failure (AHRQ Publication No. 00-E013).

The Evidence Report is also online on the National Library of Medicine Bookshelf, or can be downloaded as a zipped file.

Return to Contents

AHRQ Publication No. 00-E012
Current as of May 2000


Internet Citation:

Determinants of Disability in Patients With Chronic Renal Failure. Summary, Evidence Report/Technology Assessment: Number 13. AHRQ Publication No. 00-E012, May 2000. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/clinic/epcsums/renalsum.htm


Return EPC Evidence Reports
Clinical Information
AHRQ Home Page
Department of Health and Human Services