Background: Inequality in health outcomes in relation to Amer- Results: The PCERM systematically underpredicted ASCVD
icans' socioeconomic position is rising. event risk among patients from disadvantaged communities.
Model discrimination was poorer among these patients (concor-
Objective: First, to evaluate the spatial relationship between
dance index [C], 0.70 [95% CI, 0.67 to 0.74]) than those from the
neighborhood disadvantage and major atherosclerotic cardio-
most afuent communities (C, 0.80 [CI, 0.78 to 0.81]). The NDI
vascular disease (ASCVD)related events; second, to evaluate
alone accounted for 32.0% of census tractlevel variation in
the relative extent to which neighborhood disadvantage and
ASCVD event rates, compared with 10.0% accounted for by the
physiologic risk account for neighborhood-level variation in AS-
PCERM.
CVD event rates.
Limitations: Patients from afuent communities were overrep-
Design: Observational cohort analysis of geocoded longitudinal
electronic health records. resented. Outcomes of patients who received treatment for car-
diovascular disease at Cleveland Clinic were assumed to be in-
Setting: A single academic health center and surrounding dependent of whether the patients came from a disadvantaged
neighborhoods in northeastern Ohio. or an afuent neighborhood.
Patients: 109 793 patients from the Cleveland Clinic Health Sys- Conclusion: Neighborhood disadvantage may be a powerful
tem (CCHS) who had an outpatient lipid panel drawn between regulator of ASCVD event risk. In addition to supplemental risk
2007 and 2010. The date of the rst qualifying lipid panel served models and clinical screening criteria, population-based solu-
as the study baseline. tions are needed to ameliorate the deleterious effects of neigh-
borhood disadvantage on health outcomes.
Measurements: Time from baseline to the rst occurrence of a
major ASCVD event (myocardial infarction, stroke, or cardiovas- Primary Funding Source: The Clinical and Translational Sci-
cular death) within 5 years, modeled as a function of a locally ence Collaborative of Cleveland and National Institutes of
derived neighborhood disadvantage index (NDI) and the pre- Health.
dicted 5-year ASCVD event rate from the Pooled Cohort Equa-
tions Risk Model (PCERM) of the American College of Cardiol-
ogy and American Heart Association. Outcome data were
censored if no CCHS encounters occurred for 2 consecutive Ann Intern Med. doi:10.7326/M16-2543 Annals.org
years or when state death data were no longer available (that is, For author afliations, see end of text.
from 2014 onward). This article was published at Annals.org on 29 August 2017.
Figure 1. Distribution of NDI (dened at the census tract level) across northeastern Ohio.
Higher NDI indicates greater socioeconomic disadvantage. NDI = neighborhood disadvantage index.
Table 1. Baseline Characteristics of 109 793 Patients Included in the Analysis, by NDI Levels*
date of noncardiac death or death due to an unspeci- from the American College of Cardiology and Ameri-
ed cause, or 1 January 2014 for any patient with T0 can Heart Association (8). Observed event rates with
after 1 January 2010, whichever occurred rst. (The respect to this calibration analysis were obtained from
third censoring condition was put in place because KaplanMeier curves.
Ohio cause-of-death data were available only through Census tractlevel ASCVD event rates were esti-
2013 at the time of our analysis.) Follow-up for our mated under the Bayesian framework by using the in-
study was 5 years. tegrated nested Laplace approximation procedure of
The PCERM originally was published with respect Rue and colleagues (9), as implemented in the R-INLA
to 10-year mortality risk. To obtain 5-year estimates package (The R Foundation) (10). This allowed for im-
from the PCERM, information on the baseline hazard plementation of a conditional autoregressive Weibull
function from the underlying Cox regression models is time-to-event model that incorporated the BesagYork
required. This baseline hazard function was not pub- Mollie covariance structure (11, 12). This model may be
lished; however, the PCERM's authors did provide thought of as a spatial analogue of the more common
5-year cumulative baseline hazard function estimates to autoregressive time series model, because it incorpo-
Muntner and colleagues (5) for their validation study. In rates correlation among estimates (in our case, hazard
particular, the formulas required to compute 5-year ratio estimates for ASCVD) for neighboring geographic
PCERM risk estimates are published in an online sup- areas (census tracts) the same way the time series
plement to the Muntner group's article. We used those model allows for correlation among neighboring time
formulas instead of the original 10-year risk equations. points.
To analyze aspects of neighborhood SEP associ- We began with a null model (model 1) consisting of
ated with patients' location of residence at T0, we cre- only random effects for each census tract (character-
ated a neighborhood disadvantage index (NDI). This ized by using the BesagYorkMollie structure). Fixed
index served as a single-factor representation of sev- effects were added to this modelnamely, PCERM-
eral variables that reect neighborhood SEP, which we estimated risk or NDI. We estimated a model that
used to distribute and analyze risk associated with SEP added a xed effect for the PCERM-estimated 5-year
within our sample. We derived the NDI as a specic probability of major ASCVD events to the null model
measure of neighborhood disadvantage across north- (model 2), one that added a xed effect for the NDI to
eastern Ohio. the null model (model 3), and one that included xed
The NDI was dened at the census tract level on effects for both PCERM risk and NDI (model 4). In com-
the basis of the following U.S. Census 2010 variables: paring 2 models (for example, model 3 vs. model 1),
percentage white, non-Hispanic; percentage with a the degree by which the random-effect estimates from
high school degree; percentage with Medicaid, aged the model (that is, census tractlevel log-hazard ratio
18 to 64 years; percentage uninsured, aged 18 to 64 estimates after adjustment for any xed effects) are re-
years; median income; percentage of households be- duced by adding the covariates is the amount of spatial
low the federal poverty level; percentage of children variation accounted for by the covariates. Details of
living in households receiving supplemental security in- these calculations are given in Appendix 1 (available at
come, cash public assistance income, food stamps, or Annals.org).
Supplemental Nutrition Assistance Program benets;
and percentage of households headed by an unmar- Role of the Funding Source
ried mother. We transformed these variables into their This work was supported by the Clinical and Trans-
principal components and used the rst principal com- lational Science Collaborative of Cleveland, grant
ponent as the NDI (that is, a single-factor latent variable KL2TR000440 from the National Center for Advancing
model). Except for race, all the aforementioned charac- Translational Sciences (NCATS) component of the Na-
teristics are reected in the Area Deprivation Index (6), tional Institutes of Health (NIH), and the NIH Roadmap
a national index of neighborhood-level disadvantage for Medical Research. The funding sources had no role
based on 2000 U.S. Census data. in the design, conduct, or reporting of the study or the
decision to publish the manuscript.
Statistical Analysis
We assessed the prognostic accuracy of the
PCERM-estimated 5-year ASCVD event rates within
subgroups of patients dened according to selected RESULTS
quantiles of the NDI. Discrimination was assessed by Of 125 449 unique patients living in northeastern
using the concordance index (C) for censored out- Ohio who had a qualifying outpatient lipid panel drawn
comes (7). Calibration was assessed visually by compar- between 2007 and 2010 and were aged 35 years or
ing observed 5-year ASCVD event rates with those pre- older on the date of that lipid panel, 15 153 were ex-
dicted by the PCERM within progressive risk stratathat cluded because of medical history (3473 with a history
is, patients with predicted risk less than 2.5%, those of myocardial infarction; 1852 with a history of stroke;
with predicted risk between 2.5% and 5.0%, those with 9178 with a history of heart valve disorders; and 2761
predicted risk between 5.0% and 7.5%, and so on. We with a history of pericarditis, endocarditis, myocarditis,
selected these risk thresholds so that they corre- or cardiomyopathy). After an additional 503 patients
sponded with guidelines on blood cholesterol levels with missing baseline data on required elements of the
4 Annals of Internal Medicine Annals.org
Figure 2. Prognostic accuracy of the PCERM across strata dened according to percentile groups of the NDI (highest
percentiles correspond to the least afuent communities).
0.25 0.25
0.20 0.20
0.15 0.15
0.10 0.10
0.05 0.05
0.00 C, 0.70 (95% CI, 0.67 0.74) 0.00 C, 0.72 (CI, 0.700.75)
0.00 0.05 0.10 0.15 0.20 0.25 0.00 0.05 0.10 0.15 0.20 0.25
0.25 0.25
Observed 5-Year Event Rate
0.25 0.25
0.20 0.20
0.15 0.15
0.10 0.10
0.05 0.05
Perfect calibration of the PCERM is represented along the line y = x; points above this line indicate underestimation of risk by the PCERM in relation
to observed event rates, and points below it indicate overestimation of risk. Concordance indices (C) and corresponding 95% CIs are displayed
within each panel. The C ranges from 0.5 to 1.0, where a value of 0.5 represents no discrimination of events from nonevents and a value of 1.0
represents complete separation of outcomes. NDI = neighborhood disadvantage index; PCERM = Pooled Cohort Equations Risk Model.
SEP are intersecting in that persons may experience munities. Finally, persons from disadvantaged commu-
disadvantage in ways that are specic to distinct com- nities may either not have access to or not seek quality
binations of these 3 characteristics (13). preventive cardiovascular care.
The nding is compelling, especially when taken in All these relationships, and perhaps others, may
the context of the immense challenges facing persons explain why the PCERM performed more poorly among
living in disadvantaged neighborhoods. In addition to patients from disadvantaged neighborhoods. In partic-
the personal challenges associated with impoverish- ular, the PCERM systematically underestimated ASCVD
ment, these residents face various neighborhood-level event risk across the entire risk spectrum for patients
stressors. Comparatively speaking, disadvantaged from high-NDI neighborhoods. On the other end of the
neighborhoods lack options for exercise (including lim- socioeconomic spectrum, calibration was much better,
ited access to parks, trails, and sports and tness facil- although we did observe slight overestimates of risk
ities) (14), and use of available exercise facilities in among high-risk patients from afuent communities.
these communities is negatively affected by lack of pe- Other researchers have found that the PCERM may
destrian access, litter, vandalism, homelessness, and over- or underestimate risk depending on the subpop-
perceptions of danger associated with high rates of vi- ulation being evaluated (5, 19 21); the present data
olent crime (15, 16). Moreover, healthy food is less suggest that this relationship varies according to neigh-
available (17) and more costly (18) within low-SEP com- borhood SEP.
6 Annals of Internal Medicine Annals.org
Figure 3. Hazard ratios for major atherosclerotic cardiovascular disease events (myocardial infarction, stroke, or cardiovascular
death) across northeastern Ohio, from the null model without covariates (model 1).
Figure 4. Hazard ratios for major atherosclerotic cardiovascular disease events (myocardial infarction, stroke, or
cardiovascular death) across northeastern Ohio, from the model that adjusted for estimated 5-y risk from the American
College of Cardiology/American Heart Association Pooled Cohort Equations Risk Model and our neighborhood
socioeconomic status index (model 4).
had increased event rates even after we adjusted for tion of the PCERM among patients from disadvantaged
these factors. Further work is necessary to evaluate how communities to be amplied. In addition, we did not an-
race, ethnicity, and neighborhood factors combine to alyze the effect of residential mobility or other temporal
produce health disadvantage. phenomena (13). Finally, our study assumes that out-
Because our study involved routinely collected comes of patients who received treatment for cardiovas-
electronic health data, its results may be vulnerable to cular disease diagnoses at Cleveland Clinic were inde-
certain forms of sampling bias. The analyzed study co- pendent from the patients' respective NDI values.
hort contained 10 times more patients from the top 5% In summary, neighborhood SEP appears to be an
of census tracts (with respect to the NDI) than from the important determinant of PCERM accuracy. Efforts are
bottom 5%. Also, it contained many more patients from needed to enhance risk prediction by incorporating as-
the Cleveland metropolitan area than from outlying pects of neighborhood SEP and discerning its systemic
communities. More comprehensive data will be effects on individuals (25). Such efforts are particularly
needed to identify whether our nding of increased important in the context of health disparities in ASCVD,
ASCVD event rates in more distant low-SEP communi- whereby the mechanisms involved in ASCVD progres-
ties (such as those in Akron, Youngstown, Warren, and sion may differ qualitatively among subpopulations de-
Canton) was the result of sampling bias or of actual ned according to social strata. In addition to supple-
differences in risk patterns. Patients from low-SEP mental risk models and clinical screening criteria, a
neighborhoods were more likely to be censored be- collective approach is needed to develop grass-roots and
cause of lack of CCHS encounters (such as leaving the policy-oriented approaches to ameliorate the deleterious
health system or not seeking medical care) for at least 2 effects of neighborhood conditions on health outcomes.
years. Given that persons with censored outcomes
were as healthy as those whose outcomes were not From Cleveland Clinic, Case Western Reserve University, and
censored (Appendix Figure and Appendix Table 2, MetroHealth Medical Center, Cleveland, Ohio.
available at Annals.org), we believe that any net effect
of differential censoring on our ndings likely would be Disclaimer: The contents of this publication are solely the re-
directional in nature: Complete ascertainment of out- sponsibility of the authors and do not necessarily represent
comes likely would have caused the observed miscalibra- the ofcial views of the NIH.
8 Annals of Internal Medicine Annals.org
Author Contributions: Conception and design: J.E. Dalton, With the variation from the null (or reference)
A.T. Perzynski, C.J. Coulton, A.T. Milinovich, N.V. Dawson. Model 1
Analysis and interpretation of the data: J.E. Dalton, A.T. Per-
model (model 1) denoted , the proportion
zynski, D.A. Zidar, M.B. Rothberg, D. Einstadter, N.V. Dawson. of census tractlevel variability accounted for by, say,
Drafting of the article: J.E. Dalton, A.T. Perzynski, D.A. Zidar, our neighborhood socioeconomic status index (model
C.J. Coulton, A.T. Milinovich, J.K. Karichu, N.V. Dawson. 3) is given by:
Critical revision for important intellectual content: J.E. Dalton,
A.T. Perzynski, D.A. Zidar, M.B. Rothberg, D. Einstadter, J.K. 1 Model 3 Model 1.
Karichu, N.V. Dawson.
Final approval of the article: J.E. Dalton, A.T. Perzynski, D.A.
Zidar, M.B. Rothberg, C.J. Coulton, A.T. Milinovich, D. Einstad- APPENDIX 2: NDI
ter, J.K. Karichu, N.V. Dawson. The NDI is based on census tractlevel data from the
Provision of study materials or patients: J.E. Dalton. American Community Survey. It represents the rst princi-
Statistical expertise: J.E. Dalton. pal component of 8 specic census tractlevel population
Obtaining of funding: J.E. Dalton, N.V. Dawson. measures, which are listed in Appendix Table 3.
Administrative, technical, or logistic support: J.E. Dalton, A.T.
The rst step in calculating the NDI is to standard-
Milinovich, D. Einstadter, N.V. Dawson.
Collection and assembly of data: J.E. Dalton, A.T. Milinovich. ize (that is, scale and center) the raw census tractlevel
data; that is, subtract the sample mean from the raw
value and divide the result by the sample SD. Sample
APPENDIX 1: DECOMPOSITION OF VARIABILITY means and SDs for the 8 variables involved in the cal-
IN CENSUS TRACTLEVEL ASCVD EVENT culation are given in Appendix Table 3.
RATES For example, the transformed percentage white
Conditional autoregressive models for area- variable (which we denote with an asterisk [white*]) for
specic hazard ratios have the following general form: a hypothetical census tract with a 52.3% white popula-
tion would be
logi XTi ui vi,
white* (white 0.728) 0.300
where:
i is the hazard ratio for the outcome of interest for = (0.523 0.728) 0.300 = 0.683.
area i (in our case, i indexes census tracts),
Xi is a vector of covariate values for xed effects, The NDI is then calculated via the following
is a vector of xed-effect regression parameters, equation:
ui is a spatially structured random effect for area i, NDI = (0.351 white*) + (0.402 medicaid*)
and
vi is an unstructured residual for area i. + (0.312 uninsured*) (0.369 income*)
Note that our null model (model 1) did not include
T
xed effects; thus, the term Xi was absent from the + (0.404 poverty*) + (0.407 assistance*)
above equation.
+ (0.390 momonly*).
In the BesagYorkMollie model, the ui have the
following normal distribution:
Annals.org Annals of Internal Medicine
100
Cumulative Percentage Censored
75
NDI
Highest 10%
50
10% to <25%
25% to <50%
50% to <75%
75% to <90%
25
Lowest 10%
0
0 1 2 3 4 5
Time From Study Baseline, y
Characteristic Patients With Complete 5-y Patients With Censored ASCVD Event
Follow-up (n 56 977) Outcome Data (n 52 816)
Race/sex, %
Black female 7.8 8.8
Black male 4.6 6.0
White female 47.2 45.5
White male 40.4 39.8
Mean age (SD), y 58 (12) 55 (13)
Mean blood pressure (SD), mm Hg
Systolic 126 (15) 126 (15)
Diastolic 77 (9) 77 (10)
Median total cholesterol level (IQR), mg/dL 197 (171224) 196 (171224)
Median HDL cholesterol level (IQR), mg/dL 52 (4364) 53 (4365)
Mean LDL cholesterol level (SD), mg/dL 118 (35) 118 (36)
Median triglyceride level (IQR), mg/dL 112 (79163) 108 (76159)
Median VLDL cholesterol level (IQR), mg/dL 22 (1632) 21 (1531)
Antihypertensive prescribed, % 52.3 43.1
Statin prescribed, % 39.8 27.9
Type 2 DM, %
No 82.3 88.2
Uncomplicated 0.8 0.6
With complications 16.9 11.2
Smoking, % 13.0 17.0
Coronary artery disease, % 7.9 5.3
Peripheral vascular disease, % 2.9 2.2
Family history of CVD, % 12.2 8.8
Family history of DM, % 5.5 4.5
Primary source of payment, %
Private/managed care 49.6 62.1
Medicare 47.6 31.4
Medicaid 1.7 3.3
Military 0.4 0.4
Self-pay/other 0.6 2.8
ASCVD = atherosclerotic cardiovascular disease; CVD = cardiovascular disease; DM = diabetes mellitus; HDL = high-density lipoprotein; IQR =
interquartile range; LDL = low-density lipoprotein; VLDL = very-low-density lipoprotein.
* To convert cholesterol values to mmol/L, multiply by 0.0259. To convert triglyceride values to mmol/L, multiply by 0.0113.
Appendix Table 3. Sample Means and SDs for the 8 Variables Involved in Calculating the NDI