Biomedical and Environmental Sciences  2017, Vol. 30 Issue (2): 106-112   PDF    
Development and Validation of a Model for Predicting Diabetic Nephropathy in Chinese People*
MIAO Dan Dan1 , PAN En Chun1 ,# , ZHANG Qin1 , SUN Zhong Ming1 , QIN Yu2 and WU Ming2 ,#     
1. Department of Chronic Disease Prevention and Control, Huai'an City Center for Disease Control and Prevention, Huai'an 223001, Jiangsu, China;
2. Department of Chronic Disease Prevention and Control, Jiangsu Provincial Center for Disease Control and Prevention, Nanjing 210009, Jiangsu, China
Abstract:

Objective To develop a risk model for predicting later development of diabetic nephropathy (DN) in Chinese people with type 2 diabetes mellitus (T2DM) and evaluate its performance with independent validation.

Methods We used data collected from the project 'Comprehensive Research on the Prevention and Control of Diabetes', which was a community-based study conducted by the Jiangsu Center for Disease Control and Prevention in 2013. A total of 11, 771 eligible participants were included in our study. The endpoint was a clear diagnosis of DN. Data was divided into two components:a training set for model development and a test set for validation. The Cox proportional hazard regression was used for survival analysis in men and women. The model's performance was evaluated by discrimination and calibration.

Results The incidence (cases per 10, 000 person-years) of DN was 9.95 (95% CI; 8.66-11.43) in women and 11.28 (95% CI; 9.77-13.03) in men. Factors including diagnosis age, location, body mass index, high-density-lipoprotein cholesterol, creatinine, hypertension, dyslipidemia, retinopathy, diet control, and physical activity were significant in the final model. The model showed high discrimination and good calibration.

Conclusion The risk model for predicting DN in people with T2DM can be used in clinical practice for improving the quality of risk management and intervention.

Key words: Type 2 diabetes mellitus     Diabetic nephropathy     Risk factors     Model development and validation    
INTRODUCTION

Diabetic nephropathy is a major complication of type 2 diabetes. Characteristics of diabetic nephropathy include: an elevated urinary albumin excretion rate and blood pressure, as well as a decline in renal function[1-4]. In a previous study, more than 95% of renal diseases were observed in people with diabetes[5-6]. However, the prevalence of renal disease in patients with type 2 diabetes mellitus (T2DM) was previously not acknowledged[7]. Recent evidence has suggested that DN is becoming the leading cause of end-stage renal disease (ESRD) in diabetic patients. Furthermore, diabetes plays a major role in the development of cardiovascular events, which can in turn aggravate renal dysfunction[8-10]. Several studies conducted in other countries have identified risk factors and subsequently developed risk equations for predicting DN among people with T2DM[2, 11-13]. However, due to the complex pathogenesis of DN and the variation among people from different countries, the results may not be directly applicable. In China, researchers from Shanghai and Beijing have studied the prevalence and risk factors of chronic kidney disease (CKD) in Chinese people with T2DM[14]. In 2006, the Hong Kong Diabetes Registry developed risk equations for predicting ESRD in clinical settings[15]. However, those studies were limited to the determination of prevalence through examination of end stage renal dysfunction in clinical participants or in those with renal disease at baseline. Therefore, the main objective of the current study was to evaluate both incidence and associated risk factors of DN in people with T2DM. Using this, we aimed to develop a model for risk prediction of DN among patients with T2DM.

METHODS Study Design and Data Source

We used data from the baseline dataset of the project, 'Comprehensive Research on the Prevention and Control of the Diabetes (CRPCD)'. The CRPCD project is a large community-based, ongoing study aimed at exploring an applicable technology for comprehensive intervention in people with T2DM (Details of the project can be found in Tables S1-S2 in Supplementary materials in www.besjournal.com). The primary outcome was the patients' first diagnosis of diabetic nephropathy, after the diagnosis of T2DM. Baseline date referred to the date of diagnosis of T2DM. A clinical diagnosis of DN was made on the basis of persistent albuminuria, diabetic retinopathy, and the absence of any clinical or laboratory evidence of other kidney or urinary tract disease[11]. Information about DN events was obtained, following a comprehensive medical record review, physical examination, or questionnaire survey. Participants were retrospectively followed from baseline until the day of the survey (December 31, 2013) or first occurrence of final events. Patients with missing information, necessary for the diagnosis of DN, or who had already been diagnosed with nephropathy before the baseline assessment were excluded. We also excluded individuals above the age of 80, and those below the age of 30.

In the end, 11, 771 participants were recruited, with 5, 705 participants (including 45 patients with DN) from Huai'an city. These were treated as the training set. A total of 6, 066 participants (including 32 patients with DN) were from Suzhou city and these were treated as the test set. Information from the two groups was used for model development and evaluation respectively.

Description of Variables

Information on demographics, lifestyle, and disease history was derived from the questionnaires administered. Smoking status during the follow-up period was ascertained through self-reporting. Baseline values of physical examination and laboratory tests were obtained from the medical records of participants or through self-reporting. The actual age was recorded as age of participant at the time of the study, whilst the date of diagnosis of the disease was obtained from the medical records. Smoking status was categorized as 'yes' and 'no' in response to the question 'Have you ever smoked 100 cigarettes in the past?' Physical activity levels by taking the product of the metabolic equivalent (MET) and the amount of time used for each activity. Physical activity was then categorized into low (MET < 31.22) and high (MET > 31.22). Duration of T2DM was defined as the time interval between the date of diagnosis and time of survey. Family history of diseases was recorded on the basis of any of the family members having the disease. Dietary habits were obtained from the questionnaire. Participants with diet control referred to those modifying their dietary habits according to doctors' advice. Antidiabetic treatment included oral hypoglycemic agent or insulin administration. Patients who took their medication as prescribed were classified as demonstrating 'good compliance' while patients who did not take drugs according to the prescription were classified as demonstrating 'poor compliance.' All variables were time varied.

Statistical Analysis

After confirming that the assumption of proportionality of hazards was met, we used the Cox proportional hazards regression model to estimate the parameters separately for men and women. Covariates in the baseline model included age at diagnosis, location, culture degree, smoking status, body mass index (BMI), creatinine, high-density lipoprotein (HDL) cholesterol, systolic blood pressure, hypertension, dyslipidemia, cardiovascular disease and retinopathy during follow-up, family history of cardiovascular disease, renal disease, and T2DM, antidiabetic treatment after diagnosis, treatment compliance, physical activity, and diet control. The estimated risks of DN for 5 years, 10 years, and 20 years were calculated for each participant using the test set. Observed risks were assessed by Kaplan-Meier method using a tenth of sex-specific predicted risk.

To address missing values for smoking status, BMI, and creatinine, we carried out multiple imputations based on each conditional density given other variables. Five copies of the original data were generated with sensible values randomly imputed based on their conditional distribution. The final results were obtained by combining the analysis of five data sets using Rubin's rules[16]. To derive the correct linear scale for continuous variable, we used the multiple fractional polynomial method for model development[17].

Model performance was evaluated by discrimination and calibration. Discrimination refers to the ability to distinguish between individuals who do and do not develop an event during the follow up period; it was evaluated by Harrell's C-index[18-19]. Statistics of R2 and Somers' D were also calculated[20-21]. Calibration was assessed by comparing observed risks versus predicted risks based on deciles of the predicted risk. All the statistical analyses were performed using Stata (Version 13.0) and the imputation procedure was carried out by the user-written program ICE in Stata[22].

RESULTS Baseline Characteristics and Incidence of DN

Baseline characteristics of the 11, 771 participants are shown in Table 1. Details of the proportion of observations with missing information on risk factors can also be found in this table. More than 90% of the participants had complete data on BMI, HDL-cholesterol, smoking status, and creatinine. The training set and test set contributed 28, 542 and 40, 580 person-years respectively, during the follow-up time. Final events were observed in 45 participants from Huai'an city and 32 participants in Suzhou.

Table 1
Baseline Characteristics of the Participants in the Training and Test Sets

The crude incidence of DN in all patients was 9.95 cases/10, 000 person-years (95% CI 8.66-11.43) for women and 11.28 cases/10, 000 person-years (95% CI 9.77-13.03) for men. The difference in incidence between the two cohorts was not statistically significant (P=0.087).

Risk Factors for DN

Table 2 shows the variables remaining in the final risk model after forward stepwise selection. High creatinine level, hypertension, dyslipidemia, and retinopathy were all associated with increased risk of DN. The highest risk of DN occurred in men with high serum creatinine levels. Interestingly, both BMI and diet control/physical activity were significant predictors in men but not in women.

Table 2
Estimated Hazard Ratios for Risk Factors in the Final Model
Model Performance

Using the model fashioned from the training set, the prediction in Table 3 shows the model's performance with different indicators. In men, the index values were larger. Figure 1 shows the calibration plots of our risk model. The graph shows good agreement between the observed risks and predicted risks at both 10-years and 20-years follow-up. However, a small degree of under-prediction of the estimated risk was observed at 5-years follow-up. The top quartiles of predicted risk identified 86.36% of women and 86.96% of men who developed DN over 10-years follow-up (sensitivity). The proportion of participants without DN who were not in the top quartile of the predicted risk was up to 80.41% for women and 80.67% for men (specificity).

Table 3
Model Performance with Different Indexes for Men and Women

Download:
Figure 1 Calibration Plots for the Risk model using the Test Set. (A) 5-year risk for women; (B) 10-year risk for women; (C) 20-year risk for women; (D) 5-year risk for men; (E) 10-year risk for men; (F) 20-year risk for men.
DISCUSSION

On the basis of a large-scale community-based study, we developed a risk model for predicting the risk of developing DN in people with T2DM in China. In both discrimination and calibration, the model performed well with independent validation. Under these circumstances, the implementation of our model may lead to better management of high-risk patients with diabetes.

In agreement with many previous studies, participants with a high creatinine level, retinopathy, hypertension, and dyslipidemia showed a higher incidence of DN[13, 23-24]. The BMI, which may increase the risk of cardiovascular disease, is not frequently considered in risk models of renal disease. In our study, the association between BMI and incidence of DN was significant only in men, which may explain the complex pathophysiology behind DN. In addition, this may also be caused by data issues.

Interestingly, women from urban areas were at higher risks than women from rural areas. However, the result was the opposite in men. This may be attributed to the actual situation in China. With the implementation of the CRPCD project, the community health centers or township hospitals were tasked with responsibility of carrying out health interventions. Compared with women from urban areas, women from rural areas are easily managed by doctors in the villages. In addition, an increasing number of men from rural areas have left home and worked in urban areas, which has increased the difficulty of management. Although the basis of these paradoxical results is not clear, the discordance between their respective risk factor profiles may hint towards adopting different parameters for urban and rural people.

In our study, we did not find a significant association between smoking and incidence of DN. Thus, the effect of smoking on the development of DN remains controversial. In addition, the Reduction of Endpoints in Non-insulin-dependent diabetes mellitus with Angiotensin Ⅱ Antagonist Losartan (RENAAL) study reported that smoking at baseline was not a risk factor for renal outcome[25]. Another previous study found that heavy smokers had an increased risk of ESRD[26]. As the smoking status information in our study was collected through self-reporting, for some participants, the number of cigarettes was not quantified, whilst for others, they may have stopped smoking during the follow-up period. Furthermore, it is possible that smokers may die prior to reaching the renal endpoints, and this was not taken into consideration[25].

Results from previous studies have demonstrated that antihypertensive treatment can reduce the incidence of DN and slow its progression to ESRD[27-29]. The effect of antihypertensive treatment was not evaluated owing to unavailable information on those therapies. It would therefore have difficulties to differentiate between which drugs participants were receiving during follow-up, and which drugs would be in use for future treatment. However, antihypertensive treatments would need to be considered in further studies.

Strengths and Limitations

The strengths of our study include the large community-based sample, which provided a realistic population to assess disease risk. The final risk model was validated using another data set and obtained strong discrimination and calibration. Currently, there are no widely accepted renal risk models for patients with T2DM, and the predictors used in many reported models are variable and often not available in such large-scale studies. Our model's easily obtainable values increase its potential feasibility.

However, the present study has several limitations. Firstly, the retrospective setting may increase the level of bias compared with prospective studies. Secondly, some clinical variables were unavailable and some information was self-reported. Additionally, the endpoint of this study was defined to represent the status or quality of patients' health alone, which Is too simple. Therefore, an endpoint that can comprehensively evaluate the progression, intervention, and prognosis remains to be discussed further. In addition, as the UKPDS 68 study reported, diabetes-related complications including congestive heart failure, ischemic heart disease, myocardial infarction, stroke, amputation, renal failure and eye disease were interrelated and have similar risk factors[13], the objective of this study may be extended to explore the risks of other diabetes-related complications simultaneously.

CONCLUSION

We have developed and validated a risk model for predicting the risk of DN among people with T2DM. With its potential to identify high-risk people, this model may be used by associated institutions to provide a basis for better public health policy and clinical practice guidelines in patients with DN. However, further studies are still needed to verify these findings, and we hope that this study may shed light on any further research focusing on diabetic nephropathy.

ACKNOWLEDGEMENTS

This research used data from the survey organized by Jiangsu Provincial Center for Disease Control and Prevention. We also thank the following organizations for their data collection expertise: Changshu City Center of Disease Control and Prevention, Huai'an District Center of Disease Control and Prevention in Huai'an city, Qing-he District Center of Disease Control and Prevention in Huai'an city.

AUTHOR CONTRIBUTIONS

PAN En Chun and WU Ming designed the study and take responsibility for all the entire process. ZHANG Qin, QIN Yu, WU Ming, and PAN En Chun performed the interviews for data and sample collections; MIAO Dan Dan, SUN Zhong Ming, and ZHANG Qin analyzed the data. MIAO Dan Dan and PAN En Chun drafted the paper. All authors have read and approved the final paper.

SUPPLEMENTARY MATERIALS Description of the CRPCD project

The study 'Comprehensive Research on the Prevention and Control of the Diabetes' (CRPCD) used stratified cluster sampling method in the 65 townships of three areas, in which 39, 564 T2D people had registered and received management of the 2012 National Basic Public Health Service (Changshu, Suzhou City & Huaiyin and Chuzhou, Huai'an City, Jiangsu Province, China). Townships that conducted other health care programs were excluded. Totally 29, 705 registered T2D patients in 44 townships were selected and 23, 240 individuals were recruited. Finally 20, 340 subjects undertook the questionnaire survey and physical examination (detailed consents were displayed in Table S1). All the examinations were performed within two months (from Dec, 2013 to Jan, 2014). Laboratory tests were done among 20, 053 participants respectively. The study protocol was approved by the Ethic Board of Jiangsu Provincial Center for Disease Control and Prevention (No. 2013026). All patients were well informed and signed a written consent before participating in this study.

Table S1
Details of Baseline Survey, Physical Examination and Laboratory Test

Table S2
Definition of Diagnosis of Disease
REFERENCES
1. Hovind P, Rossing P, Tarnow L, et al. Progression of diabetic nephropathy. Kidney Int, 2001, 59:702–9. doi:10.1046/j.1523-1755.2001.059002702.x
2. Rossing K, Christensen PK, Hovind P, et al. Progression of nephropathy in type 2 diabetic patients. Kidney Int, 2004, 66:1596–605. doi:10.1111/j.1523-1755.2004.00925.x
3. Ⅱ. Incidence and prevalence of ESRD. Am J Kidney Dis, 1999; 34, S40-50.
4. Burden AC, McNally PG, Feehally J, et al. Increased incidence of end-stage renal failure secondary to diabetes mellitus in Asian ethnic groups in the United Kingdom. Diabet Med, 1992, 9:641–5. doi:10.1111/dme.1992.9.issue-7
5. Hallan SI, Dahl K, Oien CM, et al. Screening strategies for chronic kidney disease in the general population:follow-up of cross sectional health survey. BMJ, 2006, 333:1047. doi:10.1136/bmj.39001.657755.BE
6. Sarnak MJ, Levey AS, Schoolwerth AC, et al. Kidney disease as a risk factor for development of cardiovascular disease:a statement from the American Heart Association Councils on Kidney in Cardiovascular Disease, High Blood Pressure Research, Clinical Cardiology, and Epidemiology and Prevention. Hypertension, 2003, 42:1050–65. doi:10.1161/01.HYP.0000102971.85504.7c
7. Fabre J, Balant LP, Dayer PG, et al. The kidney in maturity onset diabetes mellitus:a clinical study of 510 patients. Kidney Int, 1982, 21:730–8. doi:10.1038/ki.1982.90
8. Haffner SM, Lehto S, Ronnemaa T, et al. Mortality from coronary heart disease in subjects with type 2 diabetes and in nondiabetic subjects with and without prior myocardial infarction. N Engl J Med, 1998, 339:229–34. doi:10.1056/NEJM199807233390404
9. Tonelli M, Muntner P, Lloyd A, et al. Risk of coronary events in people with chronic kidney disease compared with those with diabetes:a population-level cohort study. Lancet, 2012, 380:807–14. doi:10.1016/S0140-6736(12)60572-8
10. Gerstein HC, Mann JF, Yi Q, et al. Albuminuria and risk of cardiovascular events, death, and heart failure in diabetic and nondiabetic individuals. JAMA, 2001, 286:421–6. doi:10.1001/jama.286.4.421
11. Yokoyama H, Tomonaga O, Hirayama M, et al. Predictors of the progression of diabetic nephropathy and the beneficial effect of angiotensin-converting enzyme inhibitors in NIDDM patients. Diabetologia, 1997, 40:405–11. doi:10.1007/s001250050694
12. Ueda H, Ishimura E, Shoji T, et al. Factors affecting progression of renal failure in patients with type 2 diabetes. Diabetes Care, 2003, 26:1530–4. doi:10.2337/diacare.26.5.1530
13. Clarke PM, Gray AM, Briggs A, et al. A model to estimate the lifetime health outcomes of patients with type 2 diabetes:the United Kingdom Prospective Diabetes Study (UKPDS) Outcomes Model (UKPDS no. 68). Diabetologia, 2004, 47:1747–59. doi:10.1007/s00125-004-1527-z
14. Lu B, Song X, Dong X, et al. High prevalence of chronic kidney disease in population-based patients diagnosed with type 2 diabetes in downtown Shanghai. J Diabetes Complications, 2008, 22:96–103. doi:10.1016/j.jdiacomp.2007.08.001
15. Yang XL, So WY, Kong AP, et al. End-stage renal disease risk equations for Hong Kong Chinese patients with type 2 diabetes:Hong Kong Diabetes Registry. Diabetologia, 2006, 49:2299–308. doi:10.1007/s00125-006-0376-3
16. Rubin DB. Multiple Imputation for Nonresponse in Surveys, New York: Wiley. Biometrics, 1989: 45.
17. Royston P, Ambler G, Sauerbrei W. The use of fractional polynomials to model continuous risk variables in epidemiology. Int J Epidemiol, 1999, 28:964–74. doi:10.1093/ije/28.5.964
18. Schemper M, Henderson R. Predictive accuracy and explained variation in Cox regression. Biometrics, 2000, 56:249–55. doi:10.1111/j.0006-341X.2000.00249.x
19. Heagerty PJ, Zheng Y. Survival model predictive accuracy and ROC curves. Biometrics, 2005, 61:92–105. doi:10.1111/biom.2005.61.issue-1
20. Royston P. Explained variation for survival models. Stata Journal, 2006, 6:83–96.
21. Royston P, Sauerbrei W. A new measure of prognostic separation in survival data. Stat Med, 2004, 23:723–48. doi:10.1002/(ISSN)1097-0258
22. Statacorp LP. Stata multiple-imputation reference manual. Stata Press Publication, 2011.
23. Manttari M, Tiula E, Alikoski T, et al. Effects of hypertension and dyslipidemia on the decline in renal function. Hypertension, 1995, 26:670–5. doi:10.1161/01.HYP.26.4.670
24. Thomas GN, Critchley JA, Tomlinson B, et al. Peripheral vascular disease in Type 2 diabetic Chinese patients:associations with metabolic indices, concomitant vascular disease and genetic factors. Diabet Med, 2003, 20:988–95. doi:10.1046/j.1464-5491.2003.01046.x
25. Keane WF, Brenner BM, de Zeeuw D, et al. The risk of developing end-stage renal disease in patients with type 2 diabetes and nephropathy:the RENAAL study. Kidney Int, 2003, 63:1499–507. doi:10.1046/j.1523-1755.2003.00885.x
26. Sawicki PT, Didjurgeit U, Muhlhauser I, et al. Smoking is associated with progression of diabetic nephropathy. Diabetes Care, 1994, 17:126–31. doi:10.2337/diacare.17.2.126
27. Bakris GL, Williams M, Dworkin L, et al. Preserving renal function in adults with hypertension and diabetes:a consensus approach. National Kidney Foundation Hypertension and Diabetes Executive Committees Working Group. Am J Kidney Dis, 2000, 36:646–61. doi:10.1053/ajkd.2000.16225
28. Schrier RW, Estacio RO, Esler A, et al. Effects of aggressive blood pressure control in normotensive type 2 diabetic patients on albuminuria, retinopathy and strokes. Kidney Int, 2002, 61:1086–97. doi:10.1046/j.1523-1755.2002.00213.x
29. Tight blood pressure control and risk of macrovascular and microvascular complications in type 2 diabetes:UKPDS 38. UK Prospective Diabetes Study Group. BMJ, 1998, 317:703–13. doi:10.1136/bmj.317.7160.703