Behavioral and psychosocial indicators for depression and anxiety risk stratification among college students: development and external validation of a machine-learning-assisted framework.
Frontiers in psychology · 2026
Abstract originale
Background Depression and anxiety symptoms are common among college students. Behavioral and psychosocial indicators may support preventive campus mental health work, but risk-stratification frameworks require external validation. Methods We developed a construct-level model-explanation framework using questionnaire data from a development sample. The cleaned dataset included 1,267 students; internal-validation analyses included 1,096 students for depression risk and 1,095 for anxiety risk. Risk was defined as a Patient Health Questionnaire-9 (PHQ-9) or Generalized Anxiety Disorder-7 (GAD-7) score of 10 or higher. The primary Feature set C random-forest (RF) pipelines integrated demographic, traditional, and emerging behavioral and psychosocial indicators. Fold-specific preprocessing and percentile cutoffs were used for internal validation. Locked pipelines were applied without retraining, predictor reselection, optimization, recalibration, or threshold adjustment to an independent university sample of 1,468 students. Results External area under the receiver operating characteristic curve (AUROC), area under the precision–recall curve (PR-AUC), and Brier scores were 0.813 (95% CI, 0.776–0.848), 0.402 (0.325–0.491), and 0.090 (0.083–0.098), respectively, for depression and 0.809 (0.765–0.851), 0.205 (0.144–0.300), and 0.063 (0.056–0.070), respectively, for anxiety. Ordinary participant-level bootstrap was the primary approach, with stratified bootstrap as a sensitivity analysis. Depression calibration was close to the prevalence baseline (Brier 0.091; intercept −0.668; slope 1.401), whereas anxiety showed miscalibration (Brier 0.063 vs. baseline 0.051; intercept −1.227; slope 1.102). The models supported external discrimination and risk ranking but did not validate individual absolute-risk probabilities or clinical thresholds. Conclusion Behavioral and psychosocial indicators supported externally validated risk stratification in an independent university sample. Anxiety-risk findings should be interpreted as preliminary because the number of positive cases was limited. Further evaluation is needed before wider implementation.
Parole chiave
Leggi il testo integrale originale
Testo estratto dalla pubblicazione: sono esclusi immagini, media, supplementi e parti soggette a diritti distinti.
Behavioral and psychosocial indicators for depression and anxiety risk stratification among college students: development and external validation of a machine-learning-assisted framework
Abstract
Background
Depression and anxiety symptoms are common among college students. Behavioral and psychosocial indicators may support preventive campus mental health work, but risk-stratification frameworks require external validation.
Methods
We developed a construct-level model-explanation framework using questionnaire data from a development sample. The cleaned dataset included 1,267 students; internal-validation analyses included 1,096 students for depression risk and 1,095 for anxiety risk. Risk was defined as a Patient Health Questionnaire-9 (PHQ-9) or Generalized Anxiety Disorder-7 (GAD-7) score of 10 or higher. The primary Feature set C random-forest (RF) pipelines integrated demographic, traditional, and emerging behavioral and psychosocial indicators. Fold-specific preprocessing and percentile cutoffs were used for internal validation. Locked pipelines were applied without retraining, predictor reselection, optimization, recalibration, or threshold adjustment to an independent university sample of 1,468 students.
Results
External area under the receiver operating characteristic curve (AUROC), area under the precision–recall curve (PR-AUC), and Brier scores were 0.813 (95% CI, 0.776–0.848), 0.402 (0.325–0.491), and 0.090 (0.083–0.098), respectively, for depression and 0.809 (0.765–0.851), 0.205 (0.144–0.300), and 0.063 (0.056–0.070), respectively, for anxiety. Ordinary participant-level bootstrap was the primary approach, with stratified bootstrap as a sensitivity analysis. Depression calibration was close to the prevalence baseline (Brier 0.091; intercept −0.668; slope 1.401), whereas anxiety showed miscalibration (Brier 0.063 vs. baseline 0.051; intercept −1.227; slope 1.102). The models supported external discrimination and risk ranking but did not validate individual absolute-risk probabilities or clinical thresholds.
Conclusion
Behavioral and psychosocial indicators supported externally validated risk stratification in an independent university sample. Anxiety-risk findings should be interpreted as preliminary because the number of positive cases was limited. Further evaluation is needed before wider implementation.
Keywords: anxiety, behavioral indicators, college students, depression, psychosocial factors, risk stratification
Background
Depression and anxiety symptoms among college students are important public health and educational concerns. University life is accompanied by academic demands, social transitions, irregular schedules, digital technology use, and changing health behaviors. Large international student mental health surveys and recent meta-analytic evidence have shown that common mental health symptoms are frequent in college populations, yet many students do not receive timely support (Auerbach et al., 2018; Lipson et al., 2022; Li et al., 2022). Scalable methods for identifying students at elevated risk may therefore have value for prevention, triage, and campus health promotion, provided that such methods are reported cautiously and externally validated before implementation.
The majority of questionnaire-based studies of student mental health have evaluated individual exposures or small groups of risk indicators. Traditional health behaviors, such as physical activity, sedentary behavior, sleep duration, smoking, alcohol consumption, and dietary habits, remain relevant to mental health risk. The behavioral environment of contemporary college students also includes smartphone engagement, recreational screen time, social jetlag, body-image concern, and psychosocial resources such as perceived social support. Evidence links perceived social support with student mental health (Hefner and Eisenberg, 2009; Ruihua et al., 2025; Vicary et al., 2025), problematic smartphone use with mental health and sleep-related outcomes (Li et al., 2020; Sohn et al., 2019), sleep timing misalignment with depressive symptoms (Wittmann et al., 2006; Luo et al., 2025), body dissatisfaction with mental health (Paxton et al., 2006), and breakfast and dietary-rhythm behaviors with mental health symptoms (Wang et al., 2025). These indicators may collectively provide predictive information beyond demographic and traditional lifestyle variables.
Risk stratification in student mental health requires approaches that integrate heterogeneous behavioral and psychosocial indicators while remaining transparent about uncertainty and calibration. Machine-learning (ML) models can serve this analytic role, but methodological rigor is essential. Apparent accuracy can be misleading when outcomes are imbalanced. Transparent reporting under the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis with artificial intelligence extensions (TRIPOD+AI) and applicability assessment under the Prediction model Risk Of Bias Assessment Tool with artificial intelligence extensions (PROBAST+AI) are relevant to prediction model research (Collins et al., 2024; Moons et al., 2025). Models that rank individuals well may still provide poorly calibrated probabilities, so discrimination and calibration should be reported together (Steyerberg, 2019; Van Calster et al., 2019). Precision–recall metrics are particularly informative for low-prevalence binary outcomes (Saito and Rehmsmeier, 2015; Davis and Goadrich, 2006). Recent student-focused prediction studies and systematic reviews further emphasize algorithm comparison and the reporting of multiple performance metrics (Schaab et al., 2024; Zhai et al., 2025; El Morr et al., 2024; Meda et al., 2023; Shin et al., 2025).
External validation is essential for evaluating whether a risk-stratification framework developed in one university sample retains performance in an independent student population (Riley et al., 2024). It provides preliminary evidence of transportability (Altman and Royston, 2000), although it does not by itself establish broad transportability.
This study developed and internally validated a behavioral and psychosocial risk-stratification framework with construct-level model explanation for depression and anxiety risk among college students. Machine-learning models were used as analytical tools to integrate multidimensional indicators; the primary contribution was the externally validated framework rather than a new algorithm. The analysis compared demographic, traditional health-behavior, and emerging health-risk/psychosocial feature sets and examined calibration, threshold-dependent performance, permutation-based model explanation, and sensitivity analyses.
Methods
Study design and participants
This cross-sectional model-development and external-validation study used questionnaire data from two independent university samples. The development sample was obtained from a single university, and the Shanghai external-validation cohort provided through the Shanghai Institute of Technology was treated as an independent external sample. Development questionnaire submissions were recorded from 25 November 2025 to 4 May 2026. Exact external recruitment dates could not be reconstructed from the retained study records. The raw development file contained 1,392 records, of which 1,385 included recorded consent.
The analysis followed current recommendations for transparent prediction model development and validation, including predefined outcome definitions, feature-set construction, internal validation, calibration assessment, and sensitivity analyses (Collins et al., 2024; Moons et al., 2025).
Eligibility and data-quality criteria
Development records were retained in the cleaned dataset if consent was recorded and the submission remained after duplicate review. Potential duplicates were identified using name, student identifier, sex, college, and major when available; within suspected duplicate groups, records with greater completion were retained, followed by greater data completeness and later submission time. Excluding 118 duplicate records yielded 1,267 students. Outcome-specific analyses additionally required a calculable PHQ-9 or GAD-7 total. Implausible predictor values were set to missing rather than used as record-level exclusion criteria. Figure 1 summarizes sample eligibility and the modeling pathway.
External-validation sample
External-validation data were obtained from the Shanghai cohort provided by the Shanghai Institute of Technology. The external file contained 1,983 records; 1,530 remained after duplicate review, and the 1,468 records marked as complete in the questionnaire system formed the external-validation sample. Both outcome analyses included 1,468 students, with 148 depression-risk cases (10.1%) and 79 anxiety-risk cases (5.4%). Potential duplicates were identified using student identifier, name, sex, and date of birth when available; complete records, records with greater data completeness, and later records or submission times were retained in that order. The process excluded 453 duplicate records from 336 suspected groups involving 789 records before completeness screening (Supplementary Table S1). Personal identifiers were excluded from the external-validation analysis files. The external sport field was mapped to sports_major using the existing binary rule (sport = 1 as sports-major and other non-missing values as non-sports-major). The data provider confirmed that sport = 2 denotes a non-sports major; all retained Shanghai records had sport = 2, so sports_major = 0 for all records. The 62 records excluded at the completeness stage were not marked complete in the questionnaire system. Duplicate records were resolved by retaining one record per suspected group according to the stated priority, without field-level reconciliation across duplicate records.
Assessment of depression and anxiety risk
Depression symptoms were assessed using the nine PHQ-9 items, with each item scored from 0 to 3 and total scores ranging from 0 to 27 (Kroenke et al., 2001). Depression risk was defined as a PHQ-9 total score of 10 or higher. Anxiety symptoms were assessed using the seven GAD-7 items, with total scores ranging from 0 to 21 (Spitzer et al., 2006). Anxiety risk was defined as a GAD-7 total score of 10 or higher. Participants with incomplete item information that prevented calculation of the corresponding PHQ-9 or GAD-7 total score were excluded from that outcome-specific analysis. These thresholds were used to identify students with at least moderate symptom severity and should not be interpreted as clinical diagnoses. PHQ-9 and GAD-7 items, total scores, and variables derived directly from self-harm or suicidal-behavior questions were excluded from all predictor sets to avoid outcome leakage.
Predictor variables and feature sets
Candidate predictors covered demographic, anthropometric, lifestyle, digital-behavior, sleep-rhythm, dietary, body-image, social-support, and general health-status domains. Constructs were selected a priori based on public health relevance and literature linking perceived social support (Hefner and Eisenberg, 2009), digital engagement (Li et al., 2020; Sohn et al., 2019), sleep and circadian timing (Wittmann et al., 2006; Luo et al., 2025), body image (Paxton et al., 2006), dietary habits (Wang et al., 2025), and physical activity and sedentary behavior (World Health Organization, 2020) with student mental health. Feature set A included demographic and basic socioeconomic variables. Feature set B added traditional health behaviors. Feature set C added emerging behavioral and psychosocial indicators and was selected as the primary construct-level feature set. Feature set D contained more granular and correlated variables and was retained as a sensitivity model. Operational definitions, feature-set membership, measurement characteristics of questionnaire-derived scores, and patterns of missingness are reported in Supplementary Tables S2a–S2c and S3. Social support was included because lower perceived support has been associated with poorer mental health outcomes among university students (Hefner and Eisenberg, 2009).
Problematic smartphone use has been associated with depression and anxiety symptoms (Li et al., 2020; Sohn et al., 2019). It has also been associated with sleep-related problems (Crowhurst and Hosseinzadeh, 2024; Yin et al., 2025). Sleep timing and social jetlag indicators were incorporated because circadian misalignment has been associated with depressive symptoms in college populations (Wittmann et al., 2006; Luo et al., 2025). Body-image indicators were included based on evidence linking body dissatisfaction to mental health outcomes (Paxton et al., 2006). Dietary-rhythm indicators were considered based on evidence regarding breakfast habits and mental health symptoms among students (Wang et al., 2025). Physical activity and sedentary behavior domains were retained according to international public health recommendations (World Health Organization, 2020).
Some continuous questionnaire-derived scores and their dichotomized high-risk indicators represented related constructs. The indicators were retained in Feature set C to represent prespecified threshold-based information, while the continuous scores preserved gradient information. Predictor importance was therefore interpreted at the construct level rather than as independent information from every listed variable.
Model development, feature selection, and internal validation
The primary benchmark compared logistic regression, random forest, and support vector machine (SVM) classifiers for Feature set C (Supplementary Table S4). Model specifications are reported in Supplementary Table S5. The primary benchmark retained the prespecified Feature set C predictors; the random forest was selected after algorithm-level comparison for its combination of discrimination profile and support for descriptive model-level explanation (Schaab et al., 2024; Zhai et al., 2025; El Morr et al., 2024; Meda et al., 2023; Shin et al., 2025; Breiman, 2001). Random forest remains a complex ensemble model, and the current analysis does not provide individual-level or clinical explanations. Numeric predictors were median-imputed and standardized within each training fold, whereas categorical predictors were imputed with the most frequent category and one-hot encoded. All preprocessing was estimated within the training fold and then applied to the held-out fold. Analyses used scikit-learn (Pedregosa et al., 2011). Analyses were performed in Python 3.13.5 using scikit-learn 1.6.1 (Pedregosa et al., 2011), pandas 2.2.3, NumPy 2.1.3, SciPy 1.15.3, and Matplotlib 3.10.0. The overall analysis workflow is shown in Supplementary Figure S1. Missing values were handled within this fold-specific modeling pipeline rather than by complete-case deletion as the primary analysis.
Internal validation used repeated stratified 5-fold cross-validation (CV) with 5 repeats, yielding 25 validation folds. Percentile-derived binary indicators were recalculated within each training fold and applied to the held-out fold. Model performance was summarized using pooled participant-level AUROC, average precision (reported as PR-AUC), Brier score, recall, specificity, precision, F1 score, and balanced accuracy (Steyerberg, 2019; Brier, 1950). Default-threshold classification metrics used a threshold of 0.5. The development-derived Youden thresholds (Youden, 1950) were retained for transparent threshold evaluation. Because the outcomes were imbalanced, PR-AUC was reported as a complementary measure to AUROC (Saito and Rehmsmeier, 2015; Davis and Goadrich, 2006), and calibration was assessed separately (Van Calster et al., 2019).
The archived development-only optimization pathway was retained for traceability; after correction of the preprocessing workflow, its estimates were not treated as formally corrected internal-validation results.
Calibration, interpretation, and sensitivity analyses
Internal calibration was examined using pooled participant-level predictions from the corrected fold-specific pipeline. The corrected Feature set C calibration intercept/slope values were −0.891/1.119 for depression risk and −0.961/1.129 for anxiety risk. The earlier sigmoid and isotonic calibration comparisons were generated before the preprocessing correction and are not retained as formal corrected estimates. These results characterize internal calibration of the corrected pipeline and do not establish externally validated individual risk probabilities.
Permutation importance based on AUROC was used as a descriptive model-level explanation. Directionality summaries compared observed event rates and mean predicted probabilities across quartiles or categories of higher-ranked variables (Molnar, 2022). For the external locked models, related variables were jointly permuted within eight prespecified constructs; group importance was defined as the decrease in AUROC relative to the baseline external prediction, with results reported separately in Supplementary Table S21. These analyses characterize model behavior and do not establish causal effects.
External-validation analysis
After corrected internal validation, the final Feature set C random-forest pipelines were refitted on the full outcome-specific development samples and then applied to the external-validation dataset without retraining, predictor reselection, hyperparameter optimization, recalibration, or threshold adjustment. The external cohort was used only for final model evaluation. Feature engineering followed the development-sample rules. Sleep-time variables in the external-validation dataset were converted from seconds since midnight to clock-time values before deriving weighted sleep duration, short sleep, social jetlag, and high social jetlag according to the development-sample rules. Four distribution-based binary indicators used the fixed development-sample cutoffs. All sleep-time conversion and derived-variable construction were performed before and independently of outcome-specific analyses and model fitting; this preprocessing was outcome-blind. External-validation metrics included AUROC, PR-AUC, Brier score, calibration intercept, calibration slope, recall, specificity, precision, F1 score, and balanced accuracy. Ordinary participant-level bootstrap was the primary external uncertainty analysis; stratified bootstrap was a sensitivity analysis. The fixed internal Youden thresholds were 0.226 for depression risk and 0.251 for anxiety risk and were not re-estimated in the Shanghai external-validation cohort. For the locked primary Feature set C predictions, decision-curve analysis evaluated thresholds from 0.05 to 0.30 against treat-all and treat-none strategies (Supplementary Figure S5).
For locked external predictions, positive predictive value (PPV) and negative predictive value (NPV) were estimated under assumed prevalence levels of 5, 10, 15, and 20% using external-validation sensitivity and specificity at the fixed development-derived thresholds.
Sensitivity analyses
Sensitivity analyses included complete-case analysis, removal of sleep and rhythm variables, removal of dichotomized predictors that duplicated continuous scores, removal of anthropometric variables, logistic-regression robustness models, and the full Feature set D random-forest model. For the external-validation sensitivity analysis, one Feature set D pipeline was refit for each outcome on the full outcome-specific development sample using its fixed 70-variable specification and then applied to Shanghai; the results are reported in Supplementary Table S25. Because several archived analyses used legacy materialized percentile indicators, their numerical internal-validation estimates were not treated as formal results after correction of the preprocessing workflow. The corrected Feature set C estimates are reported in Table 1 and Supplementary Table S20. Development-only predictor-selection frequencies are provided in Supplementary Table S23; these are descriptive traceability outputs from the archived development-only selection pathway and are not treated as formal leakage-free model-selection estimates. A prediction-only all-0/all-1 sports_major mapping sensitivity using the locked primary pipelines is provided in Supplementary Table S24; this did not replace the primary external estimates. Because the anxiety outcome had 66 positive development cases and 79 positive external cases, the archived anxiety predictor rankings, number of selected predictors, and tuning outputs were treated as exploratory and potentially unstable.
Table 1Internal-validation performance of random-forest models across feature sets.
Outcome Feature set AUROC (corrected pooled CV) PR-AUC (corrected pooled CV) Brier score (corrected pooled CV) Recall Specificity
Depression risk A 0.506 0.113 0.123 0.020 0.982
Depression risk B 0.657 0.147 0.108 0.000 0.981
Depression risk C 0.773 0.266 0.091 0.176 0.963
Depression risk D 0.812 0.369 0.081 0.157 0.991
Anxiety risk A 0.602 0.107 0.084 0.045 0.989
Anxiety risk B 0.634 0.119 0.075 0.015 0.999
Anxiety risk C 0.796 0.266 0.062 0.167 0.984
Anxiety risk D 0.849 0.317 0.055 0.106 0.994
PR-AUC was calculated as average precision. Feature set A contained no percentile-derived indicators; Feature sets B–D used fold-specific percentile cutoffs and training-fold preprocessing.
Results
Sample characteristics and outcome availability
The raw questionnaire file contained 1,392 records. After consent screening and duplicate exclusion, the cleaned analytic dataset included 1,267 students. Depression-risk status was available for 1,096 students, of whom 102 were classified as positive cases (9.31%); 171 students lacked complete PHQ-9 outcome data and were excluded from the depression-specific analysis. Anxiety-risk status was available for 1,095 students, of whom 66 were classified as positive cases (6.03%); 172 students lacked complete GAD-7 outcome data and were excluded from the anxiety-specific analysis. The development-sample study flow is summarized in Figure 1. Table 2 summarizes participant characteristics by depression-risk status; anxiety-stratified characteristics are provided in Supplementary Table S8. Comparisons between participants included in and excluded from the outcome-specific analyses because of missing PHQ-9 or GAD-7 outcome data are provided in Supplementary Table S9.
Table 2Participant characteristics by depression-risk status.
Characteristic Overall Depression-risk negative Depression-risk positive p-value
N 1,096 994 102
Age, years, mean ± SD 19.17 ± 1.11 19.14 ± 1.09 19.47 ± 1.26 0.003
BMI, kg/m2, mean ± SD 21.97 ± 4.87 21.96 ± 4.83 22.06 ± 5.28 0.955
Waist circumference, cm, mean ± SD 76.78 ± 11.26 76.91 ± 11.26 75.55 ± 11.21 0.294
Weighted sedentary hours, mean ± SD 5.82 ± 3.27 5.82 ± 3.29 5.85 ± 3.06 0.645
Recreational screen time, hours, mean ± SD 4.10 ± 3.24 4.05 ± 3.22 4.54 ± 3.41 0.229
Smartphone dependency score, mean ± SD 24.50 ± 8.88 23.77 ± 8.39 31.65 ± 10.31 <0.001
Weighted sleep duration, hours, mean ± SD 8.12 ± 1.13 8.14 ± 1.10 7.87 ± 1.42 0.181
Social jetlag, hours, mean ± SD 1.38 ± 1.08 1.36 ± 1.08 1.59 ± 1.07 0.043
Body-image concern score, mean ± SD 19.16 ± 9.57 18.53 ± 9.18 25.35 ± 11.03 <0.001
Social support score, mean ± SD 59.32 ± 13.32 59.92 ± 13.24 53.48 ± 12.82 <0.001
Female, n (%) 534 (48.7) 477 (48.0) 57 (55.9) 0.157
Sports major, n (%) 77 (7.0) 65 (6.5) 12 (11.8) 0.078
Physical inactivity, n (%) 220 (20.1) 195 (19.6) 25 (24.5) 0.296
High sedentary time, n (%) 321 (29.3) 289 (29.1) 32 (31.4) 0.710
High smartphone dependency, n (%) 303 (27.6) 242 (24.3) 61 (59.8) <0.001
Short sleep, n (%) 129 (14.4) 110 (13.4) 19 (26.4) 0.004
Evening chronotype, n (%) 655 (59.8) 584 (58.8) 71 (69.6) 0.043
Breakfast skipping, n (%) 465 (42.4) 409 (41.1) 56 (54.9) 0.010
Current smoking status, n (%) 39 (3.6) 29 (2.9) 10 (9.8) 0.002
Current alcohol consumption, n (%) 216 (19.7) 185 (18.6) 31 (30.4) 0.007
High body-image concern, n (%) 284 (25.9) 232 (23.3) 52 (51.0) <0.001
Low social support, n (%) 289 (26.4) 241 (24.2) 48 (47.1) <0.001
Depression risk was defined as PHQ-9 ≥ 10. Values are shown as mean ± SD or n (%). p-values were obtained using the Welch t-tests or Mann–Whitney U tests for continuous variables and chi-squared tests or Fisher’s exact tests for categorical variables, as appropriate. Selected characteristics are shown to describe the analytic sample; full anxiety-stratified results are provided in Supplementary Table S8. Percentages were calculated using non-missing denominators; denominators may vary across variables because of missing data.
Internal-validation performance
The corrected pooled cross-validated estimates showed limited discrimination for the demographic-only model, with incremental improvement after adding traditional health-behavior and emerging behavioral/psychosocial variables. For depression risk, Feature sets A–D achieved AUROC values of 0.506, 0.657, 0.773, and 0.812, with PR-AUC values of 0.113, 0.147, 0.266, and 0.369, respectively. For anxiety risk, the corresponding AUROC values were 0.602, 0.634, 0.796, and 0.849, with PR-AUC values of 0.107, 0.119, 0.266, and 0.317. Feature set A contained no percentile-derived indicators; for Feature sets B-D, percentile cutoffs were estimated within each training fold. The corrected pooled estimates are reported in Table 1 and illustrated in Figure 2. The earlier nested optimization tables are retained only as traceability artifacts and are not formal internal-validation results.
Calibration and threshold-dependent performance
At the default threshold of 0.5, the corrected Feature set C models showed high specificity but limited recall. For depression risk, default-threshold recall and specificity were 0.176 and 0.963; for anxiety risk, they were 0.167 and 0.984. At the fixed development-derived thresholds of 0.226 and 0.251, recall/specificity were 0.716/0.710 for depression risk and 0.636/0.845 for anxiety risk. Corrected calibration intercepts/slopes were −0.891/1.119 for depression risk and −0.961/1.129 for anxiety risk. Formal corrected estimates are summarized in Table 3, with the corresponding internal calibration curves shown in Figure 3; pre-correction sigmoid/isotonic Brier comparisons were not retained as formal results.
Table 3Calibration and threshold analysis for the primary Feature set C random-forest models.
Metric Depression risk Anxiety risk
Outcome sample size, n 1,096 1,095
Observed event rate 0.093 0.060
AUROC (corrected pooled CV) 0.773 0.796
PR-AUC / average precision (corrected pooled CV) 0.266 0.266
Uncalibrated Brier score (corrected pooled CV) 0.091 0.062
Baseline Brier score 0.084 0.057
Calibration intercept (corrected pooled CV) −0.891 −0.961
Calibration slope (corrected pooled CV) 1.119 1.129
Sigmoid-calibrated Brier score Not retained Not retained
Isotonic-calibrated Brier score Not retained Not retained
Default-threshold recall 0.176 0.167
Default-threshold specificity 0.963 0.984
Fixed development-derived Youden threshold 0.226 0.251
Fixed-threshold recall 0.716 0.636
Fixed-threshold specificity 0.710 0.845
Metrics are pooled participant-level estimates from repeated stratified 5-fold cross-validation with fold-specific percentile cutoffs and training-fold preprocessing. Pre-correction sigmoid and isotonic Brier comparisons were not retained as formal corrected estimates. Fixed threshold rows use the original development-derived thresholds for transparent evaluation.
Important predictors and directionality
Table 4 summarizes each construct by summing the variable-level permutation-importance values of its prespecified continuous and dichotomized representations. Because related representations can share information, the external joint group-permutation analysis is reported separately in Supplementary Table S21.
Table 4Construct-level predictor importance for the primary Feature set C random-forest models.
Rank Depression risk construct Importance Anxiety risk construct Importance
1 Perceived social support 0.0159 Body-image concern 0.0093
2 Body-image concern 0.0123 Perceived social support 0.0075
3 Smartphone dependency 0.0123 Smartphone dependency 0.0074
4 Breakfast skipping 0.0098 Waist circumference 0.0035
5 Social jetlag 0.0068 Weighted average sedentary time 0.0034
6 Sleep duration 0.0052 Social jetlag 0.0030
7 Waist circumference 0.0044 Recreational screen time 0.0025
8 Weighted average sedentary time 0.0043 Monthly living allowance 0.0024
9 Body mass index 0.0040 Sleep duration 0.0021
10 Evening chronotype 0.0038 Body mass index 0.0021
Permutation importance was based on AUROC and summarized variable-level decreases. This table reports construct-level sums of related variable-level values; the external joint group-permutation analysis is reported separately in Supplementary Table S21.
Table 5External-validation performance of the primary Feature set C random-forest models.
Outcome n Positive n (%) AUROC (95% CI) PR-AUC (95% CI) Brier score (95% CI)
Depression risk 1,468 148 (10.1%) 0.813 (0.776–0.848) 0.402 (0.325–0.491) 0.090 (0.083–0.098)
Anxiety risk 1,468 79 (5.4%) 0.809 (0.765–0.851) 0.205 (0.144–0.300) 0.063 (0.056–0.070)
PR-AUC was calculated as average precision. Ordinary participant-level bootstrap was the primary external uncertainty analysis; stratified participant-level bootstrap was a sensitivity analysis. Calibration intercept and slope were estimated using logistic calibration models based on the logit of predicted probabilities.
Directionality summaries suggested that higher-ranked constructs showed directionally consistent differences in predicted risk probabilities, including patterns involving smartphone dependency, body-image concern, social jetlag, breakfast skipping, and lower social support. Lower social-support scores and shorter weighted sleep duration also appeared in higher-risk prediction patterns. Waist circumference and monthly allowance required cautious interpretation because their directions were less straightforward or potentially non-linear. Top constructs are shown in Table 4 and Figure 4.
Sensitivity analyses
The legacy internal sensitivity-analysis estimates in Supplementary Table S7 were not retained as formal results after correction of the preprocessing workflow. In the Feature set C-clean analysis, which retained short sleep duration and high social jetlag but removed other dichotomized indicators duplicated by continuous scores, external validation remained similar for depression risk (AUROC = 0.820, PR-AUC = 0.407, Brier score = 0.090) and anxiety risk (AUROC = 0.807, PR-AUC = 0.214, Brier score = 0.062), although default-threshold recall was lower (Supplementary Table S11, Part B). Logistic-regression robustness models showed lower discrimination than random forests, particularly for depression risk. In the Feature set D external-validation sensitivity analysis, AUROC was 0.845 (95% CI, 0.812–0.874), PR-AUC was 0.465 (0.382–0.545), and Brier score was 0.080 (0.073–0.087) for depression risk; corresponding values for anxiety risk were 0.854 (0.810–0.891), 0.278 (0.196–0.389), and 0.053 (0.047–0.060), respectively. These models showed higher AUROC and PR-AUC but greater complexity, so Feature set D remained a sensitivity model (Supplementary Table S25). Anxiety threshold and predictor-importance estimates were treated as exploratory because fewer than 100 positive cases were available. Reciprocal validation showed broadly consistent discrimination for depression risk (AUROC = 0.760, PR-AUC = 0.299, Brier score = 0.076) and anxiety risk (AUROC = 0.823, PR-AUC = 0.272, Brier score = 0.050) (Supplementary Table S12). Depression-risk and anxiety-risk outcomes were strongly associated but not identical (Supplementary Table S13).
External validation
The external-validation dataset included 1,468 students after duplicate-record exclusion and completeness screening. Depression-risk status was positive in 148 students (10.1%), and anxiety-risk status was positive in 79 students (5.4%). In external validation, the depression-risk model achieved AUROC = 0.813 (95% CI, 0.776–0.848), PR-AUC = 0.402 (95% CI, 0.325–0.491), and Brier score = 0.090 (95% CI, 0.083–0.098) (Figure 5). The anxiety-risk model achieved AUROC = 0.809 (95% CI, 0.765–0.851), PR-AUC = 0.205 (95% CI, 0.144–0.300), and the Brier score = 0.063 (95% CI, 0.056–0.070). Ordinary participant-level bootstrap was the primary uncertainty analysis, with stratified bootstrap performed as a sensitivity analysis. Depression calibration was summarized by an intercept of −0.668 and a slope of 1.401, with a Brier score close to the prevalence-only baseline (0.091). Anxiety showed meaningful external miscalibration: the Brier score was 0.063 versus a prevalence-only baseline of 0.051, with an intercept of −1.227 and a slope of 1.102 (Figure 6). The models therefore supported external risk discrimination and ranking, not validated individual absolute-risk probabilities or clinical decision thresholds. At the default threshold, recall/specificity were 0.318/0.961 for depression risk and 0.241/0.970 for anxiety risk. At the fixed internal Youden thresholds, they were 0.791/0.689 and 0.608/0.828, respectively.
Development-only optimization reassessment
The original development-only nested optimization outputs were reviewed after correction of the preprocessing workflow. Because the earlier pipeline materialized percentile flags before cross-validation, those nested performance estimates are not retained as formal results. The corrected Feature set C internal-validation results are reported in Supplementary Table S20, and the prespecified Feature set C model remains the primary benchmark.
Discussion
Principal findings
This study developed and internally validated a behavioral and psychosocial risk-stratification framework with construct-level model explanation in a single-university development sample and was externally evaluated using the locked primary model in an independent university sample. Corrected internal estimates and the original locked external point estimates are reported separately and transparently.
External validation supported the discrimination and risk-ranking capability of the primary Feature set C models in an independent university sample. The ordinary-bootstrap results also showed that discrimination and probability calibration provide different information: the depression Brier score was close to the prevalence-only baseline, whereas the anxiety Brier score exceeded it. The framework should therefore be used as a research-oriented risk-stratification approach rather than as a source of validated individual absolute-risk probabilities or clinical decision thresholds.
Interpretation of model performance
In low-prevalence settings, a model can show high specificity and accuracy while missing many positive cases; precision–recall metrics therefore provide additional information beyond receiver operating characteristic curve (ROC) analysis (Saito and Rehmsmeier, 2015; Davis and Goadrich, 2006).
Calibration and practical implications
Calibration and discrimination should be interpreted jointly when assessing externally validated risk-stratification frameworks. Differences between university samples may affect absolute-risk estimates, so local recalibration and threshold assessment remain appropriate before broader implementation.
The archived development-only optimization pathway is not interpreted as a formal performance comparison because its legacy percentile preprocessing preceded cross-validation. The prespecified Feature set C model therefore remains the primary benchmark; feature selection, tuning, calibration, and decision analyses are interpreted in light of the corrected internal-validation analysis.
Accordingly, at the current stage, the models are better viewed as risk-stratification tools for research and hypothesis generation rather than diagnostic tools, automatic risk-classification systems, or stand-alone implementation-ready decision-support systems. Threshold interpretation should remain context-specific: the default 0.5 threshold emphasizes specificity, whereas the development-derived Youden thresholds trade specificity for recall. Prevalence-adjusted or utility-based cutoffs may be preferable in practice, depending on the relative costs of false-negative and false-positive classifications and on referral capacity. Local Platt or isotonic recalibration should be assessed using an independent local sample before broader implementation.
Predictor patterns
The construct pattern was consistent with a multidimensional view of student mental health. Previous machine-learning studies using behavioral and health-related indicators have similarly suggested that heterogeneous information sources may improve identification of students with elevated psychological risk (Chowdhury et al., 2024; Rahman et al., 2023). Recent studies have further emphasized that integrating multidomain behavioral, psychosocial, and digital indicators may provide complementary information for identifying students at elevated mental health risk (Zhang et al., 2024; Shvetcov et al., 2024). Methodological reviews also emphasize transparent reporting and appropriate validation design in AI-based mental health research (Tornero-Costa et al., 2023). External validation and calibration assessment remain essential before broader implementation (Collins et al., 2024; Moons et al., 2025). Feature set C-clean produced similar patterns after removing duplicated indicators; Feature set C remained primary because it retained gradient and threshold-type information.
Perceived social support may represent an interpersonal resource linked to lower depression, anxiety, and stress symptoms among university students (Guo et al., 2021). Problematic smartphone use may intersect with mental health through sleep quality and peer relationships; evidence in Chinese medical students supports sleep quality as a potential pathway between mobile phone addiction and depression (Feng et al., 2022). Passive-sensing research has also used digital behavioral indicators to predict stress among university students (Shvetcov et al., 2024). Body image has been examined alongside depression and anxiety in Chinese college students (Han et al., 2023), while sleep duration was interpreted using established guidance on sleep duration (Hirshkowitz et al., 2015).
Because several dichotomized predictors were derived from continuous questionnaire-derived scores, feature-importance results should be interpreted as construct-level signals rather than independent effects of each individual variable.
The construct-level importance values in Figure 4 should be interpreted as descriptive contributions to model discrimination rather than as effect sizes or evidence of independent clinical effects. Related variables share information, and the variable-level summaries in Figure 4 are complemented by the joint external group-permutation analysis in Supplementary Table S21. Lower-ranked constructs with small importance values may be unstable, so interpretation focuses on broader construct patterns rather than small differences among lower-ranked variables.
The overlap in construct-level model explanation between the depression-risk and anxiety-risk models is consistent with the close psychological relationship between depressive and anxious symptoms. Shared constructs, including perceived social support, body-image concern, smartphone dependency, social jetlag, and sleep duration, may reflect common behavioral and psychosocial contexts. The two outcomes were modeled separately because their ranking, calibration, and event precision differed; anxiety findings remain preliminary because 79 external positive cases produced greater uncertainty, particularly for PR-AUC, calibration, and threshold metrics.
Strengths and limitations
The study strengths included sample-flow documentation, duplicate review, exclusion of outcome-leakage variables, prespecified feature sets, repeated internal cross-validation, evaluation of PR-AUC and calibration, model-level explanation, and external validation. The limitations included the cross-sectional design, questionnaire-derived predictors, fewer than 100 anxiety-risk cases, restriction to Chinese university settings, possible common-method bias from self-reported predictors and outcomes collected in the same survey, and outcome-specific missingness. Participants with complete outcome data differed in age and perceived social support from those excluded, so selection bias related to outcome availability cannot be excluded. Differences in age and several behavioral distributions between the two cohorts indicate case-mix shift, which may partly contribute to the observed external calibration drift. Sleep-related predictors had approximately 27.5% missingness in the development cohort. The primary imputation strategy implicitly relied on missingness being adequately handled by observed information; however, students with more irregular lifestyles or greater psychological distress may have been more likely to omit sleep-related items, and a missing-not-at-random mechanism cannot be excluded. The Shanghai external cohort contained no sports-major students: sport = 2 for all retained records denoted non-sports majors, and sports_major was therefore set to 0 for all records. The sports_major predictor was invariant in this cohort, so its transportability across different sports-major compositions could not be assessed separately. Development-sample cutoffs and fixed thresholds may require local reassessment, and local Platt or isotonic recalibration may be needed before implementation. A prediction-only all-0/all-1 mapping sensitivity using the locked pipelines is reported in Supplementary Table S24; the current mapping is based on the confirmed sport = 2 code meaning, and the all-1 scenario is a counterfactual sensitivity analysis. In this prediction-only sensitivity, discrimination was relatively insensitive to the alternative coding, whereas probability calibration showed somewhat greater sensitivity (Supplementary Table S24). Feature set D external-validation sensitivity results using the confirmed sports_major = 0 mapping are reported separately in Supplementary Table S25. Exact invitation denominators, response rates, and a complete reconstruction of the original sampling frame or stratification procedure were unavailable from the retained study records.
Conclusion
In corrected internal validation, emerging behavioral and psychosocial indicators improved risk stratification beyond demographic and traditional health-behavior variables. External validation showed that the primary Feature set C models retained discrimination and risk-ranking capability, but probability calibration and practical thresholds require further evaluation. The results support a model-level explanatory framework for prevention-oriented research, not a clinical or screening-ready decision system. Anxiety-risk estimates should be interpreted as preliminary because the number of positive cases was limited.
Acknowledgments
We acknowledge Anhui Medical University for initiating and coordinating the collaborative research project that provided the framework for this study. We thank the Shanghai Institute of Technology for providing the external-validation dataset and supporting data collection and the collaborating institutions and students for their participation.
Funding Statement
The author(s) declared that financial support was not received for this work and/or its publication.
Edited by: Valeria Saladino, Magna Græcia University, Italy
Reviewed by: Rubén Baena-Navarro, University of Córdoba, Colombia
Xialong Cheng, Hefei Fourth People’s Hospital, China
Abbreviations: AP, average precision; AUROC, area under the receiver operating characteristic curve; BMI, body mass index; CV, cross-validation; GAD-7, Generalized Anxiety Disorder-7; ML, machine learning; OOF, out-of-fold; PHQ-9, Patient Health Questionnaire-9; PR-AUC, area under the precision–recall curve; RF, random forest; SVM, support vector machine; PROBAST+AI, Prediction model Risk of Bias Assessment Tool with artificial intelligence extensions; TRIPOD+AI, Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis with artificial intelligence extensions.
Data availability statement
The participant-level datasets are not publicly available because they contain sensitive health information and are subject to ethical and institutional restrictions. Requests for access to de-identified data should be directed to the corresponding author, Guopeng Hu (hugp@hqu.edu.cn). Access may be granted on reasonable request, subject to the relevant ethical and institutional approvals. The analysis code and locked model objects can be made available from the corresponding author on reasonable request, subject to institutional, ethical, and data-use restrictions.
Ethics statement
The studies involving humans were approved by the Ethics Committee of Anhui Medical University, Hefei, China. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
KM: Conceptualization, Data curation, Software, Visualization, Writing – review & editing. YH: Formal analysis, Investigation, Project administration, Writing – review & editing. XY: Project administration, Resources, Supervision, Writing – review & editing. LL: Conceptualization, Methodology, Validation, Writing – original draft. YZ: Investigation, Project administration, Validation, Writing – review & editing. GH: Conceptualization, Data curation, Formal analysis, Project administration, Writing – review & editing.
Conflict of interest
The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author(s) declared that Generative AI was not used in the creation of this manuscript.
Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2026.1972318/full#supplementary-material
References
Altman D. G., Royston P. (2000). What do we mean by validating a prognostic model?
Stat. Med.
19, 453–473. doi: 10.1002/(SICI)1097-0258(20000229)19:4<453::AID-SIM350>3.0.CO;2-5,
Auerbach R. P., Mortier P., Bruffaerts R., Alonso J., Benjet C., Cuijpers P., et al. (2018). WHO world mental health surveys international college student project: prevalence and distribution of mental disorders. J. Abnorm. Psychol.
127, 623–638. doi: 10.1037/abn0000362,
Breiman L. (2001). Random forests. Mach. Learn.
45, 5–32. doi: 10.1023/A:1010933404324
Brier G. W. (1950). Verification of forecasts expressed in terms of probability. Mon. Weather Rev.
78, 1–3. doi: 10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2
Chowdhury A. H., Rad D., Rahman M. S. (2024). Predicting anxiety, depression, and insomnia among Bangladeshi university students using tree-based machine learning models. Health Sci Rep.
7:e2037. doi: 10.1002/hsr2.2037,
Collins G. S., Moons K. G. M., Dhiman P., Riley R. D., Beam A. L., Van Calster B., et al. (2024). TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ
385:e078378. doi: 10.1136/bmj-2023-078378,
Crowhurst S., Hosseinzadeh H. (2024). Risk factors of smartphone addiction: a systematic review of longitudinal studies. Public Health Chall.
3:e202. doi: 10.1002/puh2.202,
Davis J., Goadrich M.
The relationship between precision-recall and ROC curves
Proceedings of the 23rd International Conference on Machine Learning. New York, NY: Association for Computing Machinery; (2006) 233–240.
El Morr C., Jammal M., Bou-Hamad I., Hijazi S., Ayna D., Romani M., et al. (2024). Predictive machine learning models for assessing Lebanese university students' depression, anxiety, and stress during COVID-19. J. Prim. Care Community Health
15:21501319241235588. doi: 10.1177/21501319241235588,
Feng Z., Diao Y., Ma H., Liu M., Long M., Zhao S., et al. (2022). Mobile phone addiction and depression among Chinese medical students: the mediating role of sleep quality and the moderating role of peer relationships. BMC Psychiatry
22:567. doi: 10.1186/s12888-022-04183-9,
Guo K., Zhang X., Bai S., Minhat H. S., Mohd Nazan A. I. M., Feng J., et al. (2021). Assessing social support impact on depression, anxiety, and stress among undergraduate students in Shaanxi province during the COVID-19 pandemic of China. PLoS One
16:e0253891. doi: 10.1371/journal.pone.0253891
Han B., Du G., Yang Y., Chen J., Sun G. (2023). Relationships between physical activity, body image, BMI, depression and anxiety in Chinese college students during the COVID-19 pandemic. BMC Public Health
23:24. doi: 10.1186/s12889-022-14917-9,
Hefner J., Eisenberg D. (2009). Social support and mental health among college students. Am. J. Orthopsychiatry
79, 491–499. doi: 10.1037/a0016918,
Hirshkowitz M., Whiton K., Albert S. M., Alessi C., Bruni O., DonCarlos L., et al. (2015). National Sleep Foundation's sleep time duration recommendations: methodology and results summary. Sleep Health
1, 40–43. doi: 10.1016/j.sleh.2014.12.010,
Kroenke K., Spitzer R. L., Williams J. B. W. (2001). The PHQ-9: validity of a brief depression severity measure. J. Gen. Intern. Med.
16, 606–613. doi: 10.1046/j.1525-1497.2001.016009606.x,
Li Y., Li G., Liu L., Wu H. (2020). Correlations between mobile phone addiction and anxiety, depression, impulsivity, and poor sleep quality among college students: a systematic review and meta-analysis. J. Behav. Addict.
9, 551–571. doi: 10.1556/2006.2020.00057,
Li W., Zhao Z., Chen D., Peng Y., Lu Z. (2022). Prevalence and associated factors of depression and anxiety symptoms among college students: a systematic review and meta-analysis. J. Child Psychol. Psychiatry
63, 1222–1230. doi: 10.1111/jcpp.13606,
Lipson S. K., Zhou S., Abelson S., Heinze J., Jirsa M., Morigney J., et al. (2022). Trends in college student mental health and help-seeking by race/ethnicity: findings from the national healthy minds study, 2013-2021. J. Affect. Disord.
306, 138–147. doi: 10.1016/j.jad.2022.03.038,
Luo J., Yang J., Dai T., Zhao J., Wu S., Zhou L., et al. (2025). Non-linear relationship between social jetlag and depressive symptoms among Chinese college students. Sci. Rep.
15:18317. doi: 10.1038/s41598-025-03371-3,
Meda N., Pardini S., Rigobello P., Visioli F., Novara C. (2023). Frequency and machine learning predictors of severe depressive symptoms and suicidal ideation among university students. Epidemiol. Psychiatr. Sci.
32:e42. doi: 10.1017/S2045796023000550,
Molnar C.
Interpretable Machine Learning: A Guide for Making Black Box Models Explainable. 2nd ed. (2022). Available online at: https://christophm.github.io/interpretable-ml-book/. (Accessed May 19, 2026).
Moons K. G. M., Damen J. A. A., Kaul T., Hooft L., Andaur Navarro C., Dhiman P., et al. (2025). PROBAST+AI: an updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods. BMJ
388:e082505. doi: 10.1136/bmj-2024-082505,
Paxton S. J., Neumark-Sztainer D., Hannan P. J., Eisenberg M. E. (2006). Body dissatisfaction prospectively predicts depressive mood and low self-esteem in adolescent girls and boys. J. Clin. Child Adolesc. Psychol.
35, 539–549. doi: 10.1207/s15374424jccp3504_5,
Pedregosa F., Varoquaux G., Gramfort A., Michel V., Thirion B., Grisel O., et al. (2011). Scikit-learn: machine learning in Python. J. Mach. Learn. Res.
12, 2825–2830. Available online at: https://www.jmlr.org/papers/v12/pedregosa11a.html
Rahman H. A., Kwicklis M., Ottom M., Amornsriwatanakul A., Abdul-Mumin K. H., Rosenberg M., et al. (2023). Machine learning-based prediction of mental well-being using health behavior data from university students. Bioengineering
10:575. doi: 10.3390/bioengineering10050575,
Riley R. D., Archer L., Snell K. I. E., Ensor J., Dhiman P., Martin G. P., et al. (2024). Evaluation of clinical prediction models (part 2): how to undertake an external validation study. BMJ
384:e074820. doi: 10.1136/bmj-2023-074820,
Ruihua L., Hassan N. C., Qiuxia Z., Sha O., Jingyi D. (2025). A systematic review on the impact of social support on college students' wellbeing and mental health. PLoS One
20:e0325212. doi: 10.1371/journal.pone.0325212,
Saito T., Rehmsmeier M. (2015). The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PLoS One
10:e0118432. doi: 10.1371/journal.pone.0118432,
Schaab B. L., Calvetti P. U., Hoffmann S., Diaz G. B., Rech M., Cazella S. C., et al. (2024). How do machine learning models perform in the detection of depression, anxiety, and stress among undergraduate students? A systematic review. Cad. Saude Publica
40:e00029323. doi: 10.1590/0102-311XEN029323,
Shin Y. B., Kim A. Y., Kim S., Shin M. S., Choi J., Lee K. L., et al. (2025). Development of prediction models for screening depression and anxiety using smartphone and wearable-based digital phenotyping: protocol for the smartphone and wearable assessment for real-time screening of depression and anxiety (SWARTS-DA) observational study in Korea. BMJ Open
15:e096773. doi: 10.1136/bmjopen-2024-096773,
Shvetcov A., Kupper J. F., Zheng W. Y., Slade A., Han J., Whitton A., et al. (2024). Passive sensing data predicts stress in university students: a supervised machine learning method for digital phenotyping. Front. Psych.
15:1422027. doi: 10.3389/fpsyt.2024.1422027,
Sohn S. Y., Rees P., Wildridge B., Kalk N. J., Carter B. (2019). Prevalence of problematic smartphone usage and associated mental health outcomes amongst children and young people: a systematic review, meta-analysis and GRADE of the evidence. BMC Psychiatry
19:356. doi: 10.1186/s12888-019-2350-x,
Spitzer R. L., Kroenke K., Williams J. B. W., Lowe B. (2006). A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch. Intern. Med.
166, 1092–1097. doi: 10.1001/archinte.166.10.1092,
Steyerberg E. W. (2019). Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating. 2nd Edn Cham: Springer.
Tornero-Costa R., Martinez-Millana A., Azzopardi-Muscat N., Lazeri L., Traver V., Novillo-Ortiz D. (2023). Methodological and quality flaws in the use of artificial intelligence in mental health research: systematic review. JMIR Ment Health.
10:e42045. doi: 10.2196/42045,
Van Calster B., McLernon D. J., van Smeden M., Wynants L., Steyerberg E. W., Topic Group ‘Evaluating diagnostic tests and prediction models’ of the STRATOS initiative (2019). Calibration: the Achilles heel of predictive analytics. BMC Med.
17:230. doi: 10.1186/s12916-019-1466-7
Vicary E., Kapadia D., Bee P., Bennion M., Brooks H. (2025). The impact of social support on university students living with mental illness: a systematic review and narrative synthesis. J. Ment. Health
34, 463–475. doi: 10.1080/09638237.2024.2408237,
Wang H., Guan Y., Du H., Dai P., Zhong J., Yu M., et al. (2025). Association of breakfast consumption frequency with depression and anxiety symptoms among school students: a cross-sectional study in eastern China. Nutrients
17:1271. doi: 10.3390/nu17071271,
Wittmann M., Dinich J., Merrow M., Roenneberg T. (2006). Social jetlag: misalignment of biological and social time. Chronobiol. Int.
23, 497–509. doi: 10.1080/07420520500545979,
World Health Organization (2020). WHO Guidelines on Physical Activity and Sedentary Behaviour. Geneva: World Health Organization.
Yin J., Tang X., Liu Z., Gong Y., Yang H., Zhang Y. (2025). Associations between both smartphone addiction and objectively measured smartphone use and sleep quality and duration among university students: cross-sectional study. JMIR Ment Health.
12:e77796. doi: 10.2196/77796,
Youden W. J. (1950). Index for rating diagnostic tests. Cancer
3, 32–35. doi: 10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3,
Zhai Y., Zhang Y., Chu Z., Geng B., Almaawali M., Fulmer R., et al. (2025). Machine learning predictive models to guide prevention and intervention allocation for anxiety and depressive disorders among college students. J. Couns. Dev.
103, 110–125. doi: 10.1002/jcad.12543
Zhang L., Zhao S., Yang Z., Zheng H., Lei M. (2024). An artificial intelligence tool to assess the risk of severe mental distress among college students in terms of demographics, eating habits, lifestyles, and sport habits: an externally validated study using machine learning. BMC Psychiatry
24:581. doi: 10.1186/s12888-024-06017-2,
Associated Data
Supplementary Materials
Data Availability Statement
The participant-level datasets are not publicly available because they contain sensitive health information and are subject to ethical and institutional restrictions. Requests for access to de-identified data should be directed to the corresponding author, Guopeng Hu (hugp@hqu.edu.cn). Access may be granted on reasonable request, subject to the relevant ethical and institutional approvals. The analysis code and locked model objects can be made available from the corresponding author on reasonable request, subject to institutional, ethical, and data-use restrictions.
Come citare questo studio
Mao K, He Y, Yin X, Lin L, Zheng Y, Hu G. (2026). Behavioral and psychosocial indicators for depression and anxiety risk stratification among college students: development and external validation of a machine-learning-assisted framework.. Frontiers in psychology. DOI: 10.3389/fpsyg.2026.1972318
Consulta la pubblicazione originale ↗