Attention-Enabled Ensemble Deep Learning Models and Their Validation for Depression Detection: A Domain Adoption Paradigm

Depression is increasingly prevalent, leading to higher suicide risk. Depression detection and sentimental analysis of text inputs in are challenging. Solo deep learning (SDL) and ensemble deep learning (EDL) models are not robust enough. Recently, have been introduced in SDL. We hypothesize that EDL (EDL) architectures are superior compared to SDL (SDL) or SDL models. We designed EDL-based architectures with to build eleven kinds of SDL model and five kinds of EDL model on four domain-specific datasets. We scientifically validated our models by comparing "seen" and "unseen" paradigms (SUP). We benchmarked our results against the SemEval (2016) sentimental dataset and established reliability tests. The mean increase in accuracy for EDL over their corresponding SDL components was 4.49%. Regarding the effect of attention block, the increase in the mean accuracy (AUC) of SDL over SDL was 2.58% (1.73%), and the increase in the mean accuracy (AUC) of EDL over EDL was 2.76% (2.80%). When comparing EDL vs. SDL for non-attention and attention, the mean EDL was greater than SDL by 4.82% (3.71%), and the mean EDL was greater than SDL by 5.06% (4.81%). For the benchmarking dataset (SemEval), the best-performing EDL model (ALBERT+BERT-BiLSTM) was superior to the best SDL (BERT-BiLSTM) model by 3.86%. Our scientific validation and robust design showed a difference of only 2.7% in SUP, thereby meeting the regulatory constraints. We validated all our hypotheses and further demonstrated that EDL is a very effective and generalized method for detecting symptoms of depression in cross-domain settings.