The goal is to develop clinically actionable biomarkers, that should generalize to ‘unseen’ data, so we have marked 30% of clinical and treatment outcome data as REPLICATION. These are blinded for prospective validation and replication purposes. Interested researchers can share () their diagnostic or treatment-outcome predictions on these REPLICATION data with us, so we can perform a ‘blinded out-of-sample’ validation for them, and post the results on this page, so that reviewers for journals can also consult this independent validation of their algorithms. Conversely, reviewers or editors faced with ‘too good to be true’ claims, can refer researchers to this resource, to perform validations and share them with us for verification and publication. We hope this will accelerate the discovery and validation of clinically actionable biomarkers that we hope will soon benefit patients and improve psychiatric and neurological care in the clinic.
| First author | Year | Original Reference | Primary Outcome | Diagnostic/Prognostic | Replicated? | PPV | nPPV | NPV | nNPV | R2 | t | F | p | ES (Cohen's d; -=opposite direction) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Krepel et al. | 2018 | Arns et al. 2012 Brain Stimul. | High fronto-central theta power | prognostic | no (X) | 0.753 | 0.388 | 0.173 | ||||||
| Low individual alpha peak frequency | prognostic | no (X) | 0.448 | 0.054 | 0.19 | |||||||||
| Larger P300 | prognostic | no (X) | 0.008 | 0.929 | 0.019 | |||||||||
| Krepel et al. | 2019 | Krepel et al. 2019 Psych Med. | BDI Anhedonia scale | prognostic | yes (V) | 60.7% | 80% | 8.516 | 0.005 | 0.76 | ||||
| Neo-NFFI Openness | prognostic | no (X) | 1.49 | 0.227 | -0.33 | |||||||||
| Bailey et al. | 2020 | Bailey et al. 2019 J Affect Disord | EEG theta connectivity | prognostic | no (X) | 1.638 | 0.103 | 0.2524 | ||||||
| Alpha power | prognostic | no (X) | 0.851 | 0.357 | ||||||||||
| Roelofs et al. | 2020 | Corlier et al. 2019 Brain Stimul. | Individal alpha peak frequency | prognostic | yes (V) | 0.162/0.026 | 0.022 | |||||||
| Nouminous (Dilip Rajeswari) | 2022 | TMS remission | prognostic | no (X) | 50% | 91.7% | 41% | |||||||
| Van Strien | 2022 | Prediction DeprNet | diagnostic | yes (V) | 67% | 126% | 61% | 113.8% | ||||||
| Van Strien | 2022 | Prediction EEGNet | diagnostic | yes (V) | 75% | 140.5% | 69% | 128.5% | ||||||
| Van Strien | 2022 | Prediction Logistic Regression | diagnostic | no (X) | 49% | 91.1% | 44% | 82.3% | ||||||
| Alekseichuk, University of Minnesota | 2023 | Prediction rTMS over prefrontal cortex | prognostic | no (X) | 71% | 99.3 | 28% | 22.2% |