Results of the participating algorithms¶

This table presents the classification performances of the algorithms that participated in this challenge. TPF = true positive fraction, AUC = area under the receiver operating characteristic (ROC) curve, CI = 95% confidence interval estimated with bootstrapping. As three-class classification of AD, MCI and controls is evaluated, the accuracy for random guessing would be ~33%. The test data consisted of 354 T1w MRI scans from three centers. As reference standard the clinical diagnosis criteria were used. More information on the set-up this project can be found on the pages About and Evaluation. A manuscript discussing these results is in preparation.

This table is regularly updated with new submissions to the challenge. The table with results discussed at the MICCAI 2014 workshop can be found at the bottom of this page.

Note: the tables are sorted alphabetically by default. The order of algorithms can be changed by clicking on another column header, e.g. "Rank accuracy".

* Methods indicated by a star were submitted to this challenge after the deadline for the workshop.

** The authors of methods indicated by two stars were involved in the organization of the CADDementia challenge. Therefore, these methods are excluded from the official ranking.

Algorithm	Rank accuracy	Rank accuracy**	Accuracy [CI] (%)	TPFCN [CI] (%)	TPFMCI [CI] (%)	TPFAD [CI] (%)	Rank AUC	Rank AUC**	AUCall [CI] (%)	AUCCN [CI] (%)	AUCMCI [CI] (%)	Date	Doc.
Soerensen-equal	1.0	1.0	63.0 [57.9 - 67.5]	96.9 [92.9 - 99.2]	28.7 [21.3 - 37.4]	61.2 [51.6 - 69.8]	1.5	1.5	78.8 [75.6 - 82.0]	86.3 [81.8 - 89.3]	63.1 [56.6 - 68.3]	15/06/2014	|
Soerensen-optimized	2.0	2.0	59.9 [54.8 - 64.7]	70.5 [62.8 - 77.8]	41.0 [33.3 - 50.0]	68.9 [59.6 - 77.2]	1.5	1.5	78.8 [75.5 - 82.1]	86.3 [81.9 - 89.3]	62.7 [56.8 - 68.4]	15/06/2014	|
Wachinger-enetNorm	3.0	3.0	59.0 [54.0 - 63.6]	72.1 [63.4 - 79.2]	51.6 [43.5 - 61.3]	51.5 [41.5 - 61.2]	4.0	4.0	77.0 [73.6 - 80.3]	83.3 [78.5 - 87.0]	59.4 [52.9 - 65.5]	15/06/2014	|
Ledig-ALL	4.0	5.0	57.9 [52.5 - 62.7]	89.1 [83.7 - 93.8]	41.0 [32.4 - 49.6]	38.8 [30.7 - 50.0]	5.0	5.0	76.7 [73.6 - 79.8]	86.6 [82.7 - 89.8]	59.7 [53.3 - 65.1]	15/06/2014	|
Moradi	5.0	6.0	57.6 [52.3 - 62.4]	57.4 [48.7 - 66.1]	59.8 [51.3 - 68.1]	55.3 [46.7 - 65.2]	-	-	-	-	-	15/06/2014	|
Dolph-LassoTextureSAE*	6.0	7.0	56.8 [51.7 - 61.9]	55.8 [46.8 - 64.2]	51.6 [42.5 - 61.0]	64.1 [53.0 - 73.3]	-	-	-	-	-	14/11/2016	|
Franke	7.0	8.0	56.2 [50.8 - 61.3]	58.9 [50.4 - 67.5]	43.4 [34.8 - 51.7]	68.0 [58.8 - 77.1]	-	-	-	-	-	15/06/2014	|
Sensi	8.5	9.5	55.1 [50.0 - 60.2]	71.3 [63.6 - 78.8]	40.2 [31.2 - 49.6]	52.4 [42.7 - 62.0]	11.0	11.0	73.8 [70.2 - 77.5]	81.7 [77.1 - 85.8]	55.0 [48.8 - 61.0]	15/06/2014	|
Ledig-CORT	8.5	9.5	55.1 [49.7 - 59.9]	68.2 [60.5 - 76.0]	45.1 [35.3 - 53.4]	50.5 [41.2 - 60.5]	12.0	12.0	73.7 [69.9 - 77.2]	79.6 [75.0 - 84.2]	58.9 [52.9 - 64.9]	15/06/2014	|
Wachinger-step1	10.5	12.5	54.0 [48.9 - 59.0]	68.2 [60.2 - 75.4]	41.0 [31.9 - 50.9]	51.5 [42.2 - 61.1]	8.0	8.0	74.6 [70.8 - 78.1]	79.1 [73.5 - 83.1]	55.0 [48.5 - 61.4]	15/06/2014	|
Ledig-GRAD	10.5	12.5	54.0 [48.9 - 59.3]	87.6 [81.7 - 92.6]	37.7 [29.3 - 47.5]	31.1 [22.4 - 40.4]	6.0	6.0	75.4 [72.4 - 78.6]	85.6 [81.5 - 88.9]	60.3 [53.9 - 66.5]	15/06/2014	|
Wachinger-step2	13.5	15.5	53.7 [47.5 - 58.8]	66.7 [58.1 - 74.1]	38.5 [30.1 - 48.1]	55.3 [45.5 - 65.0]	13.0	13.0	72.7 [68.9 - 76.4]	79.3 [74.0 - 83.5]	51.9 [45.3 - 58.7]	15/06/2014	|
Wachinger-step1Norm	13.5	15.5	53.7 [48.6 - 58.8]	63.6 [54.9 - 71.9]	47.5 [38.4 - 56.6]	48.5 [39.6 - 59.1]	9.5	9.5	74.3 [70.5 - 77.9]	79.3 [74.1 - 83.5]	55.5 [48.5 - 61.6]	15/06/2014	|
Sarica	13.5	15.5	53.7 [48.3 - 58.8]	65.9 [57.4 - 74.2]	39.3 [30.0 - 48.2]	55.3 [44.9 - 64.9]	-	-	-	-	-	15/06/2014	|
Abdulkadir	13.5	15.5	53.7 [48.3 - 58.2]	45.7 [37.0 - 53.6]	65.6 [56.1 - 73.0]	49.5 [39.4 - 58.8]	3.0	3.0	77.7 [74.2 - 81.0]	85.6 [81.4 - 89.0]	59.9 [54.1 - 66.4]	15/06/2014	|
Ledig-MBL	16.0	18.0	53.4 [47.7 - 57.9]	82.9 [76.0 - 88.7]	43.4 [35.1 - 52.9]	28.2 [20.2 - 37.4]	7.0	7.0	75.2 [72.0 - 78.1]	82.5 [77.8 - 86.0]	57.3 [50.9 - 63.6]	15/06/2014	|
Wachinger-man	17.0	19.0	53.1 [47.7 - 57.9]	61.2 [53.5 - 69.6]	60.7 [51.7 - 70.0]	34.0 [25.7 - 44.7]	9.5	9.5	74.3 [70.9 - 77.9]	80.6 [75.7 - 84.9]	56.3 [49.7 - 63.0]	15/06/2014	|
Dolph-SAE*	18.0	20.0	52.8 [47.5 - 58.2]	57.4 [48.4 - 65.8]	63.9 [54.3 - 72.3]	34.0 [25.3 - 43.3]	-	-	-	-	-	09/09/2015	|
Folego-ADNet-DA*	19.0	21.0	52.3 [46.6 - 57.1]	68.2 [60.0 - 76.6]	37.7 [28.9 - 46.6]	49.5 [40.0 - 58.7]	14.0	17.0	70.9 [66.9 - 74.8]	72.8 [67.2 - 78.0]	60.5 [54.9 - 66.1]	13/11/2017	|
Eskildsen-FACEADNI1	20.5	22.5	52.0 [46.9 - 57.1]	65.1 [56.6 - 73.1]	36.1 [28.1 - 45.5]	54.4 [44.6 - 63.6]	-	-	-	-	-	15/06/2014	|
Eskildsen-ADNI1	20.5	22.5	52.0 [46.6 - 56.8]	65.1 [56.9 - 73.2]	32.0 [24.1 - 40.9]	59.2 [49.5 - 68.3]	-	-	-	-	-	15/06/2014	|
Folego-ADNet*	22.5	25.0	51.4 [45.5 - 56.2]	77.5 [68.7 - 83.7]	27.9 [20.3 - 36.1]	46.6 [36.5 - 56.2]	17.0	22.0	68.5 [64.2 - 72.9]	70.5 [64.6 - 75.9]	61.2 [55.4 - 67.7]	04/05/2017	|
Dolph-LASSO-SAE*	22.5	25.0	51.4 [46.0 - 56.2]	39.5 [31.2 - 47.7]	54.9 [45.7 - 63.3]	62.1 [52.8 - 71.3]	-	-	-	-	-	27/05/2016	|
Eskildsen-Combined	24.0	27.0	51.1 [45.5 - 56.2]	64.3 [56.2 - 72.3]	35.2 [27.1 - 44.3]	53.4 [43.0 - 62.9]	-	-	-	-	-	15/06/2014	|
Cardenas-Pena-sprg-fssvm*	25.5	28.5	50.3 [45.2 - 55.9]	42.6 [33.9 - 52.0]	48.4 [39.7 - 58.1]	62.1 [51.7 - 70.9]	15.5	19.0	70.3 [66.6 - 74.7]	76.6 [71.7 - 81.3]	53.1 [47.2 - 60.1]	17/05/2017	|
Cardenas-Pena-sprg-fssvm*	25.5	28.5	50.3 [45.2 - 55.9]	42.6 [33.9 - 52.0]	48.4 [39.7 - 58.1]	62.1 [51.7 - 70.9]	15.5	19.0	70.3 [66.6 - 74.7]	76.4 [71.4 - 81.1]	52.7 [46.8 - 59.6]	17/05/2017	|
Dolph	27.0	30.0	49.7 [44.6 - 54.8]	84.5 [77.9 - 90.4]	23.0 [16.4 - 31.2]	37.9 [28.9 - 47.3]	21.0	26.0	63.0 [59.6 - 67.2]	66.2 [61.3 - 70.3]	55.4 [50.0 - 60.0]	15/06/2014	|
Wegmayr*	29.0	32.0	49.2 [43.8 - 54.5]	48.1 [39.3 - 56.8]	54.9 [46.5 - 63.9]	43.7 [34.7 - 54.1]	-	-	-	-	-	08/08/2017	|
Dolph-SAEexpanded*	29.0	32.0	49.2 [43.2 - 54.0]	85.3 [78.5 - 90.8]	40.2 [31.6 - 48.7]	14.6 [9.3 - 22.3]	-	-	-	-	-	28/09/2015	|
Routier-adni	29.0	32.0	49.2 [43.5 - 54.2]	94.6 [89.8 - 97.7]	11.5 [6.2 - 17.7]	36.9 [27.4 - 46.5]	-	-	-	-	-	15/06/2014	|
Wegmayr-3T*	32.0	35.0	48.3 [42.7 - 53.7]	55.8 [46.5 - 63.5]	45.1 [35.7 - 54.4]	42.7 [33.9 - 53.2]	-	-	-	-	-	14/08/2017	|
Routier-train	32.0	35.0	48.3 [42.9 - 53.4]	48.1 [39.8 - 56.9]	21.3 [14.8 - 29.0]	80.6 [72.2 - 87.3]	-	-	-	-	-	15/06/2014	|
Eskildsen-FACEADNI2	32.0	35.0	48.3 [43.2 - 53.4]	48.8 [40.5 - 57.4]	42.6 [33.9 - 51.3]	54.4 [45.5 - 64.0]	-	-	-	-	-	15/06/2014	|
Wegmayr-3T-corrected*	34.0	37.0	48.0 [42.7 - 53.1]	45.7 [37.5 - 54.3]	56.6 [46.2 - 64.6]	40.8 [31.6 - 50.9]	-	-	-	-	-	14/08/2017	|
Ledig-VOL	35.5	38.5	47.7 [42.1 - 52.8]	66.7 [57.1 - 74.1]	36.9 [28.9 - 45.9]	36.9 [28.6 - 47.2]	18.0	23.0	68.4 [64.5 - 72.5]	75.7 [70.3 - 81.0]	50.1 [44.1 - 56.4]	15/06/2014	|
Eskildsen-ADNI2	35.5	38.5	47.7 [42.1 - 52.8]	59.7 [51.2 - 68.4]	38.5 [29.9 - 47.3]	43.7 [33.7 - 53.8]	-	-	-	-	-	15/06/2014	|
Amoroso	37.0	42.0	46.9 [41.5 - 52.3]	67.4 [58.5 - 75.2]	42.6 [33.6 - 51.1]	26.2 [18.3 - 35.4]	19.0	24.0	67.2 [63.3 - 71.3]	73.4 [67.8 - 78.7]	56.0 [49.7 - 61.9]	15/06/2014	|
Tangaro	38.0	43.0	46.6 [41.0 - 51.4]	68.2 [60.2 - 76.5]	37.7 [29.2 - 46.3]	30.1 [21.7 - 39.0]	20.0	25.0	67.1 [63.2 - 71.0]	73.1 [67.8 - 78.0]	52.6 [45.9 - 58.6]	15/06/2014	|
Dolph-LDA*	39.0	44.0	42.4 [37.9 - 47.7]	59.7 [51.5 - 68.3]	45.1 [36.4 - 54.3]	17.5 [10.9 - 25.3]	-	-	-	-	-	09/09/2015	|
Alansary*	40.0	45.0	40.4 [35.3 - 45.8]	41.9 [33.3 - 50.6]	31.1 [23.4 - 40.6]	49.5 [40.4 - 59.6]	22.0	27.0	56.5 [51.8 - 60.5]	56.9 [50.5 - 63.0]	55.2 [49.1 - 61.4]	25/09/2014	|
Cardenas-Pena	41.0	46.0	39.0 [33.9 - 43.8]	50.4 [41.5 - 59.1]	28.7 [21.6 - 38.5]	36.9 [27.4 - 46.8]	23.0	28.0	55.9 [51.2 - 59.9]	57.8 [51.6 - 63.4]	50.0 [43.9 - 57.1]	15/06/2014	|
Smith	42.0	47.0	32.2 [27.4 - 36.7]	48.1 [39.6 - 57.1]	20.5 [13.9 - 28.3]	26.2 [18.3 - 35.0]	24.0	29.0	50.4 [46.7 - 54.6]	54.1 [48.0 - 60.0]	50.6 [45.0 - 57.1]	15/06/2014	|
Dolph-SAEtexture*	43.0	48.0	30.8 [25.4 - 35.3]	28.7 [21.5 - 37.4]	41.8 [32.3 - 50.4]	20.4 [13.5 - 29.2]	-	-	-	-	-	18/03/2016	|
Bron-original*,**	-	4.0	58.5 [52.8 - 63.3]	68.2 [60.0 - 76.1]	39.3 [31.5 - 49.2]	68.9 [60.2 - 77.8]	-	14.0	72.1 [68.6 - 75.5]	77.5 [72.3 - 82.2]	54.4 [48.4 - 60.5]	21/10/2014	|
Bron-age-sex*,**	-	25.0	51.4 [46.0 - 56.5]	55.0 [46.1 - 63.1]	47.5 [39.0 - 57.0]	51.5 [41.8 - 61.5]	-	19.0	70.3 [66.6 - 73.9]	79.2 [74.4 - 83.2]	46.8 [40.3 - 52.9]	21/10/2014	|
Bron-age-sex-op*,**	-	41.0	47.2 [41.8 - 52.0]	93.8 [88.8 - 97.1]	4.9 [1.8 - 10.5]	38.8 [30.3 - 49.1]	-	21.0	69.9 [66.3 - 73.4]	79.2 [74.4 - 83.2]	45.1 [38.7 - 51.2]	21/10/2014	|
Bron-age-sex-icv*,**	-	11.0	54.8 [49.2 - 59.9]	55.8 [47.3 - 64.7]	48.4 [39.5 - 57.5]	61.2 [51.1 - 70.2]	-	15.0	71.3 [67.6 - 75.1]	78.6 [73.6 - 83.0]	50.3 [43.6 - 56.4]	21/10/2014	|
Bron-age-sex-icv-op*,**	-	40.0	47.5 [42.4 - 52.5]	89.9 [84.2 - 94.4]	6.6 [3.1 - 12.5]	42.7 [33.7 - 52.4]	-	16.0	71.0 [67.4 - 74.7]	78.6 [73.6 - 83.0]	49.1 [42.3 - 55.4]	21/10/2014	|

Original results table presented on 18 September 2014 at the MICCAI workshop (Bron et al., 2015).