HomeWhy Challenges?All ChallengesCreate Your Own ChallengeContributorsForum
Sign in / Register

Results of the participating algorithms

This table presents the classification performances of the algorithms that participated in this challenge. TPF = true positive fraction, AUC = area under the receiver operating characteristic (ROC) curve, CI = 95% confidence interval estimated with bootstrapping. As three-class classification of AD, MCI and controls is evaluated, the accuracy for random guessing would be ~33%. The test data consisted of 354 T1w MRI scans from three centers. As reference standard the clinical diagnosis criteria were used. More information on the set-up this project can be found on the pages About and Evaluation. A manuscript discussing these results is in preparation.

This table is regularly updated with new submissions to the challenge. The table with results discussed at the MICCAI 2014 workshop can be found at the bottom of this page.

Note: the tables are sorted alphabetically by default. The order of algorithms can be changed by clicking on another column header, e.g. "Rank accuracy".

* Methods indicated by a star were submitted to this challenge after the deadline for the workshop.

** The authors of methods indicated by two stars were involved in the organization of the CADDementia challenge. Therefore, these methods are excluded from the official ranking.

AlgorithmRank
accuracy
Rank
accuracy**
Accuracy [CI] (%)TPFCN [CI] (%)TPFMCI [CI] (%)TPFAD [CI] (%)Rank
AUC
Rank
AUC**
AUCall [CI] (%)AUCCN [CI] (%)AUCMCI [CI] (%)DateDoc.
Soerensen-equal1.01.063.0
[57.9 - 67.5]
96.9
[92.9 - 99.2]
28.7
[21.3 - 37.4]
61.2
[51.6 - 69.8]
1.51.578.8
[75.6 - 82.0]
86.3
[81.8 - 89.3]
63.1
[56.6 - 68.3]
15/06/2014 |
Soerensen-optimized2.02.059.9
[54.8 - 64.7]
70.5
[62.8 - 77.8]
41.0
[33.3 - 50.0]
68.9
[59.6 - 77.2]
1.51.578.8
[75.5 - 82.1]
86.3
[81.9 - 89.3]
62.7
[56.8 - 68.4]
15/06/2014 |
Wachinger-enetNorm3.03.059.0
[54.0 - 63.6]
72.1
[63.4 - 79.2]
51.6
[43.5 - 61.3]
51.5
[41.5 - 61.2]
4.04.077.0
[73.6 - 80.3]
83.3
[78.5 - 87.0]
59.4
[52.9 - 65.5]
15/06/2014 |
Ledig-ALL4.05.057.9
[52.5 - 62.7]
89.1
[83.7 - 93.8]
41.0
[32.4 - 49.6]
38.8
[30.7 - 50.0]
5.05.076.7
[73.6 - 79.8]
86.6
[82.7 - 89.8]
59.7
[53.3 - 65.1]
15/06/2014 |
Moradi5.06.057.6
[52.3 - 62.4]
57.4
[48.7 - 66.1]
59.8
[51.3 - 68.1]
55.3
[46.7 - 65.2]
-----15/06/2014 |
Dolph-LassoTextureSAE*6.07.056.8
[51.7 - 61.9]
55.8
[46.8 - 64.2]
51.6
[42.5 - 61.0]
64.1
[53.0 - 73.3]
-----14/11/2016 |
Franke7.08.056.2
[50.8 - 61.3]
58.9
[50.4 - 67.5]
43.4
[34.8 - 51.7]
68.0
[58.8 - 77.1]
-----15/06/2014 |
Sensi8.59.555.1
[50.0 - 60.2]
71.3
[63.6 - 78.8]
40.2
[31.2 - 49.6]
52.4
[42.7 - 62.0]
11.011.073.8
[70.2 - 77.5]
81.7
[77.1 - 85.8]
55.0
[48.8 - 61.0]
15/06/2014 |
Ledig-CORT8.59.555.1
[49.7 - 59.9]
68.2
[60.5 - 76.0]
45.1
[35.3 - 53.4]
50.5
[41.2 - 60.5]
12.012.073.7
[69.9 - 77.2]
79.6
[75.0 - 84.2]
58.9
[52.9 - 64.9]
15/06/2014 |
Wachinger-step110.512.554.0
[48.9 - 59.0]
68.2
[60.2 - 75.4]
41.0
[31.9 - 50.9]
51.5
[42.2 - 61.1]
8.08.074.6
[70.8 - 78.1]
79.1
[73.5 - 83.1]
55.0
[48.5 - 61.4]
15/06/2014 |
Ledig-GRAD10.512.554.0
[48.9 - 59.3]
87.6
[81.7 - 92.6]
37.7
[29.3 - 47.5]
31.1
[22.4 - 40.4]
6.06.075.4
[72.4 - 78.6]
85.6
[81.5 - 88.9]
60.3
[53.9 - 66.5]
15/06/2014 |
Wachinger-step213.515.553.7
[47.5 - 58.8]
66.7
[58.1 - 74.1]
38.5
[30.1 - 48.1]
55.3
[45.5 - 65.0]
13.013.072.7
[68.9 - 76.4]
79.3
[74.0 - 83.5]
51.9
[45.3 - 58.7]
15/06/2014 |
Wachinger-step1Norm13.515.553.7
[48.6 - 58.8]
63.6
[54.9 - 71.9]
47.5
[38.4 - 56.6]
48.5
[39.6 - 59.1]
9.59.574.3
[70.5 - 77.9]
79.3
[74.1 - 83.5]
55.5
[48.5 - 61.6]
15/06/2014 |
Sarica13.515.553.7
[48.3 - 58.8]
65.9
[57.4 - 74.2]
39.3
[30.0 - 48.2]
55.3
[44.9 - 64.9]
-----15/06/2014 |
Abdulkadir13.515.553.7
[48.3 - 58.2]
45.7
[37.0 - 53.6]
65.6
[56.1 - 73.0]
49.5
[39.4 - 58.8]
3.03.077.7
[74.2 - 81.0]
85.6
[81.4 - 89.0]
59.9
[54.1 - 66.4]
15/06/2014 |
Ledig-MBL16.018.053.4
[47.7 - 57.9]
82.9
[76.0 - 88.7]
43.4
[35.1 - 52.9]
28.2
[20.2 - 37.4]
7.07.075.2
[72.0 - 78.1]
82.5
[77.8 - 86.0]
57.3
[50.9 - 63.6]
15/06/2014 |
Wachinger-man17.019.053.1
[47.7 - 57.9]
61.2
[53.5 - 69.6]
60.7
[51.7 - 70.0]
34.0
[25.7 - 44.7]
9.59.574.3
[70.9 - 77.9]
80.6
[75.7 - 84.9]
56.3
[49.7 - 63.0]
15/06/2014 |
Dolph-SAE*18.020.052.8
[47.5 - 58.2]
57.4
[48.4 - 65.8]
63.9
[54.3 - 72.3]
34.0
[25.3 - 43.3]
-----09/09/2015 |
Eskildsen-FACEADNI119.521.552.0
[46.9 - 57.1]
65.1
[56.6 - 73.1]
36.1
[28.1 - 45.5]
54.4
[44.6 - 63.6]
-----15/06/2014 |
Eskildsen-ADNI119.521.552.0
[46.6 - 56.8]
65.1
[56.9 - 73.2]
32.0
[24.1 - 40.9]
59.2
[49.5 - 68.3]
-----15/06/2014 |
Dolph-LASSO-SAE*21.023.551.4
[46.0 - 56.2]
39.5
[31.2 - 47.7]
54.9
[45.7 - 63.3]
62.1
[52.8 - 71.3]
-----27/05/2016 |
Eskildsen-Combined22.025.051.1
[45.5 - 56.2]
64.3
[56.2 - 72.3]
35.2
[27.1 - 44.3]
53.4
[43.0 - 62.9]
-----15/06/2014 |
Cardenas-Pena-sprg-fssvm*23.526.550.3
[45.2 - 55.9]
42.6
[33.9 - 52.0]
48.4
[39.7 - 58.1]
62.1
[51.7 - 70.9]
14.518.070.3
[66.6 - 74.7]
76.6
[71.7 - 81.3]
53.1
[47.2 - 60.1]
17/05/2017 |
Cardenas-Pena-sprg-fssvm*23.526.550.3
[45.2 - 55.9]
42.6
[33.9 - 52.0]
48.4
[39.7 - 58.1]
62.1
[51.7 - 70.9]
14.518.070.3
[66.6 - 74.7]
76.4
[71.4 - 81.1]
52.7
[46.8 - 59.6]
17/05/2017 |
Dolph25.028.049.7
[44.6 - 54.8]
84.5
[77.9 - 90.4]
23.0
[16.4 - 31.2]
37.9
[28.9 - 47.3]
19.024.063.0
[59.6 - 67.2]
66.2
[61.3 - 70.3]
55.4
[50.0 - 60.0]
15/06/2014 |
Wegmayr*27.030.049.2
[43.8 - 54.5]
48.1
[39.3 - 56.8]
54.9
[46.5 - 63.9]
43.7
[34.7 - 54.1]
-----08/08/2017 |
Dolph-SAEexpanded*27.030.049.2
[43.2 - 54.0]
85.3
[78.5 - 90.8]
40.2
[31.6 - 48.7]
14.6
[9.3 - 22.3]
-----28/09/2015 |
Routier-adni27.030.049.2
[43.5 - 54.2]
94.6
[89.8 - 97.7]
11.5
[6.2 - 17.7]
36.9
[27.4 - 46.5]
-----15/06/2014 |
Wegmayr-3T*30.033.048.3
[42.7 - 53.7]
55.8
[46.5 - 63.5]
45.1
[35.7 - 54.4]
42.7
[33.9 - 53.2]
-----14/08/2017 |
Routier-train30.033.048.3
[42.9 - 53.4]
48.1
[39.8 - 56.9]
21.3
[14.8 - 29.0]
80.6
[72.2 - 87.3]
-----15/06/2014 |
Eskildsen-FACEADNI230.033.048.3
[43.2 - 53.4]
48.8
[40.5 - 57.4]
42.6
[33.9 - 51.3]
54.4
[45.5 - 64.0]
-----15/06/2014 |
Wegmayr-3T-corrected*32.035.048.0
[42.7 - 53.1]
45.7
[37.5 - 54.3]
56.6
[46.2 - 64.6]
40.8
[31.6 - 50.9]
-----14/08/2017 |
Ledig-VOL33.536.547.7
[42.1 - 52.8]
66.7
[57.1 - 74.1]
36.9
[28.9 - 45.9]
36.9
[28.6 - 47.2]
16.021.068.4
[64.5 - 72.5]
75.7
[70.3 - 81.0]
50.1
[44.1 - 56.4]
15/06/2014 |
Eskildsen-ADNI233.536.547.7
[42.1 - 52.8]
59.7
[51.2 - 68.4]
38.5
[29.9 - 47.3]
43.7
[33.7 - 53.8]
-----15/06/2014 |
Amoroso35.040.046.9
[41.5 - 52.3]
67.4
[58.5 - 75.2]
42.6
[33.6 - 51.1]
26.2
[18.3 - 35.4]
17.022.067.2
[63.3 - 71.3]
73.4
[67.8 - 78.7]
56.0
[49.7 - 61.9]
15/06/2014 |
Tangaro36.041.046.6
[41.0 - 51.4]
68.2
[60.2 - 76.5]
37.7
[29.2 - 46.3]
30.1
[21.7 - 39.0]
18.023.067.1
[63.2 - 71.0]
73.1
[67.8 - 78.0]
52.6
[45.9 - 58.6]
15/06/2014 |
Dolph-LDA*37.042.042.4
[37.9 - 47.7]
59.7
[51.5 - 68.3]
45.1
[36.4 - 54.3]
17.5
[10.9 - 25.3]
-----09/09/2015 |
Alansary*38.043.040.4
[35.3 - 45.8]
41.9
[33.3 - 50.6]
31.1
[23.4 - 40.6]
49.5
[40.4 - 59.6]
20.025.056.5
[51.8 - 60.5]
56.9
[50.5 - 63.0]
55.2
[49.1 - 61.4]
25/09/2014 |
Cardenas-Pena39.044.039.0
[33.9 - 43.8]
50.4
[41.5 - 59.1]
28.7
[21.6 - 38.5]
36.9
[27.4 - 46.8]
21.026.055.9
[51.2 - 59.9]
57.8
[51.6 - 63.4]
50.0
[43.9 - 57.1]
15/06/2014 |
Smith40.045.032.2
[27.4 - 36.7]
48.1
[39.6 - 57.1]
20.5
[13.9 - 28.3]
26.2
[18.3 - 35.0]
22.027.050.4
[46.7 - 54.6]
54.1
[48.0 - 60.0]
50.6
[45.0 - 57.1]
15/06/2014 |
Dolph-SAEtexture*41.046.030.8
[25.4 - 35.3]
28.7
[21.5 - 37.4]
41.8
[32.3 - 50.4]
20.4
[13.5 - 29.2]
-----18/03/2016 |
Bron-original*,**-4.058.5
[52.8 - 63.3]
68.2
[60.0 - 76.1]
39.3
[31.5 - 49.2]
68.9
[60.2 - 77.8]
-14.072.1
[68.6 - 75.5]
77.5
[72.3 - 82.2]
54.4
[48.4 - 60.5]
21/10/2014 |
Bron-age-sex*,**-23.551.4
[46.0 - 56.5]
55.0
[46.1 - 63.1]
47.5
[39.0 - 57.0]
51.5
[41.8 - 61.5]
-18.070.3
[66.6 - 73.9]
79.2
[74.4 - 83.2]
46.8
[40.3 - 52.9]
21/10/2014 |
Bron-age-sex-op*,**-39.047.2
[41.8 - 52.0]
93.8
[88.8 - 97.1]
4.9
[1.8 - 10.5]
38.8
[30.3 - 49.1]
-20.069.9
[66.3 - 73.4]
79.2
[74.4 - 83.2]
45.1
[38.7 - 51.2]
21/10/2014 |
Bron-age-sex-icv*,**-11.054.8
[49.2 - 59.9]
55.8
[47.3 - 64.7]
48.4
[39.5 - 57.5]
61.2
[51.1 - 70.2]
-15.071.3
[67.6 - 75.1]
78.6
[73.6 - 83.0]
50.3
[43.6 - 56.4]
21/10/2014 |
Bron-age-sex-icv-op*,**-38.047.5
[42.4 - 52.5]
89.9
[84.2 - 94.4]
6.6
[3.1 - 12.5]
42.7
[33.7 - 52.4]
-16.071.0
[67.4 - 74.7]
78.6
[73.6 - 83.0]
49.1
[42.3 - 55.4]
21/10/2014 |

 

Original results table presented on 18 September 2014 at the MICCAI workshop (Bron et al., 2015).

AlgorithmRank
accuracy
Accuracy [CI] (%)TPFCN [CI] (%)TPFMCI [CI] (%)TPFAD [CI] (%)Rank
AUC
AUCall [CI] (%)AUCCN [CI] (%)AUCMCI [CI] (%)AUCAD [CI] (%)DateDocumentation
Soerensen-equal1.063.0
[57.9 - 67.5]
96.9
[92.9 - 99.2]
28.7
[21.3 - 37.4]
61.2
[51.6 - 69.8]
1.578.8
[75.6 - 82.0]
86.3
[81.8 - 89.3]
63.1
[56.6 - 68.3]
87.5
[83.4 - 91.1]
15/06/2014Paper | Wiki | Pres.
Soerensen-optimized2.059.9
[54.8 - 64.7]
70.5
[62.8 - 77.8]
41.0
[33.3 - 50.0]
68.9
[59.6 - 77.2]
1.578.8
[75.5 - 82.1]
86.3
[81.9 - 89.3]
62.7
[56.8 - 68.4]
86.7
[82.3 - 90.4]
15/06/2014Paper | Wiki | Pres.
Wachinger-enetNorm3.059.0
[54.0 - 63.6]
72.1
[63.4 - 79.2]
51.6
[43.5 - 61.3]
51.5
[41.5 - 61.2]
4.077.0
[73.6 - 80.3]
83.3
[78.5 - 87.0]
59.4
[52.9 - 65.5]
88.2
[83.8 - 91.4]
15/06/2014Paper | Wiki | Pres.
Ledig-ALL4.057.9
[52.5 - 62.7]
89.1
[83.7 - 93.8]
41.0
[32.4 - 49.6]
38.8
[30.7 - 50.0]
5.076.7
[73.6 - 79.8]
86.6
[82.7 - 89.8]
59.7
[53.3 - 65.1]
84.9
[79.7 - 88.7]
15/06/2014Paper | Wiki | Pres.
Moradi5.057.6
[52.3 - 62.4]
57.4
[48.7 - 66.1]
59.8
[51.3 - 68.1]
55.3
[46.7 - 65.2]
-----15/06/2014Paper | Wiki | Pres.
Franke6.056.2
[50.8 - 61.3]
58.9
[50.4 - 67.5]
43.4
[34.8 - 51.7]
68.0
[58.8 - 77.1]
-----15/06/2014Paper | Wiki | Pres.
Sensi7.555.1
[50.0 - 60.2]
71.3
[63.6 - 78.8]
40.2
[31.2 - 49.6]
52.4
[42.7 - 62.0]
11.073.8
[70.2 - 77.5]
81.7
[77.1 - 85.8]
55.0
[48.8 - 61.0]
83.9
[78.8 - 87.7]
15/06/2014Paper | Wiki | Pres.
Ledig-CORT7.555.1
[49.7 - 59.9]
68.2
[60.5 - 76.0]
45.1
[35.3 - 53.4]
50.5
[41.2 - 60.5]
12.073.7
[69.9 - 77.2]
79.6
[75.0 - 84.2]
58.9
[52.9 - 64.9]
82.4
[76.7 - 87.3]
15/06/2014Paper | Wiki | Pres.
Wachinger-step19.554.0
[48.9 - 59.0]
68.2
[60.2 - 75.4]
41.0
[31.9 - 50.9]
51.5
[42.2 - 61.1]
8.074.6
[70.8 - 78.1]
79.1
[73.5 - 83.1]
55.0
[48.5 - 61.4]
89.2
[85.3 - 92.3]
15/06/2014Paper | Wiki | Pres.
Ledig-GRAD9.554.0
[48.9 - 59.3]
87.6
[81.7 - 92.6]
37.7
[29.3 - 47.5]
31.1
[22.4 - 40.4]
6.075.4
[72.4 - 78.6]
85.6
[81.5 - 88.9]
60.3
[53.9 - 66.5]
81.7
[76.3 - 86.1]
15/06/2014Paper | Wiki | Pres.
Wachinger-step212.553.7
[47.5 - 58.8]
66.7
[58.1 - 74.1]
38.5
[30.1 - 48.1]
55.3
[45.5 - 65.0]
13.072.7
[68.9 - 76.4]
79.3
[74.0 - 83.5]
51.9
[45.3 - 58.7]
86.5
[81.9 - 90.3]
15/06/2014Paper | Wiki | Pres.
Wachinger-step1Norm12.553.7
[48.6 - 58.8]
63.6
[54.9 - 71.9]
47.5
[38.4 - 56.6]
48.5
[39.6 - 59.1]
9.574.3
[70.5 - 77.9]
79.3
[74.1 - 83.5]
55.5
[48.5 - 61.6]
87.7
[83.7 - 91.1]
15/06/2014Paper | Wiki | Pres.
Sarica12.553.7
[48.3 - 58.8]
65.9
[57.4 - 74.2]
39.3
[30.0 - 48.2]
55.3
[44.9 - 64.9]
-----15/06/2014Paper | Wiki | Pres.
Abdulkadir12.553.7
[48.3 - 58.2]
45.7
[37.0 - 53.6]
65.6
[56.1 - 73.0]
49.5
[39.4 - 58.8]
3.077.7
[74.2 - 81.0]
85.6
[81.4 - 89.0]
59.9
[54.1 - 66.4]
86.7
[82.3 - 90.3]
15/06/2014Paper | Wiki | Pres.
Ledig-MBL15.053.4
[47.7 - 57.9]
82.9
[76.0 - 88.7]
43.4
[35.1 - 52.9]
28.2
[20.2 - 37.4]
7.075.2
[72.0 - 78.1]
82.5
[77.8 - 86.0]
57.3
[50.9 - 63.6]
86.4
[81.4 - 89.9]
15/06/2014Paper | Wiki | Pres.
Wachinger-man16.053.1
[47.7 - 57.9]
61.2
[53.5 - 69.6]
60.7
[51.7 - 70.0]
34.0
[25.7 - 44.7]
9.574.3
[70.9 - 77.9]
80.6
[75.7 - 84.9]
56.3
[49.7 - 63.0]
86.1
[81.7 - 90.0]
15/06/2014Paper | Wiki | Pres.
Eskildsen-FACEADNI117.552.0
[46.9 - 57.1]
65.1
[56.6 - 73.1]
36.1
[28.1 - 45.5]
54.4
[44.6 - 63.6]
-----15/06/2014Paper | Wiki | Pres.
Eskildsen-ADNI117.552.0
[46.6 - 56.8]
65.1
[56.9 - 73.2]
32.0
[24.1 - 40.9]
59.2
[49.5 - 68.3]
-----15/06/2014Paper | Wiki | Pres.
Eskildsen-Combined19.051.1
[45.5 - 56.2]
64.3
[56.2 - 72.3]
35.2
[27.1 - 44.3]
53.4
[43.0 - 62.9]
-----15/06/2014Paper | Wiki | Pres.
Dolph20.049.7
[44.6 - 54.8]
84.5
[77.9 - 90.4]
23.0
[16.4 - 31.2]
37.9
[28.9 - 47.3]
17.063.0
[59.6 - 67.2]
66.2
[61.3 - 70.3]
55.4
[50.0 - 60.0]
65.8
[60.6 - 71.3]
15/06/2014Paper | Wiki | Pres.
Routier-adni21.049.2
[43.5 - 54.2]
94.6
[89.8 - 97.7]
11.5
[6.2 - 17.7]
36.9
[27.4 - 46.5]
-----15/06/2014Paper | Wiki | Pres.
Routier-train22.548.3
[42.9 - 53.4]
48.1
[39.8 - 56.9]
21.3
[14.8 - 29.0]
80.6
[72.2 - 87.3]
-----15/06/2014Paper | Wiki | Pres.
Eskildsen-FACEADNI222.548.3
[43.2 - 53.4]
48.8
[40.5 - 57.4]
42.6
[33.9 - 51.3]
54.4
[45.5 - 64.0]
-----15/06/2014Paper | Wiki | Pres.
Ledig-VOL24.547.7
[42.1 - 52.8]
66.7
[57.1 - 74.1]
36.9
[28.9 - 45.9]
36.9
[28.6 - 47.2]
14.068.4
[64.5 - 72.5]
75.7
[70.3 - 81.0]
50.1
[44.1 - 56.4]
79.0
[73.3 - 83.5]
15/06/2014Paper | Wiki | Pres.
Eskildsen-ADNI224.547.7
[42.1 - 52.8]
59.7
[51.2 - 68.4]
38.5
[29.9 - 47.3]
43.7
[33.7 - 53.8]
-----15/06/2014Paper | Wiki | Pres.
Amoroso26.046.9
[41.5 - 52.3]
67.4
[58.5 - 75.2]
42.6
[33.6 - 51.1]
26.2
[18.3 - 35.4]
15.067.2
[63.3 - 71.3]
73.4
[67.8 - 78.7]
56.0
[49.7 - 61.9]
72.3
[66.2 - 77.5]
15/06/2014Paper | Wiki | Pres.
Tangaro27.046.6
[41.0 - 51.4]
68.2
[60.2 - 76.5]
37.7
[29.2 - 46.3]
30.1
[21.7 - 39.0]
16.067.1
[63.2 - 71.0]
73.1
[67.8 - 78.0]
52.6
[45.9 - 58.6]
75.8
[70.2 - 80.6]
15/06/2014Paper | Wiki | Pres.
Cardenas-Pena28.039.0
[33.9 - 43.8]
50.4
[41.5 - 59.1]
28.7
[21.6 - 38.5]
36.9
[27.4 - 46.8]
18.055.9
[51.2 - 59.9]
57.8
[51.6 - 63.4]
50.0
[43.9 - 57.1]
59.8
[53.5 - 65.7]
15/06/2014Paper | Wiki | Pres.
Smith29.032.2
[27.4 - 36.7]
48.1
[39.6 - 57.1]
20.5
[13.9 - 28.3]
26.2
[18.3 - 35.0]
19.050.4
[46.7 - 54.6]
54.1
[48.0 - 60.0]
50.6
[45.0 - 57.1]
46.6
[40.0 - 53.6]
15/06/2014Paper | Wiki | Pres.


Consortium for Open Medical Image Computing © 2012-