News

March 29th, 2017
The CASMI 2016 Cat 2+3 paper is out!

Jan 20th, 2017
Organisation of CASMI 2017 is underway, stay tuned!

Dec 4th, 2016
The MS1 peak lists for Category 2+3 have been added for completeness.

May 6th, 2016
The winners and full results are available.

April 25th, 2016
The solutions are public now.

April 18th, 2016
The contest is closed now, the results are fantastic and will be opened soon!

April 9th, 2016
All teams who submit before the deadline April 11th will be allowed to update the submission until Friday 15th.

February 12th, 2016
New categories 2 and 3 and data for automatic methods released. 10 new challenges in category 1.

January 25th, 2016
E. Schymanski and S. Neumann joined the organising team, additional contest data coming soon.

January 11th, 2016
New CASMI 2016 raw data files are available.


Extra results in Category 1

Details per Challenge and Participant. See legend at bottom for more details

The details table is also available as CSV download. The InChIKey block1 filtered submissions used in the automatic evaluation are available for download, as well as the original submissions.

participant challenge rank rankmax tc bc wc ec rrp p wbc wwc wec wrrp
avaniya001-challenge-010 challenge-010 1.0 1 2 0 1 1 1.00 0.51 0.00 0.49 0.00 1.00
avaniya001-challenge-011 challenge-011 1.0 1 13 0 12 1 1.00 0.08 0.00 0.92 0.00 1.00
avaniya001-challenge-012 challenge-012 2.0 2 24 1 22 1 0.96 0.04 0.05 0.91 0.00 0.95
avaniya001-challenge-013 challenge-013 40.0 40 108 39 68 1 0.64 0.01 0.38 0.61 0.00 0.62
avaniya001-challenge-014 challenge-014 67.0 67 388 66 321 1 0.83 0.00 0.18 0.82 0.00 0.82
avaniya001-challenge-015 challenge-015 1.0 1 85 0 84 1 1.00 0.02 0.00 0.98 0.00 1.00
avaniya001-challenge-016 challenge-016 2.5 3 144 1 141 2 0.99 0.01 0.01 0.97 0.01 0.98
avaniya001-challenge-017 challenge-017 1.0 1 16 0 15 1 1.00 0.78 0.00 0.22 0.00 1.00
avaniya001-challenge-018 challenge-018 1.5 2 56 0 54 2 0.99 0.02 0.00 0.96 0.02 0.98
avaniya001-challenge-019 challenge-019 3.0 4 17 1 13 3 0.88 0.06 0.06 0.75 0.13 0.81
avaniya001-challenge-001 challenge-001 1.0 1 43 0 42 1 1.00 0.15 0.00 0.85 0.00 1.00
avaniya001-challenge-002 challenge-002 1.0 1 44 0 43 1 1.00 0.13 0.00 0.87 0.00 1.00
avaniya001-challenge-004 challenge-004 1.0 1 299 0 298 1 1.00 0.01 0.00 0.99 0.00 1.00
avaniya001-challenge-005 challenge-005 - - 5 - - - - - - - - -
avaniya001-challenge-006 challenge-006 - - 35 - - - - - - - - -
avaniya001-challenge-007 challenge-007 1.0 1 46 0 45 1 1.00 0.12 0.00 0.88 0.00 1.00
avaniya001-challenge-008 challenge-008 1.0 1 285 0 284 1 1.00 0.01 0.00 0.99 0.00 1.00
avaniya001-challenge-009 challenge-009 9.0 9 189 8 180 1 0.96 0.01 0.07 0.92 0.00 0.93
avaniya002-challenge-010 challenge-010 1.0 1 2 0 1 1 1.00 1.00 0.00 0.00 0.00 1.00
avaniya002-challenge-011 challenge-011 1.0 1 13 0 12 1 1.00 0.08 0.00 0.92 0.00 1.00
avaniya002-challenge-012 challenge-012 1.0 1 24 0 23 1 1.00 0.91 0.00 0.09 0.00 1.00
avaniya002-challenge-013 challenge-013 1.0 1 108 0 107 1 1.00 0.63 0.00 0.37 0.00 1.00
avaniya002-challenge-014 challenge-014 68.0 68 389 67 321 1 0.83 0.00 0.57 0.43 0.00 0.43
avaniya002-challenge-015 challenge-015 1.0 1 87 0 86 1 1.00 0.31 0.00 0.69 0.00 1.00
avaniya002-challenge-016 challenge-016 2.0 2 144 1 142 1 0.99 0.35 0.36 0.29 0.00 0.64
avaniya002-challenge-017 challenge-017 1.0 1 16 0 15 1 1.00 0.78 0.00 0.22 0.00 1.00
avaniya002-challenge-018 challenge-018 1.0 1 56 0 55 1 1.00 0.73 0.00 0.27 0.00 1.00
avaniya002-challenge-019 challenge-019 1.0 1 17 0 16 1 1.00 0.85 0.00 0.15 0.00 1.00
avaniya002-challenge-001 challenge-001 1.0 1 43 0 42 1 1.00 0.15 0.00 0.85 0.00 1.00
avaniya002-challenge-002 challenge-002 1.0 1 44 0 43 1 1.00 0.13 0.00 0.87 0.00 1.00
avaniya002-challenge-004 challenge-004 1.0 1 299 0 298 1 1.00 0.01 0.00 0.99 0.00 1.00
avaniya002-challenge-005 challenge-005 - - 5 - - - - - - - - -
avaniya002-challenge-006 challenge-006 - - 35 - - - - - - - - -
avaniya002-challenge-007 challenge-007 1.0 1 46 0 45 1 1.00 0.12 0.00 0.88 0.00 1.00
avaniya002-challenge-008 challenge-008 1.0 1 285 0 284 1 1.00 0.01 0.00 0.99 0.00 1.00
avaniya002-challenge-009 challenge-009 1.0 1 189 0 188 1 1.00 0.56 0.00 0.44 0.00 1.00
felicityallencfmorig-challenge-010 challenge-010 1.0 1 44 0 43 1 1.00 0.09 0.00 0.91 0.00 1.00
felicityallencfmorig-challenge-011 challenge-011 19.0 19 297 18 278 1 0.94 0.01 0.21 0.78 0.00 0.79
felicityallencfmorig-challenge-012 challenge-012 2.0 2 243 1 241 1 1.00 0.03 0.03 0.94 0.00 0.97
felicityallencfmorig-challenge-013 challenge-013 3.0 3 290 2 287 1 0.99 0.01 0.03 0.96 0.00 0.97
felicityallencfmorig-challenge-014 challenge-014 8.0 8 495 7 487 1 0.99 0.00 0.04 0.96 0.00 0.96
felicityallencfmorig-challenge-015 challenge-015 1.0 1 359 0 358 1 1.00 0.02 0.00 0.98 0.00 1.00
felicityallencfmorig-challenge-016 challenge-016 2.0 2 141 1 139 1 0.99 0.05 0.07 0.88 0.00 0.93
felicityallencfmorig-challenge-017 challenge-017 1.0 1 30 0 29 1 1.00 0.10 0.00 0.90 0.00 1.00
felicityallencfmorig-challenge-018 challenge-018 4.0 4 157 3 153 1 0.98 0.03 0.11 0.86 0.00 0.89
felicityallencfmorig-challenge-019 challenge-019 3.0 3 105 2 102 1 0.98 0.02 0.06 0.91 0.00 0.94
felicityallencfmorig-challenge-001 challenge-001 4.5 5 22 3 17 2 0.83 0.08 0.37 0.46 0.08 0.55
felicityallencfmorig-challenge-002 challenge-002 1.0 1 12 0 11 1 1.00 0.18 0.00 0.82 0.00 1.00
felicityallencfmorig-challenge-004 challenge-004 1.0 1 63 0 62 1 1.00 0.05 0.00 0.95 0.00 1.00
felicityallencfmorig-challenge-005 challenge-005 - - 196 - - - - - - - - -
felicityallencfmorig-challenge-006 challenge-006 2.5 3 11 1 8 2 0.85 0.13 0.18 0.56 0.13 0.69
felicityallencfmorig-challenge-007 challenge-007 1.0 1 537 0 536 1 1.00 0.03 0.00 0.97 0.00 1.00
felicityallencfmorig-challenge-008 challenge-008 4.0 4 63 3 59 1 0.95 0.05 0.19 0.76 0.00 0.81
felicityallencfmorig-challenge-009 challenge-009 1.0 1 558 0 557 1 1.00 0.02 0.00 0.98 0.00 1.00
felicityallencfmretrained-challenge-010 challenge-010 1.0 1 44 0 43 1 1.00 0.09 0.00 0.91 0.00 1.00
felicityallencfmretrained-challenge-011 challenge-011 19.0 19 297 18 278 1 0.94 0.01 0.21 0.78 0.00 0.79
felicityallencfmretrained-challenge-012 challenge-012 2.0 2 243 1 241 1 1.00 0.03 0.03 0.94 0.00 0.97
felicityallencfmretrained-challenge-013 challenge-013 3.0 3 290 2 287 1 0.99 0.01 0.03 0.96 0.00 0.97
felicityallencfmretrained-challenge-014 challenge-014 8.0 8 495 7 487 1 0.99 0.00 0.04 0.96 0.00 0.96
felicityallencfmretrained-challenge-015 challenge-015 1.0 1 359 0 358 1 1.00 0.02 0.00 0.98 0.00 1.00
felicityallencfmretrained-challenge-016 challenge-016 2.0 2 141 1 139 1 0.99 0.05 0.07 0.88 0.00 0.93
felicityallencfmretrained-challenge-017 challenge-017 1.0 1 30 0 29 1 1.00 0.10 0.00 0.90 0.00 1.00
felicityallencfmretrained-challenge-018 challenge-018 4.0 4 157 3 153 1 0.98 0.03 0.11 0.86 0.00 0.89
felicityallencfmretrained-challenge-019 challenge-019 3.0 3 105 2 102 1 0.98 0.02 0.06 0.91 0.00 0.94
felicityallencfmretrained-challenge-001 challenge-001 4.5 5 22 3 17 2 0.83 0.08 0.37 0.46 0.08 0.55
felicityallencfmretrained-challenge-002 challenge-002 1.0 1 12 0 11 1 1.00 0.18 0.00 0.82 0.00 1.00
felicityallencfmretrained-challenge-004 challenge-004 1.0 1 63 0 62 1 1.00 0.05 0.00 0.95 0.00 1.00
felicityallencfmretrained-challenge-005 challenge-005 - - 196 - - - - - - - - -
felicityallencfmretrained-challenge-006 challenge-006 2.5 3 11 1 8 2 0.85 0.13 0.18 0.56 0.13 0.69
felicityallencfmretrained-challenge-007 challenge-007 1.0 1 537 0 536 1 1.00 0.03 0.00 0.97 0.00 1.00
felicityallencfmretrained-challenge-008 challenge-008 4.0 4 63 3 59 1 0.95 0.05 0.19 0.76 0.00 0.81
felicityallencfmretrained-challenge-009 challenge-009 1.0 1 558 0 557 1 1.00 0.02 0.00 0.98 0.00 1.00
gnpscfmiddnp-challenge-010 challenge-010 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
gnpscfmiddnp-challenge-011 challenge-011 1.5 2 2 0 0 2 0.50 0.50 0.00 0.00 0.50 0.50
gnpscfmiddnp-challenge-012 challenge-012 1.0 1 8 0 7 1 1.00 0.24 0.00 0.76 0.00 1.00
gnpscfmiddnp-challenge-013 challenge-013 - - 53 - - - - - - - - -
gnpscfmiddnp-challenge-014 challenge-014 38.0 39 260 36 221 3 0.86 0.01 0.25 0.73 0.01 0.73
gnpscfmiddnp-challenge-015 challenge-015 4.0 4 43 3 39 1 0.93 0.04 0.15 0.81 0.00 0.85
gnpscfmiddnp-challenge-016 challenge-016 1.0 1 8 0 7 1 1.00 0.19 0.00 0.81 0.00 1.00
gnpscfmiddnp-challenge-017 challenge-017 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
gnpscfmiddnp-challenge-018 challenge-018 - - 13 - - - - - - - - -
gnpscfmiddnp-challenge-019 challenge-019 1.0 1 8 0 7 1 1.00 0.31 0.00 0.69 0.00 1.00
gnpscfmiddnp-challenge-001 challenge-001 3.0 4 6 1 2 3 0.60 0.18 0.27 0.18 0.36 0.36
gnpscfmiddnp-challenge-002 challenge-002 - - 6 - - - - - - - - -
gnpscfmiddnp-challenge-004 challenge-004 1.0 1 8 0 7 1 1.00 0.51 0.00 0.49 0.00 1.00
gnpscfmiddnp-challenge-005 challenge-005 - - 15 - - - - - - - - -
gnpscfmiddnp-challenge-006 challenge-006 4.5 6 6 2 0 4 0.30 0.11 0.56 0.00 0.33 0.11
gnpscfmiddnp-challenge-007 challenge-007 - - 6 - - - - - - - - -
gnpscfmiddnp-challenge-008 challenge-008 4.5 7 8 1 1 6 0.50 0.10 0.29 0.09 0.52 0.19
gnpscfmiddnp-challenge-009 challenge-009 1.0 1 13 0 12 1 1.00 0.11 0.00 0.89 0.00 1.00
gnpscsifingerid-challenge-010 challenge-010 1.0 1 7 0 6 1 1.00 0.19 0.00 0.81 0.00 1.00
gnpscsifingerid-challenge-011 challenge-011 - - 10 - - - - - - - - -
gnpscsifingerid-challenge-012 challenge-012 1.0 1 10 0 9 1 1.00 0.19 0.00 0.81 0.00 1.00
gnpscsifingerid-challenge-013 challenge-013 1.0 1 10 0 9 1 1.00 0.16 0.00 0.84 0.00 1.00
gnpscsifingerid-challenge-014 challenge-014 - - 10 - - - - - - - - -
gnpscsifingerid-challenge-015 challenge-015 4.0 4 43 3 39 1 0.93 0.04 0.15 0.81 0.00 0.85
gnpscsifingerid-challenge-016 challenge-016 1.0 1 8 0 7 1 1.00 0.19 0.00 0.81 0.00 1.00
gnpscsifingerid-challenge-017 challenge-017 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
gnpscsifingerid-challenge-018 challenge-018 - - 13 - - - - - - - - -
gnpscsifingerid-challenge-019 challenge-019 1.0 1 8 0 7 1 1.00 0.31 0.00 0.69 0.00 1.00
gnpscsifingerid-challenge-001 challenge-001 - - 10 - - - - - - - - -
gnpscsifingerid-challenge-002 challenge-002 1.0 1 10 0 9 1 1.00 0.19 0.00 0.81 0.00 1.00
gnpscsifingerid-challenge-004 challenge-004 1.0 1 10 0 9 1 1.00 0.18 0.00 0.82 0.00 1.00
gnpscsifingerid-challenge-005 challenge-005 - - 10 - - - - - - - - -
gnpscsifingerid-challenge-007 challenge-007 1.0 1 10 0 9 1 1.00 0.20 0.00 0.80 0.00 1.00
gnpscsifingerid-challenge-008 challenge-008 1.0 1 10 0 9 1 1.00 0.19 0.00 0.81 0.00 1.00
gnpscsifingerid-challenge-009 challenge-009 1.0 1 10 0 9 1 1.00 0.20 0.00 0.80 0.00 1.00
gnpsisdbunpd-challenge-010 challenge-010 1.0 1 13 0 12 1 1.00 0.90 0.00 0.10 0.00 1.00
gnpsisdbunpd-challenge-011 challenge-011 - - 96 - - - - - - - - -
gnpsisdbunpd-challenge-012 challenge-012 1.0 1 94 0 93 1 1.00 0.60 0.00 0.40 0.00 1.00
gnpsisdbunpd-challenge-013 challenge-013 - - 91 - - - - - - - - -
gnpsisdbunpd-challenge-014 challenge-014 9.0 9 77 8 68 1 0.89 0.01 0.70 0.29 0.00 0.30
gnpsisdbunpd-challenge-015 challenge-015 4.0 4 43 3 39 1 0.93 0.04 0.15 0.81 0.00 0.85
gnpsisdbunpd-challenge-016 challenge-016 1.0 1 8 0 7 1 1.00 0.19 0.00 0.81 0.00 1.00
gnpsisdbunpd-challenge-017 challenge-017 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
gnpsisdbunpd-challenge-018 challenge-018 - - 13 - - - - - - - - -
gnpsisdbunpd-challenge-019 challenge-019 1.0 1 8 0 7 1 1.00 0.31 0.00 0.69 0.00 1.00
gnpsisdbunpd-challenge-001 challenge-001 7.0 7 7 6 0 1 0.00 0.11 0.89 0.00 0.00 0.11
gnpsisdbunpd-challenge-002 challenge-002 2.0 2 5 1 3 1 0.75 0.27 0.36 0.37 0.00 0.64
gnpsisdbunpd-challenge-004 challenge-004 1.0 1 31 0 30 1 1.00 0.26 0.00 0.74 0.00 1.00
gnpsisdbunpd-challenge-005 challenge-005 - - 46 - - - - - - - - -
gnpsisdbunpd-challenge-006 challenge-006 6.0 6 8 5 2 1 0.29 0.07 0.79 0.14 0.00 0.21
gnpsisdbunpd-challenge-007 challenge-007 2.0 2 5 1 3 1 0.75 0.26 0.37 0.37 0.00 0.63
gnpsisdbunpd-challenge-008 challenge-008 1.0 1 18 0 17 1 1.00 0.43 0.00 0.57 0.00 1.00
gnpsisdbunpd-challenge-009 challenge-009 1.0 1 53 0 52 1 1.00 0.24 0.00 0.76 0.00 1.00
nikolic-challenge-010 challenge-010 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
nikolic-challenge-011 challenge-011 1.0 1 2 0 1 1 1.00 0.50 0.00 0.50 0.00 1.00
nikolic-challenge-012 challenge-012 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
nikolic-challenge-013 challenge-013 1.0 1 2 0 1 1 1.00 0.55 0.00 0.45 0.00 1.00
nikolic-challenge-014 challenge-014 2.0 2 5 1 3 1 0.75 0.23 0.25 0.52 0.00 0.75
nikolic-challenge-015 challenge-015 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
nikolic-challenge-016 challenge-016 1.0 1 2 0 1 1 1.00 0.60 0.00 0.40 0.00 1.00
nikolic-challenge-017 challenge-017 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
nikolic-challenge-018 challenge-018 1.0 1 2 0 1 1 1.00 0.58 0.00 0.42 0.00 1.00
nikolic-challenge-019 challenge-019 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
nikolic-challenge-001 challenge-001 2.0 2 4 1 2 1 0.67 0.25 0.29 0.47 0.00 0.71
nikolic-challenge-002 challenge-002 2.0 2 2 1 0 1 0.00 0.48 0.52 0.00 0.00 0.48
nikolic-challenge-004 challenge-004 1.0 1 9 0 8 1 1.00 0.12 0.00 0.88 0.00 1.00
nikolic-challenge-005 challenge-005 1.0 1 3 0 2 1 1.00 0.36 0.00 0.64 0.00 1.00
nikolic-challenge-006 challenge-006 1.0 1 3 0 2 1 1.00 0.36 0.00 0.64 0.00 1.00
nikolic-challenge-007 challenge-007 1.0 1 2 0 1 1 1.00 0.57 0.00 0.43 0.00 1.00
nikolic-challenge-008 challenge-008 2.0 2 2 1 0 1 0.00 0.46 0.54 0.00 0.00 0.46
nikolic-challenge-009 challenge-009 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
pma-challenge-010 challenge-010 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
pma-challenge-011 challenge-011 8.0 8 9 7 1 1 0.12 0.09 0.82 0.09 0.00 0.18
pma-challenge-012 challenge-012 4.0 4 9 3 5 1 0.62 0.12 0.41 0.47 0.00 0.59
pma-challenge-013 challenge-013 - - 13 - - - - - - - - -
pma-challenge-014 challenge-014 - - 12 - - - - - - - - -
pma-challenge-001 challenge-001 3.0 3 8 2 5 1 0.71 0.15 0.37 0.48 0.00 0.63
pma-challenge-002 challenge-002 2.0 2 8 1 6 1 0.86 0.19 0.22 0.59 0.00 0.78
pma-challenge-004 challenge-004 2.0 2 11 1 9 1 0.90 0.10 0.11 0.79 0.00 0.89
pma-challenge-005 challenge-005 - - 11 - - - - - - - - -
pma-challenge-006 challenge-006 7.0 7 8 6 1 1 0.14 0.10 0.81 0.09 0.00 0.19
pma-challenge-007 challenge-007 2.0 2 8 1 6 1 0.86 0.17 0.19 0.64 0.00 0.81
pma-challenge-008 challenge-008 4.0 4 12 3 8 1 0.73 0.09 0.27 0.64 0.00 0.73
pma-challenge-009 challenge-009 1.0 1 12 0 11 1 1.00 0.11 0.00 0.89 0.00 1.00
pmadnpisdb-challenge-011 challenge-011 2.0 2 2 1 0 1 0.00 0.40 0.60 0.00 0.00 0.40
pmadnpisdb-challenge-012 challenge-012 2.0 2 8 1 6 1 0.86 0.18 0.21 0.61 0.00 0.79
pmadnpisdb-challenge-013 challenge-013 - - 9 - - - - - - - - -
pmadnpisdb-challenge-014 challenge-014 - - 8 - - - - - - - - -
pmadnpisdb-challenge-001 challenge-001 3.0 3 7 2 4 1 0.67 0.16 0.41 0.43 0.00 0.59
pmadnpisdb-challenge-002 challenge-002 1.0 1 7 0 6 1 1.00 0.23 0.00 0.77 0.00 1.00
pmadnpisdb-challenge-004 challenge-004 1.0 1 8 0 7 1 1.00 0.15 0.00 0.85 0.00 1.00
pmadnpisdb-challenge-005 challenge-005 - - 10 - - - - - - - - -
pmadnpisdb-challenge-006 challenge-006 7.0 7 7 6 0 1 0.00 0.11 0.89 0.00 0.00 0.11
pmadnpisdb-challenge-007 challenge-007 1.0 1 7 0 6 1 1.00 0.21 0.00 0.79 0.00 1.00
pmadnpisdb-challenge-008 challenge-008 3.0 3 8 2 5 1 0.71 0.14 0.28 0.59 0.00 0.72
pmadnpisdb-challenge-009 challenge-009 1.0 1 9 0 8 1 1.00 0.14 0.00 0.86 0.00 1.00
pmaunpdisdb-challenge-010 challenge-010 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
pmaunpdisdb-challenge-011 challenge-011 - - 3 - - - - - - - - -
pmaunpdisdb-challenge-012 challenge-012 3.0 3 7 2 4 1 0.67 0.15 0.35 0.50 0.00 0.65
pmaunpdisdb-challenge-013 challenge-013 - - 8 - - - - - - - - -
pmaunpdisdb-challenge-014 challenge-014 - - 9 - - - - - - - - -
pmaunpdisdb-challenge-001 challenge-001 3.0 3 8 2 5 1 0.71 0.15 0.37 0.48 0.00 0.63
pmaunpdisdb-challenge-002 challenge-002 2.0 2 8 1 6 1 0.86 0.19 0.23 0.58 0.00 0.77
pmaunpdisdb-challenge-004 challenge-004 2.0 2 8 1 6 1 0.86 0.13 0.13 0.74 0.00 0.87
pmaunpdisdb-challenge-005 challenge-005 - - 9 - - - - - - - - -
pmaunpdisdb-challenge-006 challenge-006 6.0 6 8 5 2 1 0.29 0.10 0.71 0.19 0.00 0.29
pmaunpdisdb-challenge-007 challenge-007 2.0 2 8 1 6 1 0.86 0.17 0.19 0.63 0.00 0.81
pmaunpdisdb-challenge-008 challenge-008 6.0 6 8 5 2 1 0.29 0.12 0.63 0.24 0.00 0.37
pmaunpdisdb-challenge-009 challenge-009 1.0 1 8 0 7 1 1.00 0.15 0.00 0.85 0.00 1.00
ruttkies_metfrag_cfmid-challenge-010 challenge-010 15.0 15 161 14 146 1 0.91 0.01 0.18 0.81 0.00 0.82
ruttkies_metfrag_cfmid-challenge-011 challenge-011 175.0 175 238 174 63 1 0.27 0.00 0.79 0.20 0.00 0.21
ruttkies_metfrag_cfmid-challenge-012 challenge-012 88.0 88 1159 87 1071 1 0.92 0.00 0.23 0.77 0.00 0.77
ruttkies_metfrag_cfmid-challenge-013 challenge-013 146.0 146 356 145 210 1 0.59 0.00 0.49 0.50 0.00 0.51
ruttkies_metfrag_cfmid-challenge-014 challenge-014 18.0 18 597 17 579 1 0.97 0.00 0.05 0.95 0.00 0.95
ruttkies_metfrag_cfmid-challenge-015 challenge-015 1.0 1 2012 0 2011 1 1.00 0.00 0.00 1.00 0.00 1.00
ruttkies_metfrag_cfmid-challenge-016 challenge-016 25.0 25 489 24 464 1 0.95 0.00 0.09 0.90 0.00 0.91
ruttkies_metfrag_cfmid-challenge-017 challenge-017 3.0 3 22 2 19 1 0.90 0.18 0.41 0.41 0.00 0.59
ruttkies_metfrag_cfmid-challenge-018 challenge-018 34.5 36 230 32 194 4 0.85 0.01 0.25 0.73 0.02 0.73
ruttkies_metfrag_cfmid-challenge-019 challenge-019 2.0 2 18 1 16 1 0.94 0.07 0.07 0.86 0.00 0.93
ruttkies_metfrag_cfmid-challenge-001 challenge-001 4.0 4 167 3 163 1 0.98 0.02 0.08 0.90 0.00 0.92
ruttkies_metfrag_cfmid-challenge-002 challenge-002 1.0 1 176 0 175 1 1.00 0.05 0.00 0.95 0.00 1.00
ruttkies_metfrag_cfmid-challenge-004 challenge-004 34.0 35 427 32 392 3 0.92 0.00 0.14 0.84 0.01 0.85
ruttkies_metfrag_cfmid-challenge-005 challenge-005 - - 189 - - - - - - - - -
ruttkies_metfrag_cfmid-challenge-006 challenge-006 - - 590 - - - - - - - - -
ruttkies_metfrag_cfmid-challenge-007 challenge-007 1.5 2 451 0 449 2 1.00 0.04 0.00 0.92 0.04 0.96
ruttkies_metfrag_cfmid-challenge-008 challenge-008 46.0 46 619 45 573 1 0.93 0.00 0.12 0.88 0.00 0.88
ruttkies_metfrag_cfmid-challenge-009 challenge-009 1206.5 1207 5238 1205 4031 2 0.77 0.00 0.31 0.69 0.00 0.69
samuelblcms-challenge-010 challenge-010 1.0 1 2 0 1 1 1.00 0.50 0.00 0.50 0.00 1.00
samuelblcms-challenge-011 challenge-011 4.0 4 7 3 3 1 0.50 0.14 0.43 0.42 0.00 0.57
samuelblcms-challenge-012 challenge-012 1.0 1 17 0 16 1 1.00 0.06 0.00 0.94 0.00 1.00
samuelblcms-challenge-013 challenge-013 - - 11 - - - - - - - - -
samuelblcms-challenge-014 challenge-014 29.0 29 443 28 414 1 0.94 0.00 0.07 0.93 0.00 0.93
samuelblcms-challenge-015 challenge-015 1.0 1 32 0 31 1 1.00 0.03 0.00 0.97 0.00 1.00
samuelblcms-challenge-016 challenge-016 2.0 2 12 1 10 1 0.91 0.10 0.10 0.81 0.00 0.90
samuelblcms-challenge-017 challenge-017 - - 14 - - - - - - - - -
samuelblcms-challenge-018 challenge-018 12.0 12 19 11 7 1 0.39 0.05 0.58 0.37 0.00 0.42
samuelblcms-challenge-019 challenge-019 1.0 1 11 0 10 1 1.00 0.10 0.00 0.90 0.00 1.00
samuelblcms-challenge-001 challenge-001 7.0 7 10 6 3 1 0.33 0.10 0.63 0.27 0.00 0.37
samuelblcms-challenge-002 challenge-002 1.0 1 10 0 9 1 1.00 0.12 0.00 0.88 0.00 1.00
samuelblcms-challenge-004 challenge-004 6.0 11 11 0 0 11 0.50 0.09 0.00 0.00 0.91 0.09
samuelblcms-challenge-005 challenge-005 - - 12 - - - - - - - - -
samuelblcms-challenge-006 challenge-006 6.0 6 10 5 4 1 0.44 0.12 0.62 0.25 0.00 0.38
samuelblcms-challenge-007 challenge-007 1.0 1 10 0 9 1 1.00 0.22 0.00 0.78 0.00 1.00
samuelblcms-challenge-009 challenge-009 2.0 2 15 1 13 1 0.93 0.07 0.08 0.86 0.00 0.92
samuelbms-challenge-010 challenge-010 1.0 1 2 0 1 1 1.00 0.55 0.00 0.45 0.00 1.00
samuelbms-challenge-011 challenge-011 - - 6 - - - - - - - - -
samuelbms-challenge-012 challenge-012 1.0 1 17 0 16 1 1.00 0.06 0.00 0.94 0.00 1.00
samuelbms-challenge-013 challenge-013 - - 12 - - - - - - - - -
samuelbms-challenge-014 challenge-014 23.0 23 66 22 43 1 0.66 0.02 0.34 0.65 0.00 0.66
samuelbms-challenge-015 challenge-015 3.0 3 84 2 81 1 0.98 0.02 0.03 0.95 0.00 0.97
samuelbms-challenge-016 challenge-016 2.0 2 12 1 10 1 0.91 0.10 0.10 0.81 0.00 0.90
samuelbms-challenge-017 challenge-017 - - 14 - - - - - - - - -
samuelbms-challenge-018 challenge-018 12.0 12 19 11 7 1 0.39 0.05 0.60 0.35 0.00 0.40
samuelbms-challenge-019 challenge-019 1.0 1 11 0 10 1 1.00 0.11 0.00 0.89 0.00 1.00
samuelbms-challenge-001 challenge-001 7.0 7 10 6 3 1 0.33 0.10 0.63 0.27 0.00 0.37
samuelbms-challenge-002 challenge-002 1.0 1 10 0 9 1 1.00 0.12 0.00 0.88 0.00 1.00
samuelbms-challenge-004 challenge-004 2.0 2 11 1 9 1 0.90 0.09 0.09 0.82 0.00 0.91
samuelbms-challenge-005 challenge-005 - - 12 - - - - - - - - -
samuelbms-challenge-006 challenge-006 6.0 6 10 5 4 1 0.44 0.12 0.62 0.25 0.00 0.38
samuelbms-challenge-007 challenge-007 1.0 1 10 0 9 1 1.00 0.22 0.00 0.78 0.00 1.00
samuelbms-challenge-009 challenge-009 2.0 2 15 1 13 1 0.93 0.07 0.08 0.86 0.00 0.92
tkind-challenge-010 challenge-010 1.0 1 150 0 149 1 1.00 0.01 0.00 0.99 0.00 1.00
tkind-challenge-011 challenge-011 1.0 1 224 0 223 1 1.00 0.01 0.00 0.99 0.00 1.00
tkind-challenge-012 challenge-012 1.0 1 992 0 991 1 1.00 0.00 0.00 1.00 0.00 1.00
tkind-challenge-013 challenge-013 1.0 1 360 0 359 1 1.00 0.01 0.00 0.99 0.00 1.00
tkind-challenge-014 challenge-014 292.0 582 582 1 0 581 0.50 0.00 0.00 0.00 1.00 0.00
tkind-challenge-015 challenge-015 1.0 1 2006 0 2005 1 1.00 0.00 0.00 1.00 0.00 1.00
tkind-challenge-016 challenge-016 1.0 1 409 0 408 1 1.00 0.00 0.00 1.00 0.00 1.00
tkind-challenge-017 challenge-017 1.0 1 22 0 21 1 1.00 0.08 0.00 0.92 0.00 1.00
tkind-challenge-018 challenge-018 1.0 1 69 0 68 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-019 challenge-019 1.0 1 20 0 19 1 1.00 0.24 0.00 0.76 0.00 1.00
tkind-challenge-001 challenge-001 5.0 5 9 4 4 1 0.50 0.10 0.70 0.20 0.00 0.30
tkind-challenge-002 challenge-002 1.0 1 13 0 12 1 1.00 0.17 0.00 0.83 0.00 1.00
tkind-challenge-004 challenge-004 1.0 1 11 0 10 1 1.00 0.10 0.00 0.90 0.00 1.00
tkind-challenge-005 challenge-005 - - 32 - - - - - - - - -
tkind-challenge-006 challenge-006 - - 20 - - - - - - - - -
tkind-challenge-007 challenge-007 3.0 5 5 0 0 5 0.50 0.20 0.00 0.00 0.80 0.20
tkind-challenge-008 challenge-008 2.0 3 3 0 0 3 0.50 0.33 0.00 0.00 0.67 0.33
tkind-challenge-009 challenge-009 1.0 1 3 0 2 1 1.00 0.36 0.00 0.64 0.00 1.00

Table legend:

rank
Absolute rank of correct solution (average of tied ranks)
rankmax
Absolute rank of correct solution (max of tied ranks, worst case)
tc
Total number of candidates
bc
Number of candidates with a score better than correct solution
wc
Number of candidates with a score worse than correct solution
ec
Number of candidates with same score as the correct solution
rrp
Relative ranking position (1.0 is good, 0.0 is not)
p
Score of correct solution
wbc
Sum of scores better than correct solution
wwc
Sum of scores worse than correct solution
wec
Sum of scores equal to correct solution
wrrp
RRP weighted by the scores (1 is good)