News

Oct 31st, 2017
The results are now available.

Oct 30th, 2017
The solutions are now available.

Sept 8th, 2017
Update for Challenge 15 available, but will not count in evaluation.

Sept 4th, 2017
Updated mailling list and submission information.

Aug 23rd, 2017
The preliminary results have been sent out to participants, and are now available.

July 09th, 2017
We fixed the intensities in the TSV archive for challenges 046-243.

June 22nd, 2017
We added the Category 4 on a subset of the data files.

May 22nd, 2017
We have improved challenges 29, 42, 71, 89, 105, 106 and 144.

April 26th, 2017
The rules and challenges of CASMI 2017 are public now !

Jan 20th, 2017
Organisation of CASMI 2017 is underway, stay tuned!


Results in Category 1

Details per Challenge and Participant. See legend at bottom for more details

The details table is also available as CSV download.
participant category challenge rank rankmax tc bc wc ec rrp
CStacey-challenge-001 category1 challenge-001 - - 7 - - - -
kai-challenge-001 category1 challenge-001 31.0 31 960 30 929 1 0.97
kai112-challenge-001 category1 challenge-001 9.0 9 5203 8 5194 1 1.00
Rakesh-challenge-001 category1 challenge-001 - - 37 - - - -
SamuelB-challenge-001 category1 challenge-001 - - 76 - - - -
SamuelB2-challenge-001 category1 challenge-001 - - 76 - - - -
SamuelB3-challenge-001 category1 challenge-001 - - 76 - - - -
seeslab-challenge-001 category1 challenge-001 1.0 1 243 0 242 1 1.00
CStacey-challenge-002 category1 challenge-002 3.5 5 18 1 13 4 0.85
kai-challenge-002 category1 challenge-002 11.0 11 12224 10 12213 1 1.00
kai112-challenge-002 category1 challenge-002 - - 9537 - - - -
Rakesh-challenge-002 category1 challenge-002 - - 84 - - - -
SamuelB-challenge-002 category1 challenge-002 4.0 4 322 3 318 1 0.99
SamuelB2-challenge-002 category1 challenge-002 4.0 4 322 3 318 1 0.99
SamuelB3-challenge-002 category1 challenge-002 4.0 4 322 3 318 1 0.99
seeslab-challenge-002 category1 challenge-002 21.0 21 266 20 245 1 0.92
CStacey-challenge-003 category1 challenge-003 - - 26 - - - -
kai-challenge-003 category1 challenge-003 1.0 1 8290 0 8289 1 1.00
kai112-challenge-003 category1 challenge-003 47.0 47 17926 46 17879 1 1.00
Rakesh-challenge-003 category1 challenge-003 - - 135 - - - -
SamuelB-challenge-003 category1 challenge-003 1.0 1 226 0 225 1 1.00
SamuelB2-challenge-003 category1 challenge-003 1.0 1 224 0 223 1 1.00
SamuelB3-challenge-003 category1 challenge-003 1.0 1 224 0 223 1 1.00
seeslab-challenge-003 category1 challenge-003 7.0 7 288 6 281 1 0.98
CStacey-challenge-004 category1 challenge-004 - - 4 - - - -
kai-challenge-004 category1 challenge-004 1.0 1 431 0 430 1 1.00
kai112-challenge-004 category1 challenge-004 1.0 1 1610 0 1609 1 1.00
Rakesh-challenge-004 category1 challenge-004 2.0 2 343 1 341 1 1.00
SamuelB-challenge-004 category1 challenge-004 - - 2 - - - -
SamuelB2-challenge-004 category1 challenge-004 - - 2 - - - -
SamuelB3-challenge-004 category1 challenge-004 - - 2 - - - -
seeslab-challenge-004 category1 challenge-004 3.0 3 242 2 239 1 0.99
CStacey-challenge-005 category1 challenge-005 - - 15 - - - -
kai-challenge-005 category1 challenge-005 95.0 95 431 94 336 1 0.78
kai112-challenge-005 category1 challenge-005 101.0 101 3075 100 2974 1 0.97
Rakesh-challenge-005 category1 challenge-005 - - 360 - - - -
SamuelB-challenge-005 category1 challenge-005 22.0 22 139 21 117 1 0.85
SamuelB2-challenge-005 category1 challenge-005 3.0 3 139 2 136 1 0.99
SamuelB3-challenge-005 category1 challenge-005 3.0 3 139 2 136 1 0.99
seeslab-challenge-005 category1 challenge-005 31.0 31 242 30 211 1 0.88
CStacey-challenge-006 category1 challenge-006 12.5 15 22 9 7 6 0.45
kai-challenge-006 category1 challenge-006 1.0 1 431 0 430 1 1.00
kai112-challenge-006 category1 challenge-006 1.0 1 1772 0 1771 1 1.00
Rakesh-challenge-006 category1 challenge-006 - - 501 - - - -
SamuelB-challenge-006 category1 challenge-006 18.0 18 139 17 121 1 0.88
SamuelB2-challenge-006 category1 challenge-006 1.0 1 139 0 138 1 1.00
SamuelB3-challenge-006 category1 challenge-006 1.0 1 139 0 138 1 1.00
seeslab-challenge-006 category1 challenge-006 16.0 16 244 15 228 1 0.94
CStacey-challenge-007 category1 challenge-007 13.0 18 20 7 2 11 0.37
kai-challenge-007 category1 challenge-007 1.0 1 431 0 430 1 1.00
kai112-challenge-007 category1 challenge-007 1.0 1 3702 0 3701 1 1.00
Rakesh-challenge-007 category1 challenge-007 1.0 1 706 0 705 1 1.00
SamuelB-challenge-007 category1 challenge-007 17.0 17 139 16 122 1 0.88
SamuelB2-challenge-007 category1 challenge-007 1.0 1 139 0 138 1 1.00
SamuelB3-challenge-007 category1 challenge-007 1.0 1 139 0 138 1 1.00
seeslab-challenge-007 category1 challenge-007 2.0 2 250 1 248 1 1.00
CStacey-challenge-008 category1 challenge-008 1.5 2 15 0 13 2 0.96
kai-challenge-008 category1 challenge-008 1.0 1 2553 0 2552 1 1.00
kai112-challenge-008 category1 challenge-008 1.0 1 11631 0 11630 1 1.00
Rakesh-challenge-008 category1 challenge-008 - - 486 - - - -
SamuelB-challenge-008 category1 challenge-008 - - 222 - - - -
SamuelB2-challenge-008 category1 challenge-008 - - 222 - - - -
SamuelB3-challenge-008 category1 challenge-008 - - 222 - - - -
seeslab-challenge-008 category1 challenge-008 9.0 9 268 8 259 1 0.97
CStacey-challenge-009 category1 challenge-009 3.5 5 17 1 12 4 0.84
kai-challenge-009 category1 challenge-009 1.0 1 1472 0 1471 1 1.00
kai112-challenge-009 category1 challenge-009 1.0 1 7950 0 7949 1 1.00
Rakesh-challenge-009 category1 challenge-009 - - 482 - - - -
SamuelB-challenge-009 category1 challenge-009 10.0 10 146 9 136 1 0.94
SamuelB2-challenge-009 category1 challenge-009 10.0 10 146 9 136 1 0.94
SamuelB3-challenge-009 category1 challenge-009 10.0 10 146 9 136 1 0.94
seeslab-challenge-009 category1 challenge-009 24.0 24 271 23 247 1 0.91
CStacey-challenge-010 category1 challenge-010 1.0 1 24 0 23 1 1.00
kai-challenge-010 category1 challenge-010 8584.0 8584 16436 8583 7852 1 0.48
kai112-challenge-010 category1 challenge-010 - - 34153 - - - -
Rakesh-challenge-010 category1 challenge-010 - - 118 - - - -
SamuelB-challenge-010 category1 challenge-010 4.0 4 31 3 27 1 0.90
SamuelB2-challenge-010 category1 challenge-010 4.0 4 31 3 27 1 0.90
SamuelB3-challenge-010 category1 challenge-010 4.0 4 31 3 27 1 0.90
seeslab-challenge-010 category1 challenge-010 - - 192 - - - -
CStacey-challenge-011 category1 challenge-011 1.0 1 4 0 3 1 1.00
kai-challenge-011 category1 challenge-011 2.0 2 13983 1 13981 1 1.00
kai112-challenge-011 category1 challenge-011 2.0 2 34866 1 34864 1 1.00
Rakesh-challenge-011 category1 challenge-011 - - 136 - - - -
SamuelB-challenge-011 category1 challenge-011 1.0 1 221 0 220 1 1.00
SamuelB2-challenge-011 category1 challenge-011 1.0 1 208 0 207 1 1.00
SamuelB3-challenge-011 category1 challenge-011 1.0 1 208 0 207 1 1.00
seeslab-challenge-011 category1 challenge-011 - - 193 - - - -
CStacey-challenge-012 category1 challenge-012 - - 28 - - - -
kai-challenge-012 category1 challenge-012 4.0 4 4951 3 4947 1 1.00
kai112-challenge-012 category1 challenge-012 2556.0 2556 15827 2555 13271 1 0.84
Rakesh-challenge-012 category1 challenge-012 - - 432 - - - -
SamuelB-challenge-012 category1 challenge-012 9.0 9 463 8 454 1 0.98
SamuelB2-challenge-012 category1 challenge-012 9.0 9 449 8 440 1 0.98
SamuelB3-challenge-012 category1 challenge-012 9.0 9 449 8 440 1 0.98
seeslab-challenge-012 category1 challenge-012 14.0 14 88 13 74 1 0.85
CStacey-challenge-013 category1 challenge-013 1.0 1 47 0 46 1 1.00
kai-challenge-013 category1 challenge-013 6.0 6 932 5 926 1 0.99
kai112-challenge-013 category1 challenge-013 1.0 1 5582 0 5581 1 1.00
Rakesh-challenge-013 category1 challenge-013 - - 426 - - - -
SamuelB-challenge-013 category1 challenge-013 33.0 33 128 32 95 1 0.75
SamuelB2-challenge-013 category1 challenge-013 3.0 3 128 2 125 1 0.98
SamuelB3-challenge-013 category1 challenge-013 3.0 3 128 2 125 1 0.98
seeslab-challenge-013 category1 challenge-013 27.0 27 101 26 74 1 0.74
CStacey-challenge-014 category1 challenge-014 - - 16 - - - -
kai-challenge-014 category1 challenge-014 180.0 180 529 179 349 1 0.66
kai112-challenge-014 category1 challenge-014 118.0 118 4112 117 3994 1 0.97
Rakesh-challenge-014 category1 challenge-014 - - 466 - - - -
SamuelB-challenge-014 category1 challenge-014 8.0 8 81 7 73 1 0.91
SamuelB2-challenge-014 category1 challenge-014 2.0 2 81 1 79 1 0.99
SamuelB3-challenge-014 category1 challenge-014 2.0 2 81 1 79 1 0.99
seeslab-challenge-014 category1 challenge-014 38.0 38 227 37 189 1 0.84
CStacey-challenge-015 category1 challenge-015 - - 16 - - - -
kai-challenge-015 category1 challenge-015 14.0 14 529 13 515 1 0.98
kai112-challenge-015 category1 challenge-015 21.0 21 4112 20 4091 1 1.00
Rakesh-challenge-015 category1 challenge-015 - - 479 - - - -
SamuelB-challenge-015 category1 challenge-015 9.0 9 81 8 72 1 0.90
SamuelB2-challenge-015 category1 challenge-015 10.0 10 81 9 71 1 0.89
SamuelB3-challenge-015 category1 challenge-015 28.0 28 81 27 53 1 0.66
seeslab-challenge-015 category1 challenge-015 4.5 5 226 3 221 2 0.98
CStacey-challenge-016 category1 challenge-016 - - 25 - - - -
kai-challenge-016 category1 challenge-016 1.0 1 1073 0 1072 1 1.00
kai112-challenge-016 category1 challenge-016 1.0 1 4800 0 4799 1 1.00
Rakesh-challenge-016 category1 challenge-016 - - 465 - - - -
SamuelB-challenge-016 category1 challenge-016 59.0 59 162 58 103 1 0.64
SamuelB2-challenge-016 category1 challenge-016 59.0 59 162 58 103 1 0.64
SamuelB3-challenge-016 category1 challenge-016 59.0 59 162 58 103 1 0.64
seeslab-challenge-016 category1 challenge-016 25.0 25 280 24 255 1 0.91
CStacey-challenge-017 category1 challenge-017 2.5 4 31 0 27 4 0.95
kai-challenge-017 category1 challenge-017 1.0 1 2483 0 2482 1 1.00
kai112-challenge-017 category1 challenge-017 19.0 19 11916 18 11897 1 1.00
Rakesh-challenge-017 category1 challenge-017 - - 193 - - - -
SamuelB-challenge-017 category1 challenge-017 1.0 1 293 0 292 1 1.00
SamuelB2-challenge-017 category1 challenge-017 1.0 1 293 0 292 1 1.00
SamuelB3-challenge-017 category1 challenge-017 1.0 1 293 0 292 1 1.00
seeslab-challenge-017 category1 challenge-017 13.0 13 278 12 265 1 0.96
CStacey-challenge-018 category1 challenge-018 - - 53 - - - -
kai-challenge-018 category1 challenge-018 92.0 92 1668 91 1576 1 0.95
kai112-challenge-018 category1 challenge-018 - - 3890 - - - -
Rakesh-challenge-018 category1 challenge-018 - - 218 - - - -
SamuelB-challenge-018 category1 challenge-018 13.0 13 223 12 210 1 0.95
SamuelB2-challenge-018 category1 challenge-018 13.0 13 223 12 210 1 0.95
SamuelB3-challenge-018 category1 challenge-018 13.0 13 223 12 210 1 0.95
seeslab-challenge-018 category1 challenge-018 13.0 13 224 12 211 1 0.95
CStacey-challenge-019 category1 challenge-019 1.0 1 21 0 20 1 1.00
kai-challenge-019 category1 challenge-019 2.0 2 4150 1 4148 1 1.00
kai112-challenge-019 category1 challenge-019 - - 9443 - - - -
Rakesh-challenge-019 category1 challenge-019 - - 2 - - - -
SamuelB-challenge-019 category1 challenge-019 - - 68 - - - -
SamuelB2-challenge-019 category1 challenge-019 - - 68 - - - -
SamuelB3-challenge-019 category1 challenge-019 - - 68 - - - -
seeslab-challenge-019 category1 challenge-019 - - 138 - - - -
CStacey-challenge-020 category1 challenge-020 - - 5 - - - -
kai-challenge-020 category1 challenge-020 42.0 42 7417 41 7375 1 0.99
kai112-challenge-020 category1 challenge-020 - - 12971 - - - -
Rakesh-challenge-020 category1 challenge-020 - - 216 - - - -
SamuelB-challenge-020 category1 challenge-020 3.0 3 125 2 122 1 0.98
SamuelB2-challenge-020 category1 challenge-020 3.0 3 125 2 122 1 0.98
SamuelB3-challenge-020 category1 challenge-020 3.0 3 125 2 122 1 0.98
seeslab-challenge-020 category1 challenge-020 7.0 7 249 6 242 1 0.98
CStacey-challenge-021 category1 challenge-021 4.0 4 125 3 121 1 0.98
kai-challenge-021 category1 challenge-021 372.0 372 13688 371 13316 1 0.97
kai112-challenge-021 category1 challenge-021 3805.0 3805 33603 3804 29798 1 0.89
Rakesh-challenge-021 category1 challenge-021 - - 203 - - - -
SamuelB-challenge-021 category1 challenge-021 - - 77 - - - -
SamuelB2-challenge-021 category1 challenge-021 - - 77 - - - -
SamuelB3-challenge-021 category1 challenge-021 - - 77 - - - -
seeslab-challenge-021 category1 challenge-021 - - 286 - - - -
CStacey-challenge-022 category1 challenge-022 1.5 2 4 0 2 2 0.83
kai-challenge-022 category1 challenge-022 3.0 3 1457 2 1454 1 1.00
kai112-challenge-022 category1 challenge-022 - - 3681 - - - -
Rakesh-challenge-022 category1 challenge-022 - - 519 - - - -
SamuelB-challenge-022 category1 challenge-022 4.0 4 180 3 176 1 0.98
SamuelB2-challenge-022 category1 challenge-022 4.0 4 180 3 176 1 0.98
SamuelB3-challenge-022 category1 challenge-022 4.0 4 180 3 176 1 0.98
seeslab-challenge-022 category1 challenge-022 2.0 2 194 1 192 1 0.99
CStacey-challenge-023 category1 challenge-023 2.5 4 4 0 0 4 0.50
kai-challenge-023 category1 challenge-023 25.0 25 8591 24 8566 1 1.00
kai112-challenge-023 category1 challenge-023 252.0 252 44392 251 44140 1 0.99
Rakesh-challenge-023 category1 challenge-023 - - 223 - - - -
SamuelB-challenge-023 category1 challenge-023 15.0 15 205 14 190 1 0.93
SamuelB2-challenge-023 category1 challenge-023 15.0 15 205 14 190 1 0.93
SamuelB3-challenge-023 category1 challenge-023 15.0 15 205 14 190 1 0.93
seeslab-challenge-023 category1 challenge-023 - - 218 - - - -
CStacey-challenge-024 category1 challenge-024 1.0 1 50 0 49 1 1.00
kai-challenge-024 category1 challenge-024 7.0 7 3561 6 3554 1 1.00
kai112-challenge-024 category1 challenge-024 258.0 258 5509 257 5251 1 0.95
Rakesh-challenge-024 category1 challenge-024 - - 113 - - - -
SamuelB-challenge-024 category1 challenge-024 1.5 2 250 0 248 2 1.00
SamuelB2-challenge-024 category1 challenge-024 1.5 2 250 0 248 2 1.00
SamuelB3-challenge-024 category1 challenge-024 1.5 2 257 0 255 2 1.00
seeslab-challenge-024 category1 challenge-024 1.0 1 267 0 266 1 1.00
CStacey-challenge-025 category1 challenge-025 12.0 13 14 10 1 3 0.15
kai-challenge-025 category1 challenge-025 10.0 10 726 9 716 1 0.99
kai112-challenge-025 category1 challenge-025 - - 6683 - - - -
Rakesh-challenge-025 category1 challenge-025 - - 508 - - - -
SamuelB-challenge-025 category1 challenge-025 - - 187 - - - -
SamuelB2-challenge-025 category1 challenge-025 - - 187 - - - -
SamuelB3-challenge-025 category1 challenge-025 - - 187 - - - -
seeslab-challenge-025 category1 challenge-025 23.0 23 197 22 174 1 0.89
CStacey-challenge-026 category1 challenge-026 32.0 34 348 29 314 5 0.91
kai-challenge-026 category1 challenge-026 2.0 2 3769 1 3767 1 1.00
kai112-challenge-026 category1 challenge-026 1.0 1 6454 0 6453 1 1.00
Rakesh-challenge-026 category1 challenge-026 - - 363 - - - -
SamuelB-challenge-026 category1 challenge-026 - - 228 - - - -
SamuelB2-challenge-026 category1 challenge-026 - - 228 - - - -
SamuelB3-challenge-026 category1 challenge-026 - - 228 - - - -
seeslab-challenge-026 category1 challenge-026 27.0 27 286 26 259 1 0.91
CStacey-challenge-027 category1 challenge-027 1.0 1 8 0 7 1 1.00
kai-challenge-027 category1 challenge-027 - - 4466 - - - -
kai112-challenge-027 category1 challenge-027 122.0 122 25173 121 25051 1 1.00
Rakesh-challenge-027 category1 challenge-027 - - 291 - - - -
SamuelB-challenge-027 category1 challenge-027 8.0 8 347 7 339 1 0.98
SamuelB2-challenge-027 category1 challenge-027 8.0 8 347 7 339 1 0.98
SamuelB3-challenge-027 category1 challenge-027 8.0 8 347 7 339 1 0.98
seeslab-challenge-027 category1 challenge-027 - - 210 - - - -
CStacey-challenge-028 category1 challenge-028 - - 15 - - - -
kai-challenge-028 category1 challenge-028 10.0 10 8326 9 8316 1 1.00
kai112-challenge-028 category1 challenge-028 34.0 34 14596 33 14562 1 1.00
Rakesh-challenge-028 category1 challenge-028 - - 198 - - - -
SamuelB-challenge-028 category1 challenge-028 - - 69 - - - -
SamuelB2-challenge-028 category1 challenge-028 - - 69 - - - -
SamuelB3-challenge-028 category1 challenge-028 - - 69 - - - -
seeslab-challenge-028 category1 challenge-028 106.0 106 289 105 183 1 0.64
CStacey-challenge-029 category1 challenge-029 1.0 1 12 0 11 1 1.00
kai-challenge-029 category1 challenge-029 7.0 7 151 6 144 1 0.96
kai112-challenge-029 category1 challenge-029 - - 226 - - - -
Rakesh-challenge-029 category1 challenge-029 1.0 1 305 0 304 1 1.00
SamuelB-challenge-029 category1 challenge-029 3.0 3 25 2 22 1 0.92
SamuelB2-challenge-029 category1 challenge-029 3.0 3 25 2 22 1 0.92
SamuelB3-challenge-029 category1 challenge-029 3.0 3 25 2 22 1 0.92
seeslab-challenge-029 category1 challenge-029 1.0 1 196 0 195 1 1.00
CStacey-challenge-030 category1 challenge-030 - - 1 - - - -
kai-challenge-030 category1 challenge-030 3.0 3 2923 2 2920 1 1.00
kai112-challenge-030 category1 challenge-030 4.0 4 7716 3 7712 1 1.00
Rakesh-challenge-030 category1 challenge-030 - - 440 - - - -
SamuelB-challenge-030 category1 challenge-030 3.0 3 111 2 108 1 0.98
SamuelB2-challenge-030 category1 challenge-030 4.0 4 111 3 107 1 0.97
SamuelB3-challenge-030 category1 challenge-030 4.0 4 111 3 107 1 0.97
seeslab-challenge-030 category1 challenge-030 - - 44392 - - - -
CStacey-challenge-031 category1 challenge-031 - - 1 - - - -
kai-challenge-031 category1 challenge-031 4.0 4 6913 3 6909 1 1.00
kai112-challenge-031 category1 challenge-031 2.0 2 9929 1 9927 1 1.00
Rakesh-challenge-031 category1 challenge-031 1.0 1 983 0 982 1 1.00
SamuelB-challenge-031 category1 challenge-031 22.0 22 144 21 122 1 0.85
SamuelB2-challenge-031 category1 challenge-031 22.0 22 144 21 122 1 0.85
SamuelB3-challenge-031 category1 challenge-031 22.0 22 144 21 122 1 0.85
seeslab-challenge-031 category1 challenge-031 2.0 2 262 1 260 1 1.00
CStacey-challenge-032 category1 challenge-032 - - 20 - - - -
kai-challenge-032 category1 challenge-032 2.0 2 3278 1 3276 1 1.00
kai112-challenge-032 category1 challenge-032 - - 3953 - - - -
Rakesh-challenge-032 category1 challenge-032 7.0 7 682 6 675 1 0.99
SamuelB-challenge-032 category1 challenge-032 - - 12 - - - -
SamuelB2-challenge-032 category1 challenge-032 - - 12 - - - -
SamuelB3-challenge-032 category1 challenge-032 - - 12 - - - -
seeslab-challenge-032 category1 challenge-032 14.0 14 260 13 246 1 0.95
CStacey-challenge-033 category1 challenge-033 - - 1 - - - -
kai-challenge-033 category1 challenge-033 59.0 59 540 58 481 1 0.89
kai112-challenge-033 category1 challenge-033 - - 2977 - - - -
Rakesh-challenge-033 category1 challenge-033 - - 314 - - - -
SamuelB-challenge-033 category1 challenge-033 - - 190 - - - -
SamuelB2-challenge-033 category1 challenge-033 - - 190 - - - -
SamuelB3-challenge-033 category1 challenge-033 - - 190 - - - -
seeslab-challenge-033 category1 challenge-033 - - 279 - - - -
CStacey-challenge-034 category1 challenge-034 - - 4 - - - -
kai-challenge-034 category1 challenge-034 - - 4163 - - - -
kai112-challenge-034 category1 challenge-034 - - 12157 - - - -
Rakesh-challenge-034 category1 challenge-034 - - 324 - - - -
SamuelB-challenge-034 category1 challenge-034 - - 258 - - - -
SamuelB2-challenge-034 category1 challenge-034 - - 258 - - - -
SamuelB3-challenge-034 category1 challenge-034 - - 261 - - - -
seeslab-challenge-034 category1 challenge-034 66.0 66 275 65 209 1 0.76
CStacey-challenge-035 category1 challenge-035 - - 1 - - - -
kai-challenge-035 category1 challenge-035 1.0 1 19213 0 19212 1 1.00
kai112-challenge-035 category1 challenge-035 - - 32411 - - - -
Rakesh-challenge-035 category1 challenge-035 - - 207 - - - -
SamuelB-challenge-035 category1 challenge-035 31.0 31 149 30 118 1 0.80
SamuelB2-challenge-035 category1 challenge-035 31.0 31 149 30 118 1 0.80
SamuelB3-challenge-035 category1 challenge-035 31.0 31 149 30 118 1 0.80
seeslab-challenge-035 category1 challenge-035 60.0 60 287 59 227 1 0.79
CStacey-challenge-036 category1 challenge-036 3.0 5 17 0 12 5 0.88
kai-challenge-036 category1 challenge-036 2.0 2 3484 1 3482 1 1.00
kai112-challenge-036 category1 challenge-036 1.0 1 13049 0 13048 1 1.00
Rakesh-challenge-036 category1 challenge-036 1.0 1 554 0 553 1 1.00
SamuelB-challenge-036 category1 challenge-036 94.5 118 232 70 114 48 0.60
SamuelB2-challenge-036 category1 challenge-036 84.5 108 231 60 123 48 0.64
SamuelB3-challenge-036 category1 challenge-036 84.5 108 231 60 123 48 0.64
seeslab-challenge-036 category1 challenge-036 5.0 5 230 4 225 1 0.98
CStacey-challenge-037 category1 challenge-037 - - 18 - - - -
kai-challenge-037 category1 challenge-037 14.0 14 5788 13 5774 1 1.00
kai112-challenge-037 category1 challenge-037 1.0 1 8366 0 8365 1 1.00
Rakesh-challenge-037 category1 challenge-037 1.0 1 334 0 333 1 1.00
SamuelB-challenge-037 category1 challenge-037 20.0 20 224 19 204 1 0.91
SamuelB2-challenge-037 category1 challenge-037 20.0 20 224 19 204 1 0.91
SamuelB3-challenge-037 category1 challenge-037 20.0 20 224 19 204 1 0.91
seeslab-challenge-037 category1 challenge-037 2.0 2 249 1 247 1 1.00
CStacey-challenge-038 category1 challenge-038 22.5 24 26 20 2 4 0.14
kai-challenge-038 category1 challenge-038 25.0 25 11493 24 11468 1 1.00
kai112-challenge-038 category1 challenge-038 1.0 1 17406 0 17405 1 1.00
Rakesh-challenge-038 category1 challenge-038 2.0 2 407 1 405 1 1.00
SamuelB-challenge-038 category1 challenge-038 29.0 29 106 28 77 1 0.73
SamuelB2-challenge-038 category1 challenge-038 29.0 29 106 28 77 1 0.73
SamuelB3-challenge-038 category1 challenge-038 29.0 29 106 28 77 1 0.73
seeslab-challenge-038 category1 challenge-038 1.0 1 268 0 267 1 1.00
CStacey-challenge-039 category1 challenge-039 3.0 4 10 1 6 3 0.78
kai-challenge-039 category1 challenge-039 10.0 10 1910 9 1900 1 1.00
kai112-challenge-039 category1 challenge-039 - - 16329 - - - -
Rakesh-challenge-039 category1 challenge-039 - - 446 - - - -
SamuelB-challenge-039 category1 challenge-039 1.0 1 163 0 162 1 1.00
SamuelB2-challenge-039 category1 challenge-039 1.0 1 163 0 162 1 1.00
SamuelB3-challenge-039 category1 challenge-039 1.0 1 163 0 162 1 1.00
seeslab-challenge-039 category1 challenge-039 12.0 12 295 11 283 1 0.96
CStacey-challenge-040 category1 challenge-040 7.0 8 15 5 7 3 0.57
kai-challenge-040 category1 challenge-040 3.0 3 177 2 174 1 0.99
kai112-challenge-040 category1 challenge-040 - - 456 - - - -
Rakesh-challenge-040 category1 challenge-040 1.0 1 343 0 342 1 1.00
SamuelB-challenge-040 category1 challenge-040 3.5 4 273 2 269 2 0.99
SamuelB2-challenge-040 category1 challenge-040 3.5 4 273 2 269 2 0.99
SamuelB3-challenge-040 category1 challenge-040 3.5 4 273 2 269 2 0.99
seeslab-challenge-040 category1 challenge-040 3.0 3 93 2 90 1 0.98
CStacey-challenge-041 category1 challenge-041 47.0 52 52 41 0 11 0.10
kai-challenge-041 category1 challenge-041 1.0 1 4029 0 4028 1 1.00
kai112-challenge-041 category1 challenge-041 1.0 1 7689 0 7688 1 1.00
Rakesh-challenge-041 category1 challenge-041 - - 413 - - - -
SamuelB-challenge-041 category1 challenge-041 - - 210 - - - -
SamuelB2-challenge-041 category1 challenge-041 - - 210 - - - -
SamuelB3-challenge-041 category1 challenge-041 - - 210 - - - -
seeslab-challenge-041 category1 challenge-041 - - 208 - - - -
CStacey-challenge-042 category1 challenge-042 - - 10 - - - -
kai-challenge-042 category1 challenge-042 1.0 1 529 0 528 1 1.00
kai112-challenge-042 category1 challenge-042 - - 29106 - - - -
Rakesh-challenge-042 category1 challenge-042 - - 86 - - - -
SamuelB-challenge-042 category1 challenge-042 - - 22 - - - -
SamuelB2-challenge-042 category1 challenge-042 - - 22 - - - -
SamuelB3-challenge-042 category1 challenge-042 - - 22 - - - -
seeslab-challenge-042 category1 challenge-042 23.0 23 236 22 213 1 0.91
CStacey-challenge-043 category1 challenge-043 - - 4 - - - -
kai-challenge-043 category1 challenge-043 - - 11148 - - - -
kai112-challenge-043 category1 challenge-043 - - 42989 - - - -
Rakesh-challenge-043 category1 challenge-043 - - 357 - - - -
SamuelB-challenge-043 category1 challenge-043 - - 84 - - - -
SamuelB2-challenge-043 category1 challenge-043 - - 84 - - - -
SamuelB3-challenge-043 category1 challenge-043 - - 84 - - - -
seeslab-challenge-043 category1 challenge-043 - - 296 - - - -
CStacey-challenge-044 category1 challenge-044 - - 1 - - - -
kai-challenge-044 category1 challenge-044 4.0 4 2847 3 2843 1 1.00
kai112-challenge-044 category1 challenge-044 86.0 86 8715 85 8629 1 0.99
Rakesh-challenge-044 category1 challenge-044 - - 91 - - - -
SamuelB-challenge-044 category1 challenge-044 - - 27 - - - -
SamuelB2-challenge-044 category1 challenge-044 - - 27 - - - -
SamuelB3-challenge-044 category1 challenge-044 - - 27 - - - -
seeslab-challenge-044 category1 challenge-044 - - 198 - - - -
CStacey-challenge-045 category1 challenge-045 - - 1 - - - -
kai-challenge-045 category1 challenge-045 - - 1510 - - - -
kai112-challenge-045 category1 challenge-045 - - 4357 - - - -
Rakesh-challenge-045 category1 challenge-045 - - 907 - - - -
SamuelB-challenge-045 category1 challenge-045 - - 269 - - - -
SamuelB2-challenge-045 category1 challenge-045 - - 269 - - - -
SamuelB3-challenge-045 category1 challenge-045 - - 270 - - - -
seeslab-challenge-045 category1 challenge-045 - - 84 - - - -

Table legend:

rank
Absolute rank of correct solution (average of tied ranks)
rankmax
Absolute rank of correct solution (max of tied ranks, worst case)
tc
Total number of candidates
bc
Number of candidates with a score better than correct solution
wc
Number of candidates with a score worse than correct solution
ec
Number of candidates with same score as the correct solution
rrp
Relative ranking position (1.0 is good, 0.0 is not)
p
Score of correct solution
wbc
Sum of scores better than correct solution
wwc
Sum of scores worse than correct solution
wec
Sum of scores equal to correct solution
wrrp
RRP weighted by the scores (1 is good)