News

March 29th, 2017
The CASMI 2016 Cat 2+3 paper is out!

Jan 20th, 2017
Organisation of CASMI 2017 is underway, stay tuned!

Dec 4th, 2016
The MS1 peak lists for Category 2+3 have been added for completeness.

May 6th, 2016
The winners and full results are available.

April 25th, 2016
The solutions are public now.

April 18th, 2016
The contest is closed now, the results are fantastic and will be opened soon!

April 9th, 2016
All teams who submit before the deadline April 11th will be allowed to update the submission until Friday 15th.

February 12th, 2016
New categories 2 and 3 and data for automatic methods released. 10 new challenges in category 1.

January 25th, 2016
E. Schymanski and S. Neumann joined the organising team, additional contest data coming soon.

January 11th, 2016
New CASMI 2016 raw data files are available.


Results in Category 3

Details per Challenge and Participant. See legend at bottom for more details

The details table is also available as CSV download. The InChIKey block1 filtered submissions used in the automatic evaluation are available for download, as well as the original submissions.

participant challenge rank rankmax tc bc wc ec rrp p wbc wwc wec wrrp
felicityallencfmretrained-challenge-100 challenge-100 7.0 7 1547 6 1540 1 1.00 0.00 0.43 0.57 0.00 0.57
felicityallencfmretrained-challenge-101 challenge-101 10.0 10 740 9 730 1 0.99 0.00 0.53 0.47 0.00 0.47
felicityallencfmretrained-challenge-102 challenge-102 2.0 2 258 1 256 1 1.00 0.12 0.34 0.54 0.00 0.66
felicityallencfmretrained-challenge-103 challenge-103 6.0 6 510 5 504 1 0.99 0.03 0.32 0.65 0.00 0.68
felicityallencfmretrained-challenge-104 challenge-104 3.0 3 46 2 43 1 0.96 0.03 0.06 0.91 0.00 0.94
felicityallencfmretrained-challenge-105 challenge-105 1.0 1 1421 0 1420 1 1.00 0.46 0.00 0.54 0.00 1.00
felicityallencfmretrained-challenge-106 challenge-106 2.0 2 1012 1 1010 1 1.00 0.02 0.92 0.06 0.00 0.08
felicityallencfmretrained-challenge-107 challenge-107 1.0 1 296 0 295 1 1.00 0.22 0.00 0.78 0.00 1.00
felicityallencfmretrained-challenge-108 challenge-108 1.0 1 1873 0 1872 1 1.00 0.32 0.00 0.68 0.00 1.00
felicityallencfmretrained-challenge-109 challenge-109 1.0 1 2742 0 2741 1 1.00 0.19 0.00 0.81 0.00 1.00
felicityallencfmretrained-challenge-010 challenge-010 6.0 10 45 1 35 9 0.89 0.04 0.04 0.64 0.29 0.67
felicityallencfmretrained-challenge-110 challenge-110 1.0 1 2262 0 2261 1 1.00 0.19 0.00 0.81 0.00 1.00
felicityallencfmretrained-challenge-111 challenge-111 1.0 1 1306 0 1305 1 1.00 0.35 0.00 0.65 0.00 1.00
felicityallencfmretrained-challenge-112 challenge-112 1.0 1 2409 0 2408 1 1.00 0.18 0.00 0.82 0.00 1.00
felicityallencfmretrained-challenge-113 challenge-113 4.0 4 39 3 35 1 0.92 0.14 0.41 0.46 0.00 0.59
felicityallencfmretrained-challenge-114 challenge-114 1.0 1 920 0 919 1 1.00 0.13 0.00 0.87 0.00 1.00
felicityallencfmretrained-challenge-115 challenge-115 1.0 1 557 0 556 1 1.00 0.32 0.00 0.68 0.00 1.00
felicityallencfmretrained-challenge-116 challenge-116 2.0 2 136 1 134 1 0.99 0.02 0.02 0.97 0.00 0.98
felicityallencfmretrained-challenge-117 challenge-117 1.0 1 2009 0 2008 1 1.00 0.16 0.00 0.84 0.00 1.00
felicityallencfmretrained-challenge-118 challenge-118 1.0 1 3291 0 3290 1 1.00 0.13 0.00 0.87 0.00 1.00
felicityallencfmretrained-challenge-119 challenge-119 45.0 45 169 44 124 1 0.74 0.01 0.50 0.49 0.00 0.50
felicityallencfmretrained-challenge-011 challenge-011 1.0 1 5341 0 5340 1 1.00 0.73 0.00 0.27 0.00 1.00
felicityallencfmretrained-challenge-120 challenge-120 2.0 2 717 1 715 1 1.00 0.08 0.15 0.77 0.00 0.85
felicityallencfmretrained-challenge-121 challenge-121 3.0 3 1702 2 1699 1 1.00 0.06 0.28 0.66 0.00 0.72
felicityallencfmretrained-challenge-122 challenge-122 1.0 1 449 0 448 1 1.00 0.80 0.00 0.20 0.00 1.00
felicityallencfmretrained-challenge-123 challenge-123 1.0 1 16 0 15 1 1.00 0.81 0.00 0.19 0.00 1.00
felicityallencfmretrained-challenge-124 challenge-124 1.0 1 6145 0 6144 1 1.00 0.11 0.00 0.89 0.00 1.00
felicityallencfmretrained-challenge-125 challenge-125 1.0 1 248 0 247 1 1.00 0.07 0.00 0.93 0.00 1.00
felicityallencfmretrained-challenge-126 challenge-126 6.0 6 1137 5 1131 1 1.00 0.00 0.16 0.84 0.00 0.84
felicityallencfmretrained-challenge-127 challenge-127 1.0 1 120 0 119 1 1.00 0.02 0.00 0.98 0.00 1.00
felicityallencfmretrained-challenge-128 challenge-128 1.0 1 266 0 265 1 1.00 0.18 0.00 0.82 0.00 1.00
felicityallencfmretrained-challenge-129 challenge-129 28.0 28 1672 27 1644 1 0.98 0.00 0.14 0.86 0.00 0.86
felicityallencfmretrained-challenge-012 challenge-012 1.0 1 4456 0 4455 1 1.00 0.04 0.00 0.96 0.00 1.00
felicityallencfmretrained-challenge-130 challenge-130 1.0 1 1857 0 1856 1 1.00 0.55 0.00 0.45 0.00 1.00
felicityallencfmretrained-challenge-131 challenge-131 28.0 28 2205 27 2177 1 0.99 0.00 0.53 0.47 0.00 0.47
felicityallencfmretrained-challenge-132 challenge-132 1.0 1 877 0 876 1 1.00 0.62 0.00 0.38 0.00 1.00
felicityallencfmretrained-challenge-133 challenge-133 1.0 1 1034 0 1033 1 1.00 0.51 0.00 0.49 0.00 1.00
felicityallencfmretrained-challenge-134 challenge-134 1.0 1 1181 0 1180 1 1.00 0.28 0.00 0.72 0.00 1.00
felicityallencfmretrained-challenge-135 challenge-135 2.0 2 200 1 198 1 0.99 0.00 0.97 0.02 0.00 0.03
felicityallencfmretrained-challenge-136 challenge-136 21.0 21 112 20 91 1 0.82 0.01 0.49 0.50 0.00 0.51
felicityallencfmretrained-challenge-137 challenge-137 1.0 1 5890 0 5889 1 1.00 0.22 0.00 0.78 0.00 1.00
felicityallencfmretrained-challenge-138 challenge-138 2.0 2 1207 1 1205 1 1.00 0.03 0.79 0.19 0.00 0.21
felicityallencfmretrained-challenge-139 challenge-139 1.0 1 2884 0 2883 1 1.00 0.28 0.00 0.72 0.00 1.00
felicityallencfmretrained-challenge-013 challenge-013 2.0 2 1008 1 1006 1 1.00 0.00 0.06 0.94 0.00 0.94
felicityallencfmretrained-challenge-140 challenge-140 8.0 8 774 7 766 1 0.99 0.00 0.41 0.58 0.00 0.59
felicityallencfmretrained-challenge-141 challenge-141 6.0 6 1355 5 1349 1 1.00 0.03 0.26 0.71 0.00 0.74
felicityallencfmretrained-challenge-142 challenge-142 1.0 1 2177 0 2176 1 1.00 0.10 0.00 0.90 0.00 1.00
felicityallencfmretrained-challenge-143 challenge-143 3.0 3 3248 2 3245 1 1.00 0.04 0.15 0.81 0.00 0.85
felicityallencfmretrained-challenge-144 challenge-144 2.0 2 803 1 801 1 1.00 0.06 0.06 0.88 0.00 0.94
felicityallencfmretrained-challenge-145 challenge-145 1.0 1 1958 0 1957 1 1.00 0.36 0.00 0.64 0.00 1.00
felicityallencfmretrained-challenge-146 challenge-146 2.0 2 1445 1 1443 1 1.00 0.06 0.19 0.75 0.00 0.81
felicityallencfmretrained-challenge-147 challenge-147 1.0 1 172 0 171 1 1.00 0.62 0.00 0.38 0.00 1.00
felicityallencfmretrained-challenge-148 challenge-148 2.0 2 2446 1 2444 1 1.00 0.09 0.09 0.82 0.00 0.91
felicityallencfmretrained-challenge-149 challenge-149 1.0 1 271 0 270 1 1.00 0.27 0.00 0.73 0.00 1.00
felicityallencfmretrained-challenge-014 challenge-014 19.5 20 228 18 208 2 0.92 0.01 0.18 0.81 0.01 0.81
felicityallencfmretrained-challenge-150 challenge-150 1.0 1 247 0 246 1 1.00 0.54 0.00 0.46 0.00 1.00
felicityallencfmretrained-challenge-151 challenge-151 1.0 1 2446 0 2445 1 1.00 0.23 0.00 0.77 0.00 1.00
felicityallencfmretrained-challenge-152 challenge-152 1.0 1 4075 0 4074 1 1.00 0.23 0.00 0.77 0.00 1.00
felicityallencfmretrained-challenge-153 challenge-153 3.0 3 378 2 375 1 0.99 0.01 0.02 0.97 0.00 0.98
felicityallencfmretrained-challenge-154 challenge-154 19.0 19 630 18 611 1 0.97 0.00 0.35 0.65 0.00 0.65
felicityallencfmretrained-challenge-155 challenge-155 1.0 1 585 0 584 1 1.00 0.11 0.00 0.89 0.00 1.00
felicityallencfmretrained-challenge-156 challenge-156 1.0 1 1863 0 1862 1 1.00 0.64 0.00 0.36 0.00 1.00
felicityallencfmretrained-challenge-157 challenge-157 15.0 15 3384 14 3369 1 1.00 0.01 0.27 0.72 0.00 0.73
felicityallencfmretrained-challenge-158 challenge-158 1.0 1 112 0 111 1 1.00 0.83 0.00 0.17 0.00 1.00
felicityallencfmretrained-challenge-159 challenge-159 32.0 32 1027 31 995 1 0.97 0.00 0.97 0.03 0.00 0.03
felicityallencfmretrained-challenge-015 challenge-015 1.0 1 1489 0 1488 1 1.00 0.04 0.00 0.96 0.00 1.00
felicityallencfmretrained-challenge-160 challenge-160 4.0 4 188 3 184 1 0.98 0.05 0.24 0.71 0.00 0.76
felicityallencfmretrained-challenge-161 challenge-161 1.0 1 762 0 761 1 1.00 0.12 0.00 0.88 0.00 1.00
felicityallencfmretrained-challenge-162 challenge-162 7.0 7 219 6 212 1 0.97 0.04 0.53 0.43 0.00 0.47
felicityallencfmretrained-challenge-163 challenge-163 3.0 3 3564 2 3561 1 1.00 0.02 0.06 0.92 0.00 0.94
felicityallencfmretrained-challenge-164 challenge-164 1.0 1 50 0 49 1 1.00 0.81 0.00 0.19 0.00 1.00
felicityallencfmretrained-challenge-165 challenge-165 1.0 1 218 0 217 1 1.00 0.29 0.00 0.71 0.00 1.00
felicityallencfmretrained-challenge-166 challenge-166 1.0 1 925 0 924 1 1.00 0.10 0.00 0.90 0.00 1.00
felicityallencfmretrained-challenge-167 challenge-167 1.0 1 373 0 372 1 1.00 0.11 0.00 0.89 0.00 1.00
felicityallencfmretrained-challenge-168 challenge-168 2.0 2 793 1 791 1 1.00 0.32 0.48 0.20 0.00 0.52
felicityallencfmretrained-challenge-169 challenge-169 1.0 1 1953 0 1952 1 1.00 0.79 0.00 0.21 0.00 1.00
felicityallencfmretrained-challenge-016 challenge-016 1.0 1 1857 0 1856 1 1.00 0.08 0.00 0.92 0.00 1.00
felicityallencfmretrained-challenge-170 challenge-170 1.0 1 2667 0 2666 1 1.00 0.14 0.00 0.86 0.00 1.00
felicityallencfmretrained-challenge-171 challenge-171 34.0 34 131 33 97 1 0.75 0.01 0.69 0.30 0.00 0.31
felicityallencfmretrained-challenge-172 challenge-172 1.0 1 474 0 473 1 1.00 0.10 0.00 0.90 0.00 1.00
felicityallencfmretrained-challenge-173 challenge-173 1.0 1 4048 0 4047 1 1.00 0.23 0.00 0.77 0.00 1.00
felicityallencfmretrained-challenge-174 challenge-174 1.0 1 6912 0 6911 1 1.00 0.05 0.00 0.95 0.00 1.00
felicityallencfmretrained-challenge-175 challenge-175 13.0 13 536 12 523 1 0.98 0.00 0.53 0.47 0.00 0.47
felicityallencfmretrained-challenge-176 challenge-176 1.0 1 1495 0 1494 1 1.00 0.77 0.00 0.23 0.00 1.00
felicityallencfmretrained-challenge-177 challenge-177 1.0 1 985 0 984 1 1.00 0.24 0.00 0.76 0.00 1.00
felicityallencfmretrained-challenge-178 challenge-178 2.0 2 7849 1 7847 1 1.00 0.01 0.03 0.96 0.00 0.97
felicityallencfmretrained-challenge-179 challenge-179 1.0 1 1500 0 1499 1 1.00 0.41 0.00 0.59 0.00 1.00
felicityallencfmretrained-challenge-017 challenge-017 1.0 1 1051 0 1050 1 1.00 0.12 0.00 0.88 0.00 1.00
felicityallencfmretrained-challenge-180 challenge-180 22.0 22 536 21 514 1 0.96 0.00 0.52 0.48 0.00 0.48
felicityallencfmretrained-challenge-181 challenge-181 1.0 1 153 0 152 1 1.00 0.87 0.00 0.13 0.00 1.00
felicityallencfmretrained-challenge-182 challenge-182 1.0 1 956 0 955 1 1.00 0.29 0.00 0.71 0.00 1.00
felicityallencfmretrained-challenge-183 challenge-183 1.0 1 474 0 473 1 1.00 0.09 0.00 0.91 0.00 1.00
felicityallencfmretrained-challenge-184 challenge-184 1.0 1 357 0 356 1 1.00 0.06 0.00 0.94 0.00 1.00
felicityallencfmretrained-challenge-185 challenge-185 1.0 1 1125 0 1124 1 1.00 0.95 0.00 0.05 0.00 1.00
felicityallencfmretrained-challenge-186 challenge-186 2.0 2 730 1 728 1 1.00 0.11 0.11 0.79 0.00 0.89
felicityallencfmretrained-challenge-187 challenge-187 6.0 6 2849 5 2843 1 1.00 0.02 0.25 0.73 0.00 0.75
felicityallencfmretrained-challenge-188 challenge-188 14.0 14 667 13 653 1 0.98 0.00 0.87 0.13 0.00 0.13
felicityallencfmretrained-challenge-189 challenge-189 1.0 1 1555 0 1554 1 1.00 0.25 0.00 0.75 0.00 1.00
felicityallencfmretrained-challenge-018 challenge-018 1.0 1 51 0 50 1 1.00 0.34 0.00 0.66 0.00 1.00
felicityallencfmretrained-challenge-190 challenge-190 1.0 1 190 0 189 1 1.00 0.94 0.00 0.06 0.00 1.00
felicityallencfmretrained-challenge-191 challenge-191 1.0 1 406 0 405 1 1.00 0.20 0.00 0.80 0.00 1.00
felicityallencfmretrained-challenge-192 challenge-192 2.0 2 556 1 554 1 1.00 0.28 0.41 0.31 0.00 0.59
felicityallencfmretrained-challenge-193 challenge-193 1.0 1 104 0 103 1 1.00 0.08 0.00 0.92 0.00 1.00
felicityallencfmretrained-challenge-194 challenge-194 1.0 1 207 0 206 1 1.00 0.29 0.00 0.71 0.00 1.00
felicityallencfmretrained-challenge-195 challenge-195 1.0 1 1061 0 1060 1 1.00 0.15 0.00 0.85 0.00 1.00
felicityallencfmretrained-challenge-196 challenge-196 1.0 1 301 0 300 1 1.00 0.41 0.00 0.59 0.00 1.00
felicityallencfmretrained-challenge-197 challenge-197 2.0 2 2124 1 2122 1 1.00 0.04 0.04 0.93 0.00 0.96
felicityallencfmretrained-challenge-198 challenge-198 13.0 13 75 12 62 1 0.84 0.00 0.99 0.01 0.00 0.01
felicityallencfmretrained-challenge-199 challenge-199 1.0 1 782 0 781 1 1.00 0.00 0.00 1.00 0.00 1.00
felicityallencfmretrained-challenge-019 challenge-019 1.0 1 5040 0 5039 1 1.00 0.04 0.00 0.96 0.00 1.00
felicityallencfmretrained-challenge-001 challenge-001 1.5 2 420 0 418 2 1.00 0.08 0.00 0.85 0.08 0.92
felicityallencfmretrained-challenge-200 challenge-200 2.0 2 818 1 816 1 1.00 0.15 0.15 0.71 0.00 0.85
felicityallencfmretrained-challenge-201 challenge-201 1.0 1 4322 0 4321 1 1.00 0.33 0.00 0.67 0.00 1.00
felicityallencfmretrained-challenge-202 challenge-202 2.0 2 3893 1 3891 1 1.00 0.20 0.39 0.41 0.00 0.61
felicityallencfmretrained-challenge-203 challenge-203 1.0 1 246 0 245 1 1.00 0.99 0.00 0.01 0.00 1.00
felicityallencfmretrained-challenge-204 challenge-204 5.0 5 4874 4 4869 1 1.00 0.00 0.01 0.99 0.00 0.99
felicityallencfmretrained-challenge-205 challenge-205 4.0 4 858 3 854 1 1.00 0.02 0.16 0.82 0.00 0.84
felicityallencfmretrained-challenge-206 challenge-206 1.0 1 429 0 428 1 1.00 0.40 0.00 0.60 0.00 1.00
felicityallencfmretrained-challenge-207 challenge-207 19.0 19 580 18 561 1 0.97 0.01 0.38 0.60 0.00 0.62
felicityallencfmretrained-challenge-208 challenge-208 1.0 1 11 0 10 1 1.00 0.98 0.00 0.02 0.00 1.00
felicityallencfmretrained-challenge-020 challenge-020 3.0 3 598 2 595 1 1.00 0.03 0.07 0.91 0.00 0.93
felicityallencfmretrained-challenge-021 challenge-021 1.0 1 2318 0 2317 1 1.00 0.06 0.00 0.94 0.00 1.00
felicityallencfmretrained-challenge-022 challenge-022 7.0 7 15 6 8 1 0.57 0.01 0.92 0.07 0.00 0.08
felicityallencfmretrained-challenge-023 challenge-023 1.5 2 2413 0 2411 2 1.00 0.04 0.00 0.93 0.04 0.96
felicityallencfmretrained-challenge-024 challenge-024 1.0 1 492 0 491 1 1.00 0.12 0.00 0.88 0.00 1.00
felicityallencfmretrained-challenge-025 challenge-025 1.0 1 551 0 550 1 1.00 0.25 0.00 0.75 0.00 1.00
felicityallencfmretrained-challenge-026 challenge-026 1.5 2 139 0 137 2 1.00 0.02 0.00 0.97 0.02 0.98
felicityallencfmretrained-challenge-027 challenge-027 94.5 95 361 93 266 2 0.74 0.00 0.82 0.17 0.00 0.18
felicityallencfmretrained-challenge-028 challenge-028 7.0 7 545 6 538 1 0.99 0.02 0.17 0.81 0.00 0.83
felicityallencfmretrained-challenge-029 challenge-029 1.0 1 25 0 24 1 1.00 0.36 0.00 0.64 0.00 1.00
felicityallencfmretrained-challenge-002 challenge-002 2.0 3 78 0 75 3 0.99 0.20 0.00 0.39 0.40 0.60
felicityallencfmretrained-challenge-030 challenge-030 1.0 1 2197 0 2196 1 1.00 0.03 0.00 0.97 0.00 1.00
felicityallencfmretrained-challenge-031 challenge-031 1.0 1 25 0 24 1 1.00 0.32 0.00 0.68 0.00 1.00
felicityallencfmretrained-challenge-032 challenge-032 42.0 61 112 22 51 39 0.63 0.01 0.41 0.30 0.28 0.31
felicityallencfmretrained-challenge-033 challenge-033 4.0 4 239 3 235 1 0.99 0.06 0.27 0.68 0.00 0.73
felicityallencfmretrained-challenge-034 challenge-034 3.0 3 1973 2 1970 1 1.00 0.01 0.06 0.93 0.00 0.94
felicityallencfmretrained-challenge-035 challenge-035 1.0 1 1040 0 1039 1 1.00 0.03 0.00 0.97 0.00 1.00
felicityallencfmretrained-challenge-036 challenge-036 1170.5 1172 1212 1168 40 4 0.03 0.00 0.99 0.00 0.00 0.00
felicityallencfmretrained-challenge-037 challenge-037 1.0 1 89 0 88 1 1.00 0.24 0.00 0.76 0.00 1.00
felicityallencfmretrained-challenge-038 challenge-038 1.0 1 337 0 336 1 1.00 0.46 0.00 0.54 0.00 1.00
felicityallencfmretrained-challenge-039 challenge-039 5.0 5 1358 4 1353 1 1.00 0.02 0.12 0.87 0.00 0.88
felicityallencfmretrained-challenge-003 challenge-003 7.5 13 145 1 132 12 0.95 0.01 0.14 0.69 0.15 0.71
felicityallencfmretrained-challenge-040 challenge-040 2.0 2 279 1 277 1 1.00 0.04 0.12 0.83 0.00 0.88
felicityallencfmretrained-challenge-041 challenge-041 437.0 445 954 428 509 17 0.54 0.00 0.89 0.11 0.01 0.11
felicityallencfmretrained-challenge-042 challenge-042 1.5 2 9 0 7 2 0.94 0.46 0.00 0.08 0.46 0.54
felicityallencfmretrained-challenge-043 challenge-043 1.5 2 531 0 529 2 1.00 0.07 0.00 0.86 0.07 0.93
felicityallencfmretrained-challenge-044 challenge-044 1.0 1 1716 0 1715 1 1.00 0.15 0.00 0.85 0.00 1.00
felicityallencfmretrained-challenge-045 challenge-045 3.0 3 384 2 381 1 0.99 0.06 0.28 0.66 0.00 0.72
felicityallencfmretrained-challenge-046 challenge-046 8.5 11 825 5 814 6 0.99 0.02 0.21 0.70 0.08 0.71
felicityallencfmretrained-challenge-047 challenge-047 136.0 209 381 62 172 147 0.64 0.00 0.25 0.34 0.41 0.34
felicityallencfmretrained-challenge-048 challenge-048 1.0 1 20 0 19 1 1.00 0.17 0.00 0.83 0.00 1.00
felicityallencfmretrained-challenge-049 challenge-049 1.5 2 137 0 135 2 1.00 0.09 0.00 0.81 0.09 0.91
felicityallencfmretrained-challenge-004 challenge-004 1.5 2 36 0 34 2 0.99 0.20 0.00 0.60 0.20 0.80
felicityallencfmretrained-challenge-050 challenge-050 1.0 1 1861 0 1860 1 1.00 0.17 0.00 0.83 0.00 1.00
felicityallencfmretrained-challenge-051 challenge-051 1.0 1 1521 0 1520 1 1.00 0.13 0.00 0.87 0.00 1.00
felicityallencfmretrained-challenge-052 challenge-052 1.0 1 354 0 353 1 1.00 0.07 0.00 0.93 0.00 1.00
felicityallencfmretrained-challenge-053 challenge-053 1.0 1 2656 0 2655 1 1.00 0.07 0.00 0.93 0.00 1.00
felicityallencfmretrained-challenge-054 challenge-054 3.0 3 215 2 212 1 0.99 0.07 0.14 0.79 0.00 0.86
felicityallencfmretrained-challenge-055 challenge-055 1.0 1 1532 0 1531 1 1.00 0.06 0.00 0.94 0.00 1.00
felicityallencfmretrained-challenge-056 challenge-056 1.0 1 971 0 970 1 1.00 0.28 0.00 0.72 0.00 1.00
felicityallencfmretrained-challenge-057 challenge-057 1.0 1 163 0 162 1 1.00 0.70 0.00 0.30 0.00 1.00
felicityallencfmretrained-challenge-058 challenge-058 1.0 1 155 0 154 1 1.00 0.14 0.00 0.86 0.00 1.00
felicityallencfmretrained-challenge-059 challenge-059 1.0 1 2214 0 2213 1 1.00 0.04 0.00 0.96 0.00 1.00
felicityallencfmretrained-challenge-005 challenge-005 1.0 1 365 0 364 1 1.00 0.22 0.00 0.78 0.00 1.00
felicityallencfmretrained-challenge-060 challenge-060 2.0 2 784 1 782 1 1.00 0.06 0.08 0.85 0.00 0.92
felicityallencfmretrained-challenge-061 challenge-061 1.0 1 1123 0 1122 1 1.00 0.20 0.00 0.80 0.00 1.00
felicityallencfmretrained-challenge-062 challenge-062 1.0 1 2863 0 2862 1 1.00 0.21 0.00 0.79 0.00 1.00
felicityallencfmretrained-challenge-063 challenge-063 1.0 1 190 0 189 1 1.00 0.48 0.00 0.52 0.00 1.00
felicityallencfmretrained-challenge-064 challenge-064 1.0 1 54 0 53 1 1.00 0.36 0.00 0.64 0.00 1.00
felicityallencfmretrained-challenge-065 challenge-065 2.0 2 563 1 561 1 1.00 0.12 0.17 0.71 0.00 0.83
felicityallencfmretrained-challenge-066 challenge-066 4.5 8 169 0 161 8 0.98 0.01 0.00 0.90 0.09 0.91
felicityallencfmretrained-challenge-067 challenge-067 1.0 1 204 0 203 1 1.00 0.11 0.00 0.89 0.00 1.00
felicityallencfmretrained-challenge-068 challenge-068 1.0 1 5 0 4 1 1.00 0.38 0.00 0.62 0.00 1.00
felicityallencfmretrained-challenge-069 challenge-069 1.0 1 381 0 380 1 1.00 0.05 0.00 0.95 0.00 1.00
felicityallencfmretrained-challenge-006 challenge-006 14.0 14 527 13 513 1 0.98 0.01 0.44 0.55 0.00 0.56
felicityallencfmretrained-challenge-070 challenge-070 1.0 1 816 0 815 1 1.00 0.09 0.00 0.91 0.00 1.00
felicityallencfmretrained-challenge-071 challenge-071 1.0 1 11 0 10 1 1.00 0.64 0.00 0.36 0.00 1.00
felicityallencfmretrained-challenge-072 challenge-072 1.0 1 68 0 67 1 1.00 0.07 0.00 0.93 0.00 1.00
felicityallencfmretrained-challenge-073 challenge-073 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
felicityallencfmretrained-challenge-074 challenge-074 1.0 1 432 0 431 1 1.00 0.15 0.00 0.85 0.00 1.00
felicityallencfmretrained-challenge-075 challenge-075 1.0 1 33 0 32 1 1.00 0.76 0.00 0.24 0.00 1.00
felicityallencfmretrained-challenge-076 challenge-076 1.0 1 126 0 125 1 1.00 0.16 0.00 0.84 0.00 1.00
felicityallencfmretrained-challenge-077 challenge-077 2.0 2 126 1 124 1 0.99 0.14 0.15 0.71 0.00 0.85
felicityallencfmretrained-challenge-078 challenge-078 7.0 9 116 4 107 5 0.95 0.01 0.14 0.79 0.05 0.80
felicityallencfmretrained-challenge-079 challenge-079 1.0 1 19 0 18 1 1.00 0.83 0.00 0.17 0.00 1.00
felicityallencfmretrained-challenge-007 challenge-007 1.0 1 449 0 448 1 1.00 0.14 0.00 0.86 0.00 1.00
felicityallencfmretrained-challenge-080 challenge-080 1.0 1 27 0 26 1 1.00 0.89 0.00 0.11 0.00 1.00
felicityallencfmretrained-challenge-081 challenge-081 2.0 2 155 1 153 1 0.99 0.16 0.32 0.51 0.00 0.68
felicityallencfmretrained-challenge-082 challenge-082 1.0 1 59 0 58 1 1.00 0.37 0.00 0.63 0.00 1.00
felicityallencfmretrained-challenge-083 challenge-083 19.0 19 289 18 270 1 0.94 0.00 0.70 0.30 0.00 0.30
felicityallencfmretrained-challenge-084 challenge-084 1.0 1 149 0 148 1 1.00 0.42 0.00 0.58 0.00 1.00
felicityallencfmretrained-challenge-085 challenge-085 4.0 4 97 3 93 1 0.97 0.06 0.34 0.60 0.00 0.66
felicityallencfmretrained-challenge-086 challenge-086 1.0 1 152 0 151 1 1.00 0.26 0.00 0.74 0.00 1.00
felicityallencfmretrained-challenge-087 challenge-087 85.0 85 166 84 81 1 0.49 0.00 1.00 0.00 0.00 0.00
felicityallencfmretrained-challenge-088 challenge-088 1.0 1 1056 0 1055 1 1.00 0.18 0.00 0.82 0.00 1.00
felicityallencfmretrained-challenge-089 challenge-089 123.0 123 243 122 120 1 0.50 0.00 0.96 0.04 0.00 0.04
felicityallencfmretrained-challenge-008 challenge-008 1.0 1 1681 0 1680 1 1.00 0.03 0.00 0.97 0.00 1.00
felicityallencfmretrained-challenge-090 challenge-090 13.0 13 151 12 138 1 0.92 0.01 0.10 0.89 0.00 0.90
felicityallencfmretrained-challenge-091 challenge-091 14.0 14 524 13 510 1 0.98 0.02 0.58 0.40 0.00 0.42
felicityallencfmretrained-challenge-092 challenge-092 23.0 23 826 22 803 1 0.97 0.00 0.63 0.37 0.00 0.37
felicityallencfmretrained-challenge-093 challenge-093 1.0 1 873 0 872 1 1.00 0.47 0.00 0.53 0.00 1.00
felicityallencfmretrained-challenge-094 challenge-094 1.0 1 219 0 218 1 1.00 0.05 0.00 0.95 0.00 1.00
felicityallencfmretrained-challenge-095 challenge-095 3.0 3 153 2 150 1 0.99 0.02 0.41 0.57 0.00 0.59
felicityallencfmretrained-challenge-096 challenge-096 1.0 1 452 0 451 1 1.00 0.36 0.00 0.64 0.00 1.00
felicityallencfmretrained-challenge-097 challenge-097 1.0 1 980 0 979 1 1.00 0.13 0.00 0.87 0.00 1.00
felicityallencfmretrained-challenge-098 challenge-098 1.0 1 1639 0 1638 1 1.00 0.18 0.00 0.82 0.00 1.00
felicityallencfmretrained-challenge-099 challenge-099 1.0 1 3872 0 3871 1 1.00 0.15 0.00 0.85 0.00 1.00
felicityallencfmretrained-challenge-009 challenge-009 1.0 1 86 0 85 1 1.00 0.33 0.00 0.67 0.00 1.00
tkind-challenge-100 challenge-100 14.0 17 205 10 188 7 0.94 0.01 0.07 0.88 0.04 0.89
tkind-challenge-101 challenge-101 - - 13 - - - - - - - - -
tkind-challenge-102 challenge-102 1.0 1 152 0 151 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-103 challenge-103 13.0 13 21 12 8 1 0.40 0.04 0.62 0.33 0.00 0.38
tkind-challenge-104 challenge-104 1.0 1 46 0 45 1 1.00 0.08 0.00 0.92 0.00 1.00
tkind-challenge-105 challenge-105 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-106 challenge-106 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-107 challenge-107 77.0 79 140 74 61 5 0.45 0.01 0.60 0.36 0.03 0.37
tkind-challenge-108 challenge-108 1.0 1 2 0 1 1 1.00 0.64 0.00 0.36 0.00 1.00
tkind-challenge-109 challenge-109 1.0 1 4 0 3 1 1.00 0.42 0.00 0.58 0.00 1.00
tkind-challenge-010 challenge-010 27.5 42 46 12 4 30 0.41 0.02 0.42 0.04 0.53 0.05
tkind-challenge-110 challenge-110 1.0 1 29 0 28 1 1.00 0.05 0.00 0.95 0.00 1.00
tkind-challenge-111 challenge-111 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-112 challenge-112 1.0 1 104 0 103 1 1.00 0.04 0.00 0.96 0.00 1.00
tkind-challenge-113 challenge-113 1.5 2 6 0 4 2 0.90 0.17 0.00 0.66 0.17 0.83
tkind-challenge-114 challenge-114 1.0 1 5 0 4 1 1.00 0.54 0.00 0.46 0.00 1.00
tkind-challenge-115 challenge-115 1.0 1 5 0 4 1 1.00 0.38 0.00 0.62 0.00 1.00
tkind-challenge-116 challenge-116 35.0 36 103 33 67 3 0.67 0.01 0.40 0.57 0.02 0.58
tkind-challenge-117 challenge-117 1.0 1 98 0 97 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-118 challenge-118 1.0 1 7 0 6 1 1.00 0.35 0.00 0.65 0.00 1.00
tkind-challenge-119 challenge-119 - - 3 - - - - - - - - -
tkind-challenge-011 challenge-011 1.0 1 16 0 15 1 1.00 0.12 0.00 0.88 0.00 1.00
tkind-challenge-120 challenge-120 1.0 1 3 0 2 1 1.00 0.51 0.00 0.49 0.00 1.00
tkind-challenge-121 challenge-121 1.0 1 33 0 32 1 1.00 0.08 0.00 0.92 0.00 1.00
tkind-challenge-122 challenge-122 1.0 1 153 0 152 1 1.00 0.01 0.00 0.99 0.00 1.00
tkind-challenge-123 challenge-123 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-124 challenge-124 1.0 1 112 0 111 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-125 challenge-125 25.0 25 29 24 4 1 0.14 0.03 0.86 0.10 0.00 0.14
tkind-challenge-126 challenge-126 - - 8 - - - - - - - - -
tkind-challenge-127 challenge-127 - - 46 - - - - - - - - -
tkind-challenge-128 challenge-128 3.0 3 113 2 110 1 0.98 0.02 0.04 0.94 0.00 0.96
tkind-challenge-129 challenge-129 3.5 5 104 1 99 4 0.98 0.02 0.02 0.91 0.06 0.92
tkind-challenge-012 challenge-012 1.0 1 866 0 865 1 1.00 0.00 0.00 1.00 0.00 1.00
tkind-challenge-130 challenge-130 1.0 1 4 0 3 1 1.00 0.31 0.00 0.69 0.00 1.00
tkind-challenge-131 challenge-131 - - 55 - - - - - - - - -
tkind-challenge-132 challenge-132 1.0 1 2 0 1 1 1.00 0.64 0.00 0.36 0.00 1.00
tkind-challenge-133 challenge-133 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-134 challenge-134 2.0 2 27 1 25 1 0.96 0.06 0.15 0.79 0.00 0.85
tkind-challenge-135 challenge-135 22.0 22 33 21 11 1 0.34 0.03 0.67 0.30 0.00 0.33
tkind-challenge-136 challenge-136 47.0 48 108 45 60 3 0.57 0.01 0.53 0.44 0.02 0.45
tkind-challenge-137 challenge-137 1.0 1 154 0 153 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-138 challenge-138 1.0 1 2 0 1 1 1.00 0.54 0.00 0.46 0.00 1.00
tkind-challenge-139 challenge-139 1.0 1 3 0 2 1 1.00 0.40 0.00 0.60 0.00 1.00
tkind-challenge-013 challenge-013 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-140 challenge-140 1.0 1 97 0 96 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-141 challenge-141 1.0 1 104 0 103 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-142 challenge-142 1.0 1 32 0 31 1 1.00 0.11 0.00 0.89 0.00 1.00
tkind-challenge-143 challenge-143 1.0 1 85 0 84 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-144 challenge-144 1.0 1 2 0 1 1 1.00 0.51 0.00 0.49 0.00 1.00
tkind-challenge-145 challenge-145 1.0 1 206 0 205 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-146 challenge-146 1.0 1 2 0 1 1 1.00 0.59 0.00 0.41 0.00 1.00
tkind-challenge-147 challenge-147 1.0 1 2 0 1 1 1.00 0.51 0.00 0.49 0.00 1.00
tkind-challenge-148 challenge-148 1.0 1 96 0 95 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-149 challenge-149 1.0 1 101 0 100 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-014 challenge-014 1.0 1 210 0 209 1 1.00 0.01 0.00 0.99 0.00 1.00
tkind-challenge-150 challenge-150 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-151 challenge-151 1.0 1 67 0 66 1 1.00 0.04 0.00 0.96 0.00 1.00
tkind-challenge-152 challenge-152 1.0 1 54 0 53 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-153 challenge-153 6.0 6 22 5 16 1 0.76 0.05 0.28 0.67 0.00 0.72
tkind-challenge-154 challenge-154 23.0 23 176 22 153 1 0.87 0.01 0.18 0.82 0.00 0.82
tkind-challenge-155 challenge-155 1.0 1 52 0 51 1 1.00 0.04 0.00 0.96 0.00 1.00
tkind-challenge-156 challenge-156 1.0 1 8 0 7 1 1.00 0.30 0.00 0.70 0.00 1.00
tkind-challenge-157 challenge-157 8.0 8 37 7 29 1 0.81 0.03 0.22 0.75 0.00 0.78
tkind-challenge-158 challenge-158 1.0 1 71 0 70 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-159 challenge-159 6.0 7 100 4 93 3 0.95 0.01 0.05 0.91 0.02 0.92
tkind-challenge-015 challenge-015 1.0 1 967 0 966 1 1.00 0.00 0.00 1.00 0.00 1.00
tkind-challenge-160 challenge-160 1.0 1 130 0 129 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-161 challenge-161 3.0 3 46 2 43 1 0.96 0.04 0.07 0.89 0.00 0.93
tkind-challenge-162 challenge-162 3.0 3 13 2 10 1 0.83 0.08 0.17 0.75 0.00 0.83
tkind-challenge-163 challenge-163 2.0 2 106 1 104 1 0.99 0.02 0.02 0.96 0.00 0.98
tkind-challenge-164 challenge-164 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-165 challenge-165 1.0 1 16 0 15 1 1.00 0.07 0.00 0.93 0.00 1.00
tkind-challenge-166 challenge-166 1.0 1 248 0 247 1 1.00 0.01 0.00 0.99 0.00 1.00
tkind-challenge-167 challenge-167 1.0 1 29 0 28 1 1.00 0.07 0.00 0.93 0.00 1.00
tkind-challenge-168 challenge-168 1.0 1 130 0 129 1 1.00 0.01 0.00 0.99 0.00 1.00
tkind-challenge-169 challenge-169 1.0 1 90 0 89 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-016 challenge-016 1.0 1 2 0 1 1 1.00 0.62 0.00 0.38 0.00 1.00
tkind-challenge-170 challenge-170 1.0 1 9 0 8 1 1.00 0.25 0.00 0.75 0.00 1.00
tkind-challenge-171 challenge-171 - - 99 - - - - - - - - -
tkind-challenge-172 challenge-172 1.0 1 100 0 99 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-173 challenge-173 1.0 1 9 0 8 1 1.00 0.14 0.00 0.86 0.00 1.00
tkind-challenge-174 challenge-174 1.0 1 2 0 1 1 1.00 0.60 0.00 0.40 0.00 1.00
tkind-challenge-175 challenge-175 66.0 72 109 59 37 13 0.40 0.01 0.61 0.27 0.11 0.28
tkind-challenge-176 challenge-176 1.0 1 97 0 96 1 1.00 0.04 0.00 0.96 0.00 1.00
tkind-challenge-177 challenge-177 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-178 challenge-178 1.0 1 113 0 112 1 1.00 0.05 0.00 0.95 0.00 1.00
tkind-challenge-179 challenge-179 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-017 challenge-017 4.5 5 882 3 877 2 1.00 0.00 0.01 0.99 0.00 0.99
tkind-challenge-180 challenge-180 39.0 45 109 32 64 13 0.65 0.01 0.34 0.54 0.12 0.55
tkind-challenge-181 challenge-181 1.0 1 2 0 1 1 1.00 0.53 0.00 0.47 0.00 1.00
tkind-challenge-182 challenge-182 1.0 1 4 0 3 1 1.00 0.53 0.00 0.47 0.00 1.00
tkind-challenge-183 challenge-183 9.0 9 100 8 91 1 0.92 0.01 0.10 0.89 0.00 0.90
tkind-challenge-184 challenge-184 1.0 1 110 0 109 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-185 challenge-185 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-186 challenge-186 1.0 1 36 0 35 1 1.00 0.04 0.00 0.96 0.00 1.00
tkind-challenge-187 challenge-187 1.0 1 48 0 47 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-188 challenge-188 1.0 1 60 0 59 1 1.00 0.04 0.00 0.96 0.00 1.00
tkind-challenge-189 challenge-189 1.0 1 3 0 2 1 1.00 0.36 0.00 0.64 0.00 1.00
tkind-challenge-018 challenge-018 1.0 1 2 0 1 1 1.00 0.91 0.00 0.09 0.00 1.00
tkind-challenge-190 challenge-190 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-191 challenge-191 1.0 1 47 0 46 1 1.00 0.05 0.00 0.95 0.00 1.00
tkind-challenge-192 challenge-192 1.0 1 5 0 4 1 1.00 0.26 0.00 0.74 0.00 1.00
tkind-challenge-193 challenge-193 7.0 12 12 1 0 11 0.45 0.08 0.09 0.00 0.83 0.08
tkind-challenge-194 challenge-194 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-195 challenge-195 1.0 1 97 0 96 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-196 challenge-196 2.0 2 2 1 0 1 0.00 0.47 0.53 0.00 0.00 0.47
tkind-challenge-197 challenge-197 1.0 1 103 0 102 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-198 challenge-198 - - 39 - - - - - - - - -
tkind-challenge-199 challenge-199 - - 4 - - - - - - - - -
tkind-challenge-019 challenge-019 1.0 1 102 0 101 1 1.00 0.01 0.00 0.99 0.00 1.00
tkind-challenge-001 challenge-001 2.0 2 10 1 8 1 0.89 0.12 0.12 0.76 0.00 0.88
tkind-challenge-200 challenge-200 3.0 3 3 2 0 1 0.00 0.33 0.67 0.00 0.00 0.33
tkind-challenge-201 challenge-201 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-202 challenge-202 1.0 1 2 0 1 1 1.00 0.55 0.00 0.45 0.00 1.00
tkind-challenge-203 challenge-203 1.0 1 2 0 1 1 1.00 0.50 0.00 0.50 0.00 1.00
tkind-challenge-204 challenge-204 - - 2 - - - - - - - - -
tkind-challenge-205 challenge-205 1.0 1 263 0 262 1 1.00 0.01 0.00 0.99 0.00 1.00
tkind-challenge-206 challenge-206 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-207 challenge-207 123.0 123 394 122 271 1 0.69 0.00 0.34 0.66 0.00 0.66
tkind-challenge-208 challenge-208 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-020 challenge-020 2.0 2 106 1 104 1 0.99 0.01 0.01 0.98 0.00 0.99
tkind-challenge-021 challenge-021 1.0 1 4 0 3 1 1.00 0.35 0.00 0.65 0.00 1.00
tkind-challenge-022 challenge-022 4.0 4 25 3 21 1 0.88 0.05 0.16 0.79 0.00 0.84
tkind-challenge-023 challenge-023 2.0 2 172 1 170 1 0.99 0.01 0.02 0.97 0.00 0.98
tkind-challenge-024 challenge-024 1.0 1 27 0 26 1 1.00 0.05 0.00 0.95 0.00 1.00
tkind-challenge-025 challenge-025 1.0 1 5 0 4 1 1.00 0.37 0.00 0.63 0.00 1.00
tkind-challenge-026 challenge-026 44.0 45 103 42 58 3 0.58 0.01 0.46 0.52 0.02 0.53
tkind-challenge-027 challenge-027 94.5 97 199 91 102 6 0.53 0.01 0.60 0.37 0.03 0.37
tkind-challenge-028 challenge-028 1.0 1 92 0 91 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-029 challenge-029 1.0 1 3 0 2 1 1.00 0.34 0.00 0.66 0.00 1.00
tkind-challenge-002 challenge-002 4.0 4 6 3 2 1 0.40 0.23 0.69 0.08 0.00 0.31
tkind-challenge-030 challenge-030 1.0 1 100 0 99 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-031 challenge-031 1.0 1 5 0 4 1 1.00 0.22 0.00 0.78 0.00 1.00
tkind-challenge-032 challenge-032 58.0 59 141 56 82 3 0.59 0.01 0.44 0.54 0.01 0.55
tkind-challenge-033 challenge-033 1.0 1 18 0 17 1 1.00 0.08 0.00 0.92 0.00 1.00
tkind-challenge-034 challenge-034 1.0 1 85 0 84 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-035 challenge-035 6.5 11 109 1 98 10 0.95 0.01 0.02 0.86 0.10 0.87
tkind-challenge-036 challenge-036 1.0 1 2 0 1 1 1.00 0.76 0.00 0.24 0.00 1.00
tkind-challenge-037 challenge-037 1.0 1 14 0 13 1 1.00 0.09 0.00 0.91 0.00 1.00
tkind-challenge-038 challenge-038 1.0 1 53 0 52 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-039 challenge-039 9.5 10 105 8 95 2 0.92 0.01 0.09 0.88 0.01 0.89
tkind-challenge-003 challenge-003 16.5 23 126 9 103 14 0.88 0.01 0.09 0.78 0.12 0.78
tkind-challenge-040 challenge-040 1.0 1 134 0 133 1 1.00 0.01 0.00 0.99 0.00 1.00
tkind-challenge-041 challenge-041 65.5 66 592 64 526 2 0.89 0.00 0.13 0.87 0.00 0.87
tkind-challenge-042 challenge-042 2.0 2 2 1 0 1 0.00 0.50 0.50 0.00 0.00 0.50
tkind-challenge-043 challenge-043 3.0 3 6 2 3 1 0.60 0.24 0.50 0.26 0.00 0.50
tkind-challenge-044 challenge-044 1.0 1 22 0 21 1 1.00 0.11 0.00 0.89 0.00 1.00
tkind-challenge-045 challenge-045 1.0 1 149 0 148 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-046 challenge-046 94.0 99 250 88 151 11 0.63 0.00 0.39 0.57 0.04 0.57
tkind-challenge-047 challenge-047 3.0 3 122 2 119 1 0.98 0.02 0.04 0.95 0.00 0.96
tkind-challenge-048 challenge-048 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-049 challenge-049 1.0 1 15 0 14 1 1.00 0.09 0.00 0.91 0.00 1.00
tkind-challenge-004 challenge-004 2.0 2 36 1 34 1 0.97 0.04 0.04 0.93 0.00 0.96
tkind-challenge-050 challenge-050 1.0 1 9 0 8 1 1.00 0.26 0.00 0.74 0.00 1.00
tkind-challenge-051 challenge-051 1.0 1 103 0 102 1 1.00 0.04 0.00 0.96 0.00 1.00
tkind-challenge-052 challenge-052 18.0 18 287 17 269 1 0.94 0.00 0.07 0.92 0.00 0.93
tkind-challenge-053 challenge-053 1.0 1 9 0 8 1 1.00 0.24 0.00 0.76 0.00 1.00
tkind-challenge-054 challenge-054 1.0 1 68 0 67 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-055 challenge-055 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-056 challenge-056 1.0 1 4 0 3 1 1.00 0.55 0.00 0.45 0.00 1.00
tkind-challenge-057 challenge-057 1.0 1 2 0 1 1 1.00 0.54 0.00 0.46 0.00 1.00
tkind-challenge-058 challenge-058 1.0 1 5 0 4 1 1.00 0.22 0.00 0.78 0.00 1.00
tkind-challenge-059 challenge-059 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-005 challenge-005 1.0 1 103 0 102 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-060 challenge-060 1.0 1 102 0 101 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-061 challenge-061 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-062 challenge-062 1.0 1 98 0 97 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-063 challenge-063 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-064 challenge-064 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-065 challenge-065 1.0 1 5 0 4 1 1.00 0.31 0.00 0.69 0.00 1.00
tkind-challenge-066 challenge-066 1.0 1 2 0 1 1 1.00 0.50 0.00 0.50 0.00 1.00
tkind-challenge-067 challenge-067 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-068 challenge-068 1.0 1 4 0 3 1 1.00 0.46 0.00 0.54 0.00 1.00
tkind-challenge-069 challenge-069 1.0 1 185 0 184 1 1.00 0.01 0.00 0.99 0.00 1.00
tkind-challenge-006 challenge-006 18.0 20 47 15 27 5 0.63 0.03 0.42 0.45 0.11 0.47
tkind-challenge-070 challenge-070 1.0 1 3 0 2 1 1.00 0.58 0.00 0.42 0.00 1.00
tkind-challenge-071 challenge-071 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-072 challenge-072 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-073 challenge-073 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-074 challenge-074 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-075 challenge-075 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-076 challenge-076 2.0 2 2 1 0 1 0.00 0.37 0.63 0.00 0.00 0.37
tkind-challenge-077 challenge-077 1.0 1 2 0 1 1 1.00 0.63 0.00 0.37 0.00 1.00
tkind-challenge-078 challenge-078 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-079 challenge-079 1.0 1 11 0 10 1 1.00 0.14 0.00 0.86 0.00 1.00
tkind-challenge-007 challenge-007 1.0 1 189 0 188 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-080 challenge-080 1.0 1 1 0 0 1 - 1.00 0.00 0.00 0.00 1.00
tkind-challenge-081 challenge-081 1.0 1 184 0 183 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-082 challenge-082 1.0 1 60 0 59 1 1.00 0.11 0.00 0.89 0.00 1.00
tkind-challenge-083 challenge-083 50.0 50 100 49 50 1 0.51 0.01 0.56 0.43 0.00 0.44
tkind-challenge-084 challenge-084 1.0 1 2 0 1 1 1.00 0.72 0.00 0.28 0.00 1.00
tkind-challenge-085 challenge-085 22.0 22 96 21 74 1 0.78 0.01 0.30 0.69 0.00 0.70
tkind-challenge-086 challenge-086 1.0 1 4 0 3 1 1.00 0.37 0.00 0.63 0.00 1.00
tkind-challenge-087 challenge-087 - - 8 - - - - - - - - -
tkind-challenge-088 challenge-088 1.0 1 2 0 1 1 1.00 0.69 0.00 0.31 0.00 1.00
tkind-challenge-089 challenge-089 - - 11 - - - - - - - - -
tkind-challenge-008 challenge-008 1.0 1 17 0 16 1 1.00 0.11 0.00 0.89 0.00 1.00
tkind-challenge-090 challenge-090 1.0 1 114 0 113 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-091 challenge-091 4.5 5 47 3 42 2 0.92 0.03 0.10 0.84 0.03 0.87
tkind-challenge-092 challenge-092 13.0 13 25 12 12 1 0.50 0.04 0.56 0.40 0.00 0.44
tkind-challenge-093 challenge-093 1.0 1 2 0 1 1 1.00 0.51 0.00 0.49 0.00 1.00
tkind-challenge-094 challenge-094 1.0 1 99 0 98 1 1.00 0.03 0.00 0.97 0.00 1.00
tkind-challenge-095 challenge-095 1.0 1 100 0 99 1 1.00 0.04 0.00 0.96 0.00 1.00
tkind-challenge-096 challenge-096 1.0 1 95 0 94 1 1.00 0.05 0.00 0.95 0.00 1.00
tkind-challenge-097 challenge-097 1.0 1 107 0 106 1 1.00 0.02 0.00 0.98 0.00 1.00
tkind-challenge-098 challenge-098 1.0 1 102 0 101 1 1.00 0.04 0.00 0.96 0.00 1.00
tkind-challenge-099 challenge-099 1.0 1 23 0 22 1 1.00 0.08 0.00 0.92 0.00 1.00
tkind-challenge-009 challenge-009 1.0 1 2 0 1 1 1.00 0.76 0.00 0.24 0.00 1.00

Table legend:

rank
Absolute rank of correct solution (average of tied ranks)
rankmax
Absolute rank of correct solution (max of tied ranks, worst case)
tc
Total number of candidates
bc
Number of candidates with a score better than correct solution
wc
Number of candidates with a score worse than correct solution
ec
Number of candidates with same score as the correct solution
rrp
Relative ranking position (1.0 is good, 0.0 is not)
p
Score of correct solution
wbc
Sum of scores better than correct solution
wwc
Sum of scores worse than correct solution
wec
Sum of scores equal to correct solution
wrrp
RRP weighted by the scores (1 is good)