News
March 18th, 2015
The results and winners of CASMI-2014 are now up. March 3rd, 2015
The solutions for CASMI-2014 are now available on the website. January 15th, 2015
The CASMI 2014 Challenges submissions deadline has been extended to February 15th, 2015! September 15th, 2014
The CASMI 2014 Challenges are now officially available ! September 2nd, 2014
All articles of the CASMI 2013 proceedings are now online. April 30, 2014
First announcement at the Analytical Tools for Cutting-edge Metabolomics meeting.
March 18th, 2015
The results and winners of CASMI-2014 are now up. March 3rd, 2015
The solutions for CASMI-2014 are now available on the website. January 15th, 2015
The CASMI 2014 Challenges submissions deadline has been extended to February 15th, 2015! September 15th, 2014
The CASMI 2014 Challenges are now officially available ! September 2nd, 2014
All articles of the CASMI 2013 proceedings are now online. April 30, 2014
First announcement at the Analytical Tools for Cutting-edge Metabolomics meeting.
Results in Category 1
Summary of Rank by Challenge and Participant
For each challenge, the rank of the winner(s) is highlighted in bold. If the submission did not contain the correct candidate this is denoted as "-". If someone did not participate in a challenge, nothing is shown.avaniya | bertrandsamuel | felicityallen | fitch | lridder | tpluskal | |
---|---|---|---|---|---|---|
challenge1 | 1 | - | 1 | 1 | 1 | 1 |
challenge2 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge3 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge4 | 1 | 1 | 1 | - | 1 | 1 |
challenge5 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge6 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge7 | 1 | 2 | 1 | 1 | 1 | 1 |
challenge8 | 1 | 1 | - | - | 10 | |
challenge9 | 1 | 2 | 1 | 1 | 1 | 10 |
challenge10 | 1 | - | 1 | 1 | 1 | 10 |
challenge11 | 1 | 3 | 1 | - | 1 | 1 |
challenge12 | - | 1 | 1 | - | 1 | 1 |
challenge13 | 1 | 4 | 1 | 1 | 1 | 2 |
challenge14 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge15 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge16 | 1 | 4 | 1 | 1 | 1 | 1 |
challenge17 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge18 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge19 | 1 | 2 | 1 | 1 | 2 | 2 |
challenge20 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge21 | 1 | 4 | 1 | 1 | 1 | 1 |
challenge22 | 1 | 1 | 1 | 1 | 1 | 3 |
challenge23 | - | - | - | - | - | 3 |
challenge24 | 1 | 1 | 1 | 1 | 1 | 9 |
challenge25 | 1 | - | 1 | - | - | - |
challenge26 | - | 15 | - | - | - | 12 |
challenge27 | 1 | 3 | 1 | 1 | 2 | 2 |
challenge28 | 1 | 1 | 1 | - | 1 | 2 |
challenge29 | - | 2 | - | - | - | - |
challenge30 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge31 | - | - | - | - | - | - |
challenge32 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge33 | 1 | 28 | 1 | 1 | 1 | 5 |
challenge34 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge35 | - | 1 | 1 | 1 | 1 | 5 |
challenge36 | - | - | - | 1 | 1 | 1 |
challenge37 | 1 | - | - | 1 | 1 | - |
challenge38 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge39 | 1 | 1 | - | 1 | 1 | 1 |
challenge40 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge41 | - | - | 1 | - | 1 | 2 |
challenge42 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge43 | - | 2 | 7 | 1 | 1 | 5 |
challenge44 | 1 | 1 | 1 | 1 | 1 | 1 |
challenge45 | - | 1 | 1 | 1 | 1 | 1 |
challenge46 | - | 1 | 1 | 1 | 1 | 1 |
challenge47 | 1 | 1 | 1 | 1 | 2 | |
challenge48 | - | - | - | 1 | 2 |
Participant information and abstracts
ParticipantID: BertrandSamuel Category: category1 Authors: Bertrand, Samuel(1) and Guitton, Yann (1,2,3,4,5) Affiliations: (1) Groupe Mer, Molécules, Santé-EA 2160, UFR des Sciences Pharmaceutiques et Biologiques, Université de Nantes, France (2) Université de Rennes 1, IRISA UMR 6074, Rennes, France (3) CNRS, IRISA UMR 6074, Rennes, France (4) Centre Rennes-Bretagne-Atlantique, Projet Dyliss, INRIA, Rennes Cedex, France (5) Université de Nantes, LINA UMR 6241, Nantes, France Automatic methods: yes Abstract The challenge data were automatically treated using R, Rdisop, RMassBank as follow: 1- retrieving MS Data 2- searching for NeutralLosses, adducts according to MS1 data. When no information were found ions were considered as [M]+, [M+H]+, [M+Na]+, [M+K]+, [M+H+solvent]+, [M+NH4]+ (if ammonia was added in the eluant), [M-H]-, [M+Fa]- (if Fa was added) and [M+AceticAcid]- (if AA was added); some manual interventions were done to simplify some complex detected ion relationship 3- for each adduct possibility of each challenge molecular formula were deduced by Rdisop using CxHyO27N25P9F34Fe (modified according to neutral losses and adduct assigned) as maximum allowed atoms in the very strict limit of the MS accuracy. Each possible formula should pass the seven golden rules to be saved. 4- each possible formula were scored according to MS accuracy, Spectral Accuracy, MF redundancy (multiply detected adducts from one MS spectra), type of adduct, the possibility to find Molecular formula related to MS2 ions from the MF itself 5- only formula found in chemSpider/chebi/KnApSaCK were reported for challenges 1-42 (no filtering according to existence were done for challenges 43-48)
ParticipantID: lridder Category: category2 Authors: Ridder, Lars Affiliations: Wageningen University, Laboratory of Biochemistry, Wageningen, The Netherlands Automatic methods: yes Abstract The challenge peak lists were converted to MAGMa input files, and processed with MAGMa (http://www.emetabolomics.org/magma), as described in the metadata file for category 2. Submissions for category 1 consists of the lists of unique molecular formula's obtained in category 2. The provided scores correspond to the highest scoring candidate (in category 2) with the given molecular formula. This submission is supported by the observation in Ridder et al. (2012) and Ridder et al. (2013) that, even if the top scoring candidate structure in MAGMa is not correct, the molecular formula often is. References: Ridder, L.; van der Hooft, J. J. J.; Verhoeven, S.; de Vos, R. C. H.; van Schaik, R.; Vervoort (2012) J. Rapid Commun. Mass Spectrom. 26, 2461-2471. Ridder, L.; van der Hooft, J. J. J.; Verhoeven, S.; de Vos, R. C. H.; Bino, R. J.; Vervoort, J.(2013) Anal. Chem. 85, 6033-6040.
ParticipantID: tpluskal Category: category1 Authors: Pluskal, Tomáš(1) Affiliations: (1) Okinawa Institute of Science and Technology (OIST), Onna, Okinawa, Japan Automatic methods: no Abstract I imported the challenge spectra into MZmine version 2.13.1 through a small custom-made import module. Then I generated chemical formulas using the MZmine’s chemical formula prediction module. I did not alter the resulting lists of chemical formulas generated by MZmine. However, I had to manually adjust the parameters for individual challenges, therefore I do not claim this method is fully automatic. MZmine requires 7 parameters to be set for prediction of chemical formulas: 1) Neutral mass To calculate the neutral mass from the monoisotopic m/z, I set the ion type to [M+H]+ for positive mode spectra or [M-H]- for negative mode spectra. The only exceptions were challenges #8, #23 and #26, which I believe represented [M+Na]+ ions, based on manual observation of the spectra, or empirical knowledge. Charge was assumed to be 1 in all cases. 2) m/z tolerance was set to twice the expected m/z tolerance for the instrument, as stated in the challenge description (if the challenge said "The expected mass accuracy of the instrument is <5ppm", I set the m/z tolerance to 10 ppm). 3) Element counts For challenges #1 to #31, I allowed C,H,N,O,P,S elements (0-1000 each). For challenges #32 to #48 (synthetic and unknown compounds) I also added elements F,Cl, Br,I (0-100 each). 4) Element count heuristics All restrictions available in MZmine were activated (H/C ratio, NOPS/C ratios, multiple element counts). These are originally based on the Seven Golden Rules paper by Kind and Fiehn, 2007. 5) RDBE restrictions Generated formulas were restricted to those having integer RDBE values in the range of 0-40. 6) Isotope pattern filter Isotope pattern m/z tolerance was fixed to 0.02 m/z in all cases, because input data did not contain any fine isotopic peaks. Minimum absolute intensity for generated patterns was set to 0.1. Minimum isotope pattern similarity score was set to 90% except challenges #24 (50%, due to declared bias in isotope intensity), #27 (80%, due to no candidates returned at 90%) and #35 (80%, due to no isotopes observed for 209.0453 m/z). 7) MS/MS filter MS/MS m/z tolerance was set to 0.005 m/z in all cases. MZmine uses this tolerance to interpret neutral losses (e.g., 18.0106 = H2O). Minimum MS/MS score was set to 90%, except challenges #6, #8, and #18, which contained MS/MS peaks that I was not able to interpret (even manually). For these three challenges I disabled the MS/MS filter completely.
ParticipantID: felicityallen Category: Category 1 and Category 2 Authors: Felicity Allen, Russ Greiner, David Wishart Affiliations: Department of Computing Science University of Alberta, Canada Automatic methods: yes Abstract A list of candidate molecular formulae was obtained by querying PubChem for all structures within the stated MS tolerances of the precursor mass (as obtained by combining the integer precursor mass stated in the experimental details file with the MS1 file). In cases where multiple precursor masses were listed, candidates and molecular formula were included for all listed masses. All unique molecular formulae were collated from these structures. The MS1 spectra were then predicted for each candidate molecular formula using the emass program by A. Rockwood and P. Haimi [1]. These predicted spectra were compared to the provided MS1 spectra (restricted to within 10 Da of the monoisotopic mass of the molecular formula), and an MS1_SCORE was produced for each molecular formula based on the closeness of this match. The scoring metric used was: MS1_SCORE = ( (WP + WR + DP)_3ppm + (WP + WR + DP)_5ppm + (WP + WR + DP)_10ppm )/10 where WP = intensity weighted precision (0-100) WR = intensity weighted recall (0-100) DP = dot product (0-1) x 100 [1] Rockwood A. and Haimi P., "Efficient calculation of accurate masses of isotopic peaks.", Journal of the American Society for Mass Spectrometry, 17:3 p415-9 2006. A list of candidate structures was obtained by querying all of the following databases for all candidates within the required mass ranges (determined as above): HMDB http://www.hmdb.ca/ ChEBI http://www.ebi.ac.uk/chebi/ ChEMBL https://www.ebi.ac.uk/chembl/ Metlin http://metlin.scripps.edu/ FOODB http://foodb.ca/ T3DB http://www.t3db.ca/ DrugBank http://www.drugbank.ca/ ECMDB http://www.ecmdb.ca/ YMDB http://www.ymdb.ca/ PubChem https://pubchem.ncbi.nlm.nih.gov PlantDB Privately held list of 200,000 plant and plant-derived compounds. For all candidate structures with an MS1_SCORE > 28, CFM-ID [2,3] was used to predict an MS2 spectrum for all candidates at both a 10V and 20V energy level. The MS2_SCORE was computed for each to reflect the closeness of this match: MS2_SCORE = (DP + 2JA + WP + WR)_10V + (DP + 2JA + WP + WR)_20V where WP, WR and DP are as above, and JA = Jaccard Score (0-1) x 100 [2] Allen F., Pon A., Wilson M., Greiner R., Wishart D., "CFM-ID: A web server for annotation, spectrum prediction and metabolite identification from tandem mass spectra", Nucleic Acids Research, Web Server Edition 2014. [3] Allen F., Greiner R., Wishart D., "Competitive Fragmentatation Modeling of ESI-MS/MS spectra for putative metabolite identification", Metabolomics, 11:1, p98-110, 2015. For all candidates, a DB_SCORE was produced according to which of the above databases it was found in, to make use of the provided information about metabolic origin. Consider the database names below as indicators, i.e. add the amount if in that database): DB_SCORE (Challenge 1-15) = HMDB (+200) + METLIN (+100) + ChEBI (+20) + FooDB (+20) + DrugBank (+20) + ECMDB (+10) + YMDB (+10) + ChEMBL (+10). DB_SCORE (Challenge 6-31) = ChEBI (+100) + ECMDB (+100) + YMDB (+100) + PlantDB (+100) + Metlin (+50) + FooDB (+50) + ChEMBL (+10). DB_SCORE (Challenge 32-42) = HMDB (+50) + ChEMBL (+100) + T3DB (+100) + METLIN (+100) + DrugBank(+100) DB_SCORE (Challenge 43-48) = 0 An additional manual offset of +/-50 was also made in some cases to reorder the top couple of candidates. This was done where descriptions of compounds in the database provided additional information for or against a match e.g. where a particular species or biofluid was provided in the experimental data. For Category 2, the results were ranked according to the sum of the above three scores: TOTAL_SCORE = MS2_SCORE + DB_SCORE + MS1_SCORE For Category 1, the molecular formula was computed for each structure from Category 2 and kept in the same order. The list was then processed to remove duplicate entries, keeping only the highest ranked listing for each unique molecular formula.
ParticipantID: avaniya Category: Category 1 Authors: Vaniya, Arpana, Yan Ma, Dominique Ardura, Zijuan Lai, Mine Palazoglu, Sajjan Singh Mehta, Gert Wohlgemuth, Tobias Kind, Oliver Fiehn. Affiliations: Genome Center, University of California, Davis Automatic methods: Yes Abstract: The challenge peak lists were converted to MSP files, and processed with Seven Golden Rules and Formula Finder. The results were extracted from the Excel sheet. The isotope pattern of each potential formula was simulated and compared to the MS1 spectrum of each challenge. The similarty was compared using Mass Frontier 7.0 where only the highest scoring pattern was be selected as the the best molecular formula. Databases and MS/MS mass spectral library search was performed to further verify the molecular formula. The Human Metabolome Database (HMDB) and MS/MS library search using NIST 14, MassBank, METLIN, ReSpect were used in this category. The scores from Seven Golden Rules were used for submission to CASMI.
ParticipantID: Fitch Category: Category 1 and Category 2 Authors: William Fitch (1) Affiliations: (1) Stanford University (bfitch@stanford.edu) Automatic methods: No Abstract I used manual methods to generate all structures and formulas. I did not have a good formula generator that used isotopic ratios. I did use ChemCalc sometimes and Xcalibur’s spectrum simulator. MS/MS interpretation was purely manual with a few database searches for confirmation. The dereplication choices among isomers were highly subjective based on experience and likely abundance in stated samples. MS data is not often adequate to select among isomers. We need LC retention. You gave me that data but I didn’t know how to use it. I recently published a metabolomics paper (Rapid Comm Mass Spec 2013, 27, 2091) in which I hinted at methods for making interlab retention data reproducible using sets of internal standards and well identified components. Unfortunately I have not found funding to pursue this avenue further. Two other ideas for assisting these structure determinations, especially the unknowns would be deuterium exchange and retention at 2 ph values. Determining the number of exchangeable hydrogens is simple to perform, can help select among dereplication isomers and gives extra clues with true unknowns. The retention at 2 pH experiment requires some standardization but has the potential to indicate acid base character of the unknown.
Details per Challenge and Participant. See legend at bottom for more details
The table is also available as CSV download. The individual submissions are also available for download.participant | challenge | rank | tc | bc | wc | ec | rrp | p | wbc | wwc | wec | wrrp |
---|---|---|---|---|---|---|---|---|---|---|---|---|
avaniya | challenge1 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge1 | - | 18 | - | - | - | - | - | - | - | - | - |
felicityallen | challenge1 | 1 | 14 | 0 | 13 | 1 | 1.00 | 0.22 | 0.00 | 0.78 | 0.00 | 1.00 |
fitch | challenge1 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge1 | 1 | 4 | 0 | 3 | 1 | 1.00 | 0.28 | 0.00 | 0.72 | 0.00 | 1.00 |
tpluskal | challenge1 | 1 | 13 | 0 | 12 | 1 | 1.00 | 0.08 | 0.00 | 0.92 | 0.00 | 1.00 |
avaniya | challenge2 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge2 | 1 | 10 | 0 | 9 | 1 | 1.00 | 0.16 | 0.00 | 0.84 | 0.00 | 1.00 |
felicityallen | challenge2 | 1 | 6 | 0 | 5 | 1 | 1.00 | 0.49 | 0.00 | 0.51 | 0.00 | 1.00 |
fitch | challenge2 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge2 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.34 | 0.00 | 0.66 | 0.00 | 1.00 |
tpluskal | challenge2 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
avaniya | challenge3 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge3 | 1 | 6 | 0 | 5 | 1 | 1.00 | 0.29 | 0.00 | 0.71 | 0.00 | 1.00 |
felicityallen | challenge3 | 1 | 9 | 0 | 8 | 1 | 1.00 | 0.34 | 0.00 | 0.66 | 0.00 | 1.00 |
fitch | challenge3 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge3 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge3 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.35 | 0.00 | 0.65 | 0.00 | 1.00 |
avaniya | challenge4 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge4 | 1 | 12 | 0 | 11 | 1 | 1.00 | 0.19 | 0.00 | 0.81 | 0.00 | 1.00 |
felicityallen | challenge4 | 1 | 20 | 0 | 19 | 1 | 1.00 | 0.21 | 0.00 | 0.79 | 0.00 | 1.00 |
fitch | challenge4 | - | 1 | - | - | - | - | - | - | - | - | - |
lridder | challenge4 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge4 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.34 | 0.00 | 0.66 | 0.00 | 1.00 |
avaniya | challenge5 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge5 | 1 | 6 | 0 | 5 | 1 | 1.00 | 0.18 | 0.00 | 0.82 | 0.00 | 1.00 |
felicityallen | challenge5 | 1 | 9 | 0 | 8 | 1 | 1.00 | 0.46 | 0.00 | 0.54 | 0.00 | 1.00 |
fitch | challenge5 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge5 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge5 | 1 | 2 | 0 | 1 | 1 | 1.00 | 0.51 | 0.00 | 0.49 | 0.00 | 1.00 |
avaniya | challenge6 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge6 | 1 | 4 | 0 | 3 | 1 | 1.00 | 0.30 | 0.00 | 0.70 | 0.00 | 1.00 |
felicityallen | challenge6 | 1 | 8 | 0 | 7 | 1 | 1.00 | 0.65 | 0.00 | 0.35 | 0.00 | 1.00 |
fitch | challenge6 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge6 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge6 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.34 | 0.00 | 0.66 | 0.00 | 1.00 |
avaniya | challenge7 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge7 | 2 | 4 | 1 | 2 | 1 | 0.67 | 0.27 | 0.28 | 0.45 | 0.00 | 0.72 |
felicityallen | challenge7 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.55 | 0.00 | 0.45 | 0.00 | 1.00 |
fitch | challenge7 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge7 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge7 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
avaniya | challenge8 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge8 | 1 | 51 | 0 | 50 | 1 | 1.00 | 0.03 | 0.00 | 0.97 | 0.00 | 1.00 |
felicityallen | challenge8 | - | 74 | - | - | - | - | - | - | - | - | - |
lridder | challenge8 | - | 10 | - | - | - | - | - | - | - | - | - |
tpluskal | challenge8 | 10 | 23 | 9 | 13 | 1 | 0.59 | 0.04 | 0.40 | 0.56 | 0.00 | 0.60 |
avaniya | challenge9 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge9 | 2 | 83 | 1 | 81 | 1 | 0.99 | 0.02 | 0.02 | 0.96 | 0.00 | 0.98 |
felicityallen | challenge9 | 1 | 30 | 0 | 29 | 1 | 1.00 | 0.23 | 0.00 | 0.77 | 0.00 | 1.00 |
fitch | challenge9 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge9 | 1 | 5 | 0 | 4 | 1 | 1.00 | 0.39 | 0.00 | 0.61 | 0.00 | 1.00 |
tpluskal | challenge9 | 10 | 14 | 9 | 4 | 1 | 0.31 | 0.07 | 0.65 | 0.28 | 0.00 | 0.35 |
avaniya | challenge10 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge10 | - | 51 | - | - | - | - | - | - | - | - | - |
felicityallen | challenge10 | 1 | 37 | 0 | 36 | 1 | 1.00 | 0.28 | 0.00 | 0.72 | 0.00 | 1.00 |
fitch | challenge10 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge10 | 1 | 7 | 0 | 6 | 1 | 1.00 | 0.30 | 0.00 | 0.70 | 0.00 | 1.00 |
tpluskal | challenge10 | 10 | 24 | 9 | 14 | 1 | 0.61 | 0.04 | 0.39 | 0.57 | 0.00 | 0.61 |
avaniya | challenge11 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge11 | 3 | 7 | 2 | 4 | 1 | 0.67 | 0.20 | 0.42 | 0.38 | 0.00 | 0.58 |
felicityallen | challenge11 | 1 | 9 | 0 | 8 | 1 | 1.00 | 0.42 | 0.00 | 0.58 | 0.00 | 1.00 |
fitch | challenge11 | - | 1 | - | - | - | - | - | - | - | - | - |
lridder | challenge11 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge11 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
avaniya | challenge12 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge12 | 1 | 10 | 0 | 9 | 1 | 1.00 | 0.16 | 0.00 | 0.84 | 0.00 | 1.00 |
felicityallen | challenge12 | 1 | 10 | 0 | 9 | 1 | 1.00 | 0.23 | 0.00 | 0.77 | 0.00 | 1.00 |
fitch | challenge12 | - | 1 | - | - | - | - | - | - | - | - | - |
lridder | challenge12 | 1 | 2 | 0 | 1 | 1 | 1.00 | 0.64 | 0.00 | 0.36 | 0.00 | 1.00 |
tpluskal | challenge12 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
avaniya | challenge13 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge13 | 4 | 12 | 3 | 8 | 1 | 0.73 | 0.12 | 0.41 | 0.47 | 0.00 | 0.59 |
felicityallen | challenge13 | 1 | 14 | 0 | 13 | 1 | 1.00 | 0.30 | 0.00 | 0.70 | 0.00 | 1.00 |
fitch | challenge13 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge13 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge13 | 2 | 5 | 1 | 3 | 1 | 0.75 | 0.20 | 0.20 | 0.59 | 0.00 | 0.80 |
avaniya | challenge14 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge14 | 1 | 13 | 0 | 12 | 1 | 1.00 | 0.13 | 0.00 | 0.87 | 0.00 | 1.00 |
felicityallen | challenge14 | 1 | 12 | 0 | 11 | 1 | 1.00 | 0.18 | 0.00 | 0.82 | 0.00 | 1.00 |
fitch | challenge14 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge14 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge14 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.35 | 0.00 | 0.65 | 0.00 | 1.00 |
avaniya | challenge15 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge15 | 1 | 10 | 0 | 9 | 1 | 1.00 | 0.18 | 0.00 | 0.82 | 0.00 | 1.00 |
felicityallen | challenge15 | 1 | 7 | 0 | 6 | 1 | 1.00 | 0.36 | 0.00 | 0.64 | 0.00 | 1.00 |
fitch | challenge15 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge15 | 1 | 2 | 0 | 1 | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge15 | 1 | 2 | 0 | 1 | 1 | 1.00 | 0.51 | 0.00 | 0.49 | 0.00 | 1.00 |
avaniya | challenge16 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge16 | 4 | 15 | 3 | 11 | 1 | 0.79 | 0.08 | 0.24 | 0.69 | 0.00 | 0.76 |
felicityallen | challenge16 | 1 | 17 | 0 | 16 | 1 | 1.00 | 0.10 | 0.00 | 0.90 | 0.00 | 1.00 |
fitch | challenge16 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge16 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.45 | 0.00 | 0.55 | 0.00 | 1.00 |
tpluskal | challenge16 | 1 | 5 | 0 | 4 | 1 | 1.00 | 0.21 | 0.00 | 0.79 | 0.00 | 1.00 |
avaniya | challenge17 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge17 | 1 | 26 | 0 | 25 | 1 | 1.00 | 0.07 | 0.00 | 0.93 | 0.00 | 1.00 |
felicityallen | challenge17 | 1 | 19 | 0 | 18 | 1 | 1.00 | 0.14 | 0.00 | 0.86 | 0.00 | 1.00 |
fitch | challenge17 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge17 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.65 | 0.00 | 0.35 | 0.00 | 1.00 |
tpluskal | challenge17 | 1 | 2 | 0 | 1 | 1 | 1.00 | 0.52 | 0.00 | 0.48 | 0.00 | 1.00 |
avaniya | challenge18 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge18 | 1 | 34 | 0 | 33 | 1 | 1.00 | 0.06 | 0.00 | 0.94 | 0.00 | 1.00 |
felicityallen | challenge18 | 1 | 20 | 0 | 19 | 1 | 1.00 | 0.09 | 0.00 | 0.91 | 0.00 | 1.00 |
fitch | challenge18 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge18 | 1 | 8 | 0 | 7 | 1 | 1.00 | 0.42 | 0.00 | 0.58 | 0.00 | 1.00 |
tpluskal | challenge18 | 1 | 7 | 0 | 6 | 1 | 1.00 | 0.15 | 0.00 | 0.85 | 0.00 | 1.00 |
avaniya | challenge19 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge19 | 2 | 33 | 1 | 31 | 1 | 0.97 | 0.04 | 0.04 | 0.93 | 0.00 | 0.96 |
felicityallen | challenge19 | 1 | 23 | 0 | 22 | 1 | 1.00 | 0.07 | 0.00 | 0.93 | 0.00 | 1.00 |
fitch | challenge19 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge19 | 2 | 3 | 1 | 1 | 1 | 0.50 | 0.41 | 0.42 | 0.17 | 0.00 | 0.58 |
tpluskal | challenge19 | 2 | 7 | 1 | 5 | 1 | 0.83 | 0.15 | 0.15 | 0.70 | 0.00 | 0.85 |
avaniya | challenge20 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge20 | 1 | 28 | 0 | 27 | 1 | 1.00 | 0.05 | 0.00 | 0.95 | 0.00 | 1.00 |
felicityallen | challenge20 | 1 | 38 | 0 | 37 | 1 | 1.00 | 0.07 | 0.00 | 0.93 | 0.00 | 1.00 |
fitch | challenge20 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge20 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge20 | 1 | 5 | 0 | 4 | 1 | 1.00 | 0.21 | 0.00 | 0.79 | 0.00 | 1.00 |
avaniya | challenge21 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge21 | 4 | 34 | 3 | 30 | 1 | 0.91 | 0.04 | 0.12 | 0.84 | 0.00 | 0.88 |
felicityallen | challenge21 | 1 | 21 | 0 | 20 | 1 | 1.00 | 0.15 | 0.00 | 0.85 | 0.00 | 1.00 |
fitch | challenge21 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge21 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.55 | 0.00 | 0.45 | 0.00 | 1.00 |
tpluskal | challenge21 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.34 | 0.00 | 0.66 | 0.00 | 1.00 |
avaniya | challenge22 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge22 | 1 | 28 | 0 | 27 | 1 | 1.00 | 0.05 | 0.00 | 0.95 | 0.00 | 1.00 |
felicityallen | challenge22 | 1 | 27 | 0 | 26 | 1 | 1.00 | 0.13 | 0.00 | 0.87 | 0.00 | 1.00 |
fitch | challenge22 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge22 | 1 | 2 | 0 | 1 | 1 | 1.00 | 0.88 | 0.00 | 0.13 | 0.00 | 1.00 |
tpluskal | challenge22 | 3 | 3 | 2 | 0 | 1 | 0.00 | 0.33 | 0.67 | 0.00 | 0.00 | 0.33 |
avaniya | challenge23 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge23 | - | 26 | - | - | - | - | - | - | - | - | - |
felicityallen | challenge23 | - | 43 | - | - | - | - | - | - | - | - | - |
fitch | challenge23 | - | 1 | - | - | - | - | - | - | - | - | - |
lridder | challenge23 | - | 1 | - | - | - | - | - | - | - | - | - |
tpluskal | challenge23 | 3 | 4 | 2 | 1 | 1 | 0.33 | 0.25 | 0.50 | 0.25 | 0.00 | 0.50 |
avaniya | challenge24 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge24 | 1 | 11 | 0 | 10 | 1 | 1.00 | 0.21 | 0.00 | 0.79 | 0.00 | 1.00 |
felicityallen | challenge24 | 1 | 11 | 0 | 10 | 1 | 1.00 | 0.42 | 0.00 | 0.58 | 0.00 | 1.00 |
fitch | challenge24 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge24 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge24 | 9 | 19 | 8 | 10 | 1 | 0.56 | 0.05 | 0.45 | 0.49 | 0.00 | 0.55 |
avaniya | challenge25 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge25 | - | 4 | - | - | - | - | - | - | - | - | - |
felicityallen | challenge25 | 1 | 22 | 0 | 21 | 1 | 1.00 | 0.23 | 0.00 | 0.77 | 0.00 | 1.00 |
fitch | challenge25 | - | 1 | - | - | - | - | - | - | - | - | - |
lridder | challenge25 | - | 9 | - | - | - | - | - | - | - | - | - |
tpluskal | challenge25 | - | 21 | - | - | - | - | - | - | - | - | - |
avaniya | challenge26 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge26 | 15 | 26 | 14 | 11 | 1 | 0.44 | 0.04 | 0.67 | 0.29 | 0.00 | 0.33 |
felicityallen | challenge26 | - | 107 | - | - | - | - | - | - | - | - | - |
fitch | challenge26 | - | 1 | - | - | - | - | - | - | - | - | - |
lridder | challenge26 | - | 8 | - | - | - | - | - | - | - | - | - |
tpluskal | challenge26 | 12 | 25 | 11 | 13 | 1 | 0.54 | 0.04 | 0.45 | 0.51 | 0.00 | 0.55 |
avaniya | challenge27 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge27 | 3 | 10 | 2 | 7 | 1 | 0.78 | 0.17 | 0.34 | 0.49 | 0.00 | 0.66 |
felicityallen | challenge27 | 1 | 16 | 0 | 15 | 1 | 1.00 | 0.18 | 0.00 | 0.82 | 0.00 | 1.00 |
fitch | challenge27 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge27 | 2 | 4 | 1 | 2 | 1 | 0.67 | 0.28 | 0.28 | 0.44 | 0.00 | 0.72 |
tpluskal | challenge27 | 2 | 8 | 1 | 6 | 1 | 0.86 | 0.13 | 0.13 | 0.74 | 0.00 | 0.87 |
avaniya | challenge28 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge28 | 1 | 35 | 0 | 34 | 1 | 1.00 | 0.04 | 0.00 | 0.96 | 0.00 | 1.00 |
felicityallen | challenge28 | 1 | 46 | 0 | 45 | 1 | 1.00 | 0.08 | 0.00 | 0.92 | 0.00 | 1.00 |
fitch | challenge28 | - | 1 | - | - | - | - | - | - | - | - | - |
lridder | challenge28 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge28 | 2 | 8 | 1 | 6 | 1 | 0.86 | 0.13 | 0.13 | 0.74 | 0.00 | 0.87 |
avaniya | challenge29 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge29 | 2 | 41 | 1 | 39 | 1 | 0.97 | 0.03 | 0.03 | 0.93 | 0.00 | 0.97 |
felicityallen | challenge29 | - | 25 | - | - | - | - | - | - | - | - | - |
fitch | challenge29 | - | 1 | - | - | - | - | - | - | - | - | - |
lridder | challenge29 | - | 2 | - | - | - | - | - | - | - | - | - |
tpluskal | challenge29 | - | 5 | - | - | - | - | - | - | - | - | - |
avaniya | challenge30 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge30 | 1 | 10 | 0 | 9 | 1 | 1.00 | 0.16 | 0.00 | 0.84 | 0.00 | 1.00 |
felicityallen | challenge30 | 1 | 6 | 0 | 5 | 1 | 1.00 | 0.45 | 0.00 | 0.55 | 0.00 | 1.00 |
fitch | challenge30 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge30 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge30 | 1 | 4 | 0 | 3 | 1 | 1.00 | 0.26 | 0.00 | 0.74 | 0.00 | 1.00 |
avaniya | challenge31 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge31 | - | 30 | - | - | - | - | - | - | - | - | - |
felicityallen | challenge31 | - | 39 | - | - | - | - | - | - | - | - | - |
fitch | challenge31 | - | 1 | - | - | - | - | - | - | - | - | - |
lridder | challenge31 | - | 6 | - | - | - | - | - | - | - | - | - |
tpluskal | challenge31 | - | 10 | - | - | - | - | - | - | - | - | - |
avaniya | challenge32 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge32 | 1 | 7 | 0 | 6 | 1 | 1.00 | 0.23 | 0.00 | 0.77 | 0.00 | 1.00 |
felicityallen | challenge32 | 1 | 8 | 0 | 7 | 1 | 1.00 | 0.65 | 0.00 | 0.35 | 0.00 | 1.00 |
fitch | challenge32 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge32 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge32 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.34 | 0.00 | 0.66 | 0.00 | 1.00 |
avaniya | challenge33 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge33 | 28 | 94 | 27 | 66 | 1 | 0.71 | 0.01 | 0.42 | 0.56 | 0.00 | 0.58 |
felicityallen | challenge33 | 1 | 55 | 0 | 54 | 1 | 1.00 | 0.08 | 0.00 | 0.92 | 0.00 | 1.00 |
fitch | challenge33 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge33 | 1 | 10 | 0 | 9 | 1 | 1.00 | 0.13 | 0.00 | 0.87 | 0.00 | 1.00 |
tpluskal | challenge33 | 5 | 37 | 4 | 32 | 1 | 0.89 | 0.03 | 0.11 | 0.86 | 0.00 | 0.89 |
avaniya | challenge34 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge34 | 1 | 52 | 0 | 51 | 1 | 1.00 | 0.02 | 0.00 | 0.98 | 0.00 | 1.00 |
felicityallen | challenge34 | 1 | 29 | 0 | 28 | 1 | 1.00 | 0.11 | 0.00 | 0.89 | 0.00 | 1.00 |
fitch | challenge34 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge34 | 1 | 10 | 0 | 9 | 1 | 1.00 | 0.17 | 0.00 | 0.83 | 0.00 | 1.00 |
tpluskal | challenge34 | 1 | 46 | 0 | 45 | 1 | 1.00 | 0.02 | 0.00 | 0.98 | 0.00 | 1.00 |
avaniya | challenge35 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge35 | 1 | 2 | 0 | 1 | 1 | 1.00 | 0.51 | 0.00 | 0.49 | 0.00 | 1.00 |
felicityallen | challenge35 | 1 | 12 | 0 | 11 | 1 | 1.00 | 0.35 | 0.00 | 0.65 | 0.00 | 1.00 |
fitch | challenge35 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge35 | 1 | 5 | 0 | 4 | 1 | 1.00 | 0.72 | 0.00 | 0.28 | 0.00 | 1.00 |
tpluskal | challenge35 | 5 | 6 | 4 | 1 | 1 | 0.20 | 0.16 | 0.68 | 0.16 | 0.00 | 0.32 |
avaniya | challenge36 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge36 | - | 6 | - | - | - | - | - | - | - | - | - |
felicityallen | challenge36 | - | 7 | - | - | - | - | - | - | - | - | - |
fitch | challenge36 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge36 | 1 | 3 | 0 | 2 | 1 | 1.00 | 0.41 | 0.00 | 0.59 | 0.00 | 1.00 |
tpluskal | challenge36 | 1 | 9 | 0 | 8 | 1 | 1.00 | 0.12 | 0.00 | 0.88 | 0.00 | 1.00 |
avaniya | challenge37 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge37 | - | 16 | - | - | - | - | - | - | - | - | - |
felicityallen | challenge37 | - | 37 | - | - | - | - | - | - | - | - | - |
fitch | challenge37 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge37 | 1 | 2 | 0 | 1 | 1 | 1.00 | 0.67 | 0.00 | 0.33 | 0.00 | 1.00 |
tpluskal | challenge37 | - | 1 | - | - | - | - | - | - | - | - | - |
avaniya | challenge38 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge38 | 1 | 41 | 0 | 40 | 1 | 1.00 | 0.03 | 0.00 | 0.97 | 0.00 | 1.00 |
felicityallen | challenge38 | 1 | 26 | 0 | 25 | 1 | 1.00 | 0.06 | 0.00 | 0.94 | 0.00 | 1.00 |
fitch | challenge38 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge38 | 1 | 10 | 0 | 9 | 1 | 1.00 | 0.19 | 0.00 | 0.81 | 0.00 | 1.00 |
tpluskal | challenge38 | 1 | 9 | 0 | 8 | 1 | 1.00 | 0.12 | 0.00 | 0.88 | 0.00 | 1.00 |
avaniya | challenge39 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge39 | 1 | 65 | 0 | 64 | 1 | 1.00 | 0.02 | 0.00 | 0.98 | 0.00 | 1.00 |
felicityallen | challenge39 | - | 42 | - | - | - | - | - | - | - | - | - |
fitch | challenge39 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge39 | 1 | 36 | 0 | 35 | 1 | 1.00 | 0.08 | 0.00 | 0.92 | 0.00 | 1.00 |
tpluskal | challenge39 | 1 | 9 | 0 | 8 | 1 | 1.00 | 0.12 | 0.00 | 0.88 | 0.00 | 1.00 |
avaniya | challenge40 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge40 | 1 | 8 | 0 | 7 | 1 | 1.00 | 0.19 | 0.00 | 0.81 | 0.00 | 1.00 |
felicityallen | challenge40 | 1 | 10 | 0 | 9 | 1 | 1.00 | 0.20 | 0.00 | 0.80 | 0.00 | 1.00 |
fitch | challenge40 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge40 | 1 | 4 | 0 | 3 | 1 | 1.00 | 0.43 | 0.00 | 0.57 | 0.00 | 1.00 |
tpluskal | challenge40 | 1 | 6 | 0 | 5 | 1 | 1.00 | 0.17 | 0.00 | 0.83 | 0.00 | 1.00 |
avaniya | challenge41 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge41 | - | 30 | - | - | - | - | - | - | - | - | - |
felicityallen | challenge41 | 1 | 78 | 0 | 77 | 1 | 1.00 | 0.04 | 0.00 | 0.96 | 0.00 | 1.00 |
fitch | challenge41 | - | 1 | - | - | - | - | - | - | - | - | - |
lridder | challenge41 | 1 | 8 | 0 | 7 | 1 | 1.00 | 0.20 | 0.00 | 0.80 | 0.00 | 1.00 |
tpluskal | challenge41 | 2 | 2 | 1 | 0 | 1 | 0.00 | 0.50 | 0.50 | 0.00 | 0.00 | 0.50 |
avaniya | challenge42 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge42 | 1 | 22 | 0 | 21 | 1 | 1.00 | 0.07 | 0.00 | 0.93 | 0.00 | 1.00 |
felicityallen | challenge42 | 1 | 14 | 0 | 13 | 1 | 1.00 | 0.16 | 0.00 | 0.84 | 0.00 | 1.00 |
fitch | challenge42 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge42 | 1 | 4 | 0 | 3 | 1 | 1.00 | 0.31 | 0.00 | 0.69 | 0.00 | 1.00 |
tpluskal | challenge42 | 1 | 8 | 0 | 7 | 1 | 1.00 | 0.13 | 0.00 | 0.87 | 0.00 | 1.00 |
avaniya | challenge43 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge43 | 2 | 309 | 1 | 307 | 1 | 1.00 | 0.01 | 0.01 | 0.99 | 0.00 | 0.99 |
felicityallen | challenge43 | 7 | 43 | 6 | 36 | 1 | 0.86 | 0.03 | 0.20 | 0.76 | 0.00 | 0.80 |
fitch | challenge43 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge43 | 1 | 18 | 0 | 17 | 1 | 1.00 | 0.11 | 0.00 | 0.89 | 0.00 | 1.00 |
tpluskal | challenge43 | 5 | 58 | 4 | 53 | 1 | 0.93 | 0.02 | 0.07 | 0.91 | 0.00 | 0.93 |
avaniya | challenge44 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge44 | 1 | 44 | 0 | 43 | 1 | 1.00 | 0.04 | 0.00 | 0.96 | 0.00 | 1.00 |
felicityallen | challenge44 | 1 | 13 | 0 | 12 | 1 | 1.00 | 0.18 | 0.00 | 0.82 | 0.00 | 1.00 |
fitch | challenge44 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge44 | 1 | 3 | 0 | 2 | 1 | 1.00 | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge44 | 1 | 6 | 0 | 5 | 1 | 1.00 | 0.17 | 0.00 | 0.83 | 0.00 | 1.00 |
avaniya | challenge45 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge45 | 1 | 9 | 0 | 8 | 1 | 1.00 | 0.15 | 0.00 | 0.85 | 0.00 | 1.00 |
felicityallen | challenge45 | 1 | 2 | 0 | 1 | 1 | 1.00 | 0.70 | 0.00 | 0.30 | 0.00 | 1.00 |
fitch | challenge45 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge45 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge45 | 1 | 2 | 0 | 1 | 1 | 1.00 | 0.51 | 0.00 | 0.49 | 0.00 | 1.00 |
avaniya | challenge46 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge46 | 1 | 121 | 0 | 120 | 1 | 1.00 | 0.01 | 0.00 | 0.99 | 0.00 | 1.00 |
felicityallen | challenge46 | 1 | 29 | 0 | 28 | 1 | 1.00 | 0.08 | 0.00 | 0.92 | 0.00 | 1.00 |
fitch | challenge46 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
lridder | challenge46 | 1 | 13 | 0 | 12 | 1 | 1.00 | 0.22 | 0.00 | 0.78 | 0.00 | 1.00 |
tpluskal | challenge46 | 1 | 17 | 0 | 16 | 1 | 1.00 | 0.06 | 0.00 | 0.94 | 0.00 | 1.00 |
avaniya | challenge47 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
bertrandsamuel | challenge47 | 1 | 170 | 0 | 169 | 1 | 1.00 | 0.01 | 0.00 | 0.99 | 0.00 | 1.00 |
felicityallen | challenge47 | 1 | 5 | 0 | 4 | 1 | 1.00 | 0.24 | 0.00 | 0.76 | 0.00 | 1.00 |
lridder | challenge47 | 1 | 5 | 0 | 4 | 1 | 1.00 | 0.30 | 0.00 | 0.70 | 0.00 | 1.00 |
tpluskal | challenge47 | 2 | 14 | 1 | 12 | 1 | 0.92 | 0.07 | 0.07 | 0.85 | 0.00 | 0.93 |
avaniya | challenge48 | - | 1 | - | - | - | - | - | - | - | - | - |
bertrandsamuel | challenge48 | - | 79 | - | - | - | - | - | - | - | - | - |
felicityallen | challenge48 | - | 7 | - | - | - | - | - | - | - | - | - |
lridder | challenge48 | 1 | 1 | 0 | 0 | 1 | - | 1.00 | 0.00 | 0.00 | 0.00 | 1.00 |
tpluskal | challenge48 | 2 | 17 | 1 | 15 | 1 | 0.94 | 0.06 | 0.06 | 0.88 | 0.00 | 0.94 |
Table legend:
- rank
- Absolute rank of correct solution
- tc
- Total number of candidates
- bc
- Number of candidates with a score better than correct solution
- wc
- Number of candidates with a score worse than correct solution
- ec
- Number of candidates with same score as the correct solution
- rrp
- Relative ranking position (1.0 is good, 0.0 is not)
- p
- Score of correct solution
- wbc
- Sum of scores better than correct solution
- wwc
- Sum of scores worse than correct solution
- wec
- Sum of scores equal to correct solution
- wrrp
- RRP weighted by the scores (1 is good)