Promoter Activity Prediction Challenge
Definitions
Cp: The Pearson correlation between the measured promoter activity and the predicted promoter activity. This is a measure of the co-linearity between measured and predicted promoter activities.
χ2: The χ 2 metric is defined as,
where Xipis the predicted activity of promoter i for participant pand ξi the measured activity of promoter i=1, 2 …, 53 and p=1,2….,P (with P=21). χ 2 is a measure of the distance between measured and predicted promoter activities.
Sp:The Spearman correlation between the measured promoter activity and the predicted promoter activity. This is a measure of the co-linearity between the ranks of the measured and predicted promoter activities.
R2:The R2 metric is defined as,
where, for each p, γip is the rank of the absolute difference between Xip and ξi ,1 ≤ γip≤ 53. R2 is a measure of the distance between the ranks of the measured and predicted promoter activities.
P-value Cp:The probability of obtaining a Pearson correlation Cp or larger in the ensemble in which the predictions are made choosing at random an activity for each promoter amongst all the 21 participating teams.
P-value χ2:The probability of obtaining a distance metric χ2 or smaller in the ensemble in which the predictions are made choosing at random an activity for each promoter amongst all the 21 participating teams.
P-value Sp:The probability of obtaining a Spearman correlation Sp or larger in the ensemble in which the the predictions are made choosing at random an activity for each promoter amongst all the 21 participating teams.
P-value R2:The probability of obtaining a distance metric R2 or smaller in the ensemble in which the the predictions are made choosing at random an activity for each promoter amongst all the 21 participating teams.
Overall Score:minus the logarithm (base 10) of the geometric mean of the P-values of Cp, χ2, Spand R2.
If you participated in this challenge, login to de-anonymize your team
|
Team names |
Ranking |
Cp |
Sp |
χ2 |
R2 |
P-value Cp |
P-value Sp |
P-value χ2 |
P-value R2 |
Overall Score |
|
FIRST |
1 |
0.65 |
0.65 |
52.62 |
35.85 |
0.003 |
0.002 |
0.508 |
0.004 |
1.99 |
|
c4lab |
2 |
0.54 |
0.49 |
30.82 |
37.77 |
0.097 |
0.163 |
0.001 |
0.009 |
1.69 |
|
Team #263 |
3 |
0.52 |
0.44 |
29.80 |
37.16 |
0.148 |
0.350 |
0.001 |
0.007 |
1.64 |
|
Team #164 |
4 |
0.49 |
0.48 |
35.11 |
40.51 |
0.227 |
0.196 |
0.013 |
0.022 |
1.23 |
|
Team #259 |
5 |
0.50 |
0.46 |
31.39 |
48.89 |
0.214 |
0.298 |
0.002 |
0.143 |
1.18 |
|
Team #140 |
6 |
0.53 |
0.59 |
61.21 |
47.71 |
0.108 |
0.014 |
0.821 |
0.116 |
0.96 |
|
Team #250 |
7 |
0.53 |
0.47 |
65.74 |
37.87 |
0.128 |
0.230 |
0.909 |
0.009 |
0.91 |
|
Team #84 |
8 |
0.47 |
0.53 |
40.79 |
50.29 |
0.294 |
0.082 |
0.079 |
0.175 |
0.87 |
|
Team #17 |
9 |
0.52 |
0.48 |
69.06 |
41.69 |
0.139 |
0.217 |
0.949 |
0.031 |
0.76 |
|
Team #154 |
10 |
0.45 |
0.49 |
55.45 |
40.44 |
0.414 |
0.176 |
0.628 |
0.022 |
0.75 |
|
Team #21 |
11 |
0.47 |
0.46 |
50.40 |
42.62 |
0.315 |
0.283 |
0.413 |
0.042 |
0.70 |
|
Team #76 |
12 |
0.42 |
0.57 |
57.10 |
49.24 |
0.526 |
0.030 |
0.693 |
0.150 |
0.69 |
|
Team #61 |
13 |
0.53 |
0.45 |
55.43 |
46.59 |
0.110 |
0.316 |
0.627 |
0.092 |
0.67 |
|
Team #187 |
14 |
0.55 |
0.51 |
61.96 |
55.80 |
0.082 |
0.128 |
0.839 |
0.369 |
0.62 |
|
Team #257 |
15 |
0.50 |
0.45 |
47.68 |
50.68 |
0.193 |
0.303 |
0.299 |
0.186 |
0.62 |
|
Team #253 |
16 |
0.45 |
0.44 |
91.10 |
50.77 |
0.405 |
0.373 |
0.999 |
0.189 |
0.39 |
|
Team #264 |
17 |
0.30 |
0.30 |
46.48 |
60.99 |
0.893 |
0.892 |
0.250 |
0.566 |
0.24 |
|
Team #245 |
18 |
0.33 |
0.23 |
44.09 |
77.34 |
0.839 |
0.978 |
0.166 |
0.936 |
0.22 |
|
Team #265 |
19 |
0.39 |
0.37 |
50.28 |
81.96 |
0.631 |
0.664 |
0.410 |
0.971 |
0.19 |
|
Team #176 |
20 |
0.27 |
0.24 |
47.66 |
72.06 |
0.947 |
0.970 |
0.298 |
0.866 |
0.16 |
|
Team #138 |
21 |
0.13 |
0.09 |
88.82 |
106.76 |
0.999 |
1.000 |
0.999 |
1.000 |
0.00 |