14th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
Menu
Multimer Predictions Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate zscores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate zscores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  • Analysis on the models designated as "1"
  • Analysis on the models with the best scores
Targets :
  • TBM (easy)
  • TBM/FM (medium)
  • FM (hard)
  • X-ray
  • NMR
  • CryoEM
Groups:
  • CASP groups on all targets
  • CASP+CAPRI groups on CAPRI targets only
The final ranking was generated according to the formula: Z-score(F1) + Z-score(Jaccard score) + Z-score(lDDT(oligo)) + Z-score(TM) .
    #     GR
    name		     GR
    code		     Targets Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 BAKER-experimental 403 29 27.5855 1 0.9512 1 31.2739 1 1.0784 2
2 Venclovas 029 29 22.3640 2 0.7712 4 25.7443 2 0.8877 3
3 Takeda-Shitaka-Lab 055 29 15.6035 3 0.5381 5 20.1932 3 0.6963 5
4 Seok 193 28 11.9170 4 0.4970 6 17.5844 4 0.6280 6
5 DATE 288 25 -0.4062 7 0.3038 7 12.5006 5 0.5000 7
6 Bates_BMM 336 29 0.6470 6 0.0223 11 11.7050 6 0.4036 10
7 Kiharalab 071 28 4.1910 5 0.2211 8 11.2516 7 0.4018 11
8 Huang 298 23 -8.8818 9 0.1356 10 10.6814 8 0.4644 8
9 Elofsson 472 22 -10.8047 10 0.1452 9 9.2463 9 0.4203 9
10 Risoluto 341 29 -5.5563 8 -0.1916 17 8.0148 10 0.2764 18
11 Seok-assembly 451 24 -11.2582 12 -0.0524 13 7.4546 11 0.3106 14
12 SBROD-select 062 24 -17.0204 14 -0.2925 22 6.9597 12 0.2900 17
13 LamoureuxLab 066 22 -17.1004 15 -0.1409 16 6.8726 13 0.3124 13
14 Vakser 173 25 -10.9931 11 -0.1197 15 6.3652 14 0.2546 21
15 UNRES-template 018 22 -20.1591 17 -0.2800 21 5.7530 15 0.2615 19
16 Ornate-select 375 23 -18.8677 16 -0.2986 23 5.3542 16 0.2328 22
17 VoroCNN-select 343 28 -13.0389 13 -0.3942 24 4.8780 17 0.1742 23
18 AILON 192 12 -37.0453 21 -0.2538 19 4.0773 18 0.3398 12
19 McGuffin 220 13 -32.2398 19 -0.0184 12 3.8466 19 0.2959 16
20 Zhang-Assembly 182 11 -38.8719 22 -0.2611 20 2.8174 20 0.2561 20
21 Seok-naive_assembly 491 16 -36.1100 20 -0.6319 28 2.4291 21 0.1518 24
22 E2E 376 2 -52.1926 29 0.9037 2 2.3459 22 1.1729 1
23 ricardo 467 6 -46.4456 26 -0.0743 14 1.8169 23 0.3028 15
24 UNRES 360 21 -32.0602 18 -0.7648 31 1.6981 24 0.0809 27
25 edmc_pf 387 1 -55.1879 34 0.8121 3 0.8161 25 0.8161 4
26 UNRES-contact 096 13 -39.3180 23 -0.5629 26 0.7781 26 0.0599 29
27 DellaCorteLab 323 13 -41.3117 24 -0.7163 29 0.7603 27 0.0585 30
28 bioinsilico_sbi 196 6 -49.6885 27 -0.6148 27 0.5406 28 0.0901 26
29 ropius0 254 3 -52.7381 30 -0.2460 18 0.3105 29 0.1035 25
30 DELCLAB 369 16 -44.8128 25 -1.1758 33 0.2773 30 0.0173 34
31 xianmingpan 014 5 -53.9264 32 -1.1853 34 0.2463 31 0.0493 31
32 ict-ams 476 3 -56.3604 35 -1.4535 38 0.1988 32 0.0663 28
33 Pharmulator 340 7 -50.9521 28 -0.9932 32 0.1878 33 0.0268 32
34 CAO-QA1 217 7 -52.9171 31 -1.2739 35 0.1695 34 0.0242 33
35 BAKER-ROBETTA 278 1 -56.5559 36 -0.5559 25 0.0000 35 0.0000 35
36 Jones-UCL 304 1 -56.7336 37 -0.7336 30 0.0000 35 0.0000 35
37 MULTICOM-CLUSTER 075 1 -57.3248 38 -1.3248 36 0.0000 35 0.0000 35
38 Spider 349 5 -54.7094 33 -1.3419 37 0.0000 35 0.0000 35
39 FoldEM 107 1 -57.4888 39 -1.4888 39 0.0000 35 0.0000 35
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2020, University of California, Davis