13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
  • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
      The ranking of the groups is based on the analysis of zscores for GDT_TS.
    • TBM
    • TBM/FM
    • FM
    • FM_sp (Combination of EUs: T0953s2-D23, T0984, T1000, T1002)
    #     GR
    code
    GR
    name
    Domains Count     SUM Zscore
    (>-2.0)
    Rank SUM Zscore
    (>-2.0)
    AVG Zscore
    (>-2.0)
    Rank AVG Zscore
    (>-2.0)
    SUM Zscore
    (>0.0)
    Rank SUM Zscore
    (>0.0)
    AVG Zscore
    (>0.0)
    Rank AVG Zscore
    (>0.0)
1 043 A7D 103 119.8429 1 1.1635 1 127.4816 1 1.2377 1
2 322 Zhang 103 106.7674 2 1.0366 2 107.3673 2 1.0424 2
3 089 MULTICOM 103 98.6232 3 0.9575 3 99.1458 3 0.9626 3
4 145 QUARK 103 90.1429 4 0.8752 4 90.7139 4 0.8807 4
5 261 Zhang-Server 103 88.1913 5 0.8562 5 88.9971 5 0.8640 5
6 460 McGuffin 103 80.7632 6 0.7841 6 83.5298 6 0.8110 6
7 354 wfAll-Cheng 103 76.8791 7 0.7464 8 80.1704 7 0.7784 9
8 135 SBROD 101 71.5034 9 0.7476 7 78.9170 8 0.7814 8
9 324 RaptorX-DeepModeller 103 75.4289 8 0.7323 9 78.5276 9 0.7624 10
10 197 MESHI 103 70.2323 10 0.6819 11 75.8915 10 0.7368 11
11 274 MUFold 103 66.9621 13 0.6501 14 74.0937 11 0.7194 12
12 222 Seok-refine 103 63.5832 15 0.6173 17 73.8036 12 0.7165 13
13 055 VoroMQA-select 103 67.2288 12 0.6527 13 73.2189 13 0.7109 14
14 196 Grudinin 103 68.8019 11 0.6680 12 73.0861 14 0.7096 15
15 192 Elofsson 102 62.8775 16 0.6361 15 70.1501 15 0.6877 17
16 086 BAKER 101 57.8510 18 0.6124 18 69.5033 16 0.6882 16
17 224 Destini 103 64.7773 14 0.6289 16 68.0528 17 0.6607 18
18 418 Seder3nc 103 40.3575 28 0.3918 30 67.1390 18 0.6518 19
19 344 Kiharalab 103 60.8535 17 0.5908 19 65.4274 19 0.6352 21
20 208 KIAS-Gdansk 99 49.0663 22 0.5764 20 63.7605 20 0.6440 20
21 406 Seder3mm 103 49.6085 21 0.4816 23 63.6841 21 0.6183 22
22 221 RaptorX-TBM 103 55.1204 19 0.5351 21 62.2454 22 0.6043 23
23 071 Seder3full 103 32.5446 32 0.3160 37 61.8155 23 0.6002 24
24 117 Jones-UCL 103 52.9645 20 0.5142 22 61.4808 24 0.5969 26
25 044 ProQ2 102 44.3952 23 0.4549 24 61.1617 25 0.5996 25
26 366 Venclovas 74 -5.1946 47 0.7136 10 59.0580 26 0.7981 7
27 241 Bhageerath-Star 103 40.8163 27 0.3963 29 57.9908 27 0.5630 27
28 068 Seok 103 36.7221 30 0.3565 33 57.3213 28 0.5565 30
29 457 Wallner 102 43.9243 25 0.4502 25 57.3192 29 0.5620 29
30 309 Seder1 103 36.0024 31 0.3495 35 55.9507 30 0.5432 33
31 390 Bhattacharya 103 44.3011 24 0.4301 26 55.9501 31 0.5432 34
32 368 BAKER-ROSETTASERVER 102 39.8738 29 0.4105 27 55.7125 32 0.5462 31
33 426 AP_1 103 41.0305 26 0.3984 28 54.7580 33 0.5316 35
34 498 RaptorX-Contact 103 29.9227 33 0.2905 38 54.4903 34 0.5290 36
35 214 wfRosetta-ModF7 99 29.6602 34 0.3804 32 53.9857 35 0.5453 32
36 281 SHORTLE 81 -12.8715 50 0.3843 31 42.3546 36 0.5229 37
37 244 Seder3hard 103 -33.1726 55 -0.3221 62 42.0953 37 0.4087 39
38 163 Bates_BMM 82 -13.7656 51 0.3443 36 41.9079 38 0.5111 38
39 156 Seok-server 103 8.2323 44 0.0799 49 41.1504 39 0.3995 40
40 243 MULTICOM-CONSTRUCT 103 29.1158 35 0.2827 39 40.9489 40 0.3976 41
41 446 slbio 71 -38.7719 57 0.3553 34 39.9033 41 0.5620 28
42 329 D-Haven 102 15.6610 39 0.1731 44 39.8322 42 0.3905 43
43 441 FALCON 103 12.6969 41 0.1233 47 39.5229 43 0.3837 44
44 279 ZHOU-SPOT 100 13.8474 40 0.1985 42 39.3987 44 0.3940 42
45 377 wfRstta-Maghrabi-TQA 101 -4.0196 46 -0.0002 51 38.5807 45 0.3820 45
46 058 MULTICOM_CLUSTER 103 25.5573 36 0.2481 40 37.9085 46 0.3680 46
47 023 MULTICOM-NOVEL 103 25.0043 37 0.2428 41 37.3678 47 0.3628 48
48 149 Zhou-SPOT-3D 103 17.4728 38 0.1696 45 36.1533 48 0.3510 50
49 164 Yang-Server 100 11.9878 42 0.1799 43 36.0608 49 0.3606 49
50 246 IntFOLD5 103 7.0799 45 0.0687 50 35.2016 50 0.3418 51
51 116 Zhang-CEthreader 103 9.0908 43 0.0883 48 33.9868 51 0.3300 52
52 335 wfRosetta-PQ2-AngQA 103 -18.1334 52 -0.1761 57 30.6827 52 0.2979 56
53 471 CPClab 102 -10.3789 49 -0.0821 53 27.9747 53 0.2743 57
54 266 slbio_server 90 -39.5285 58 -0.1503 55 26.9565 54 0.2995 54
55 160 CMA-align 99 -8.2171 48 -0.0022 52 24.0672 55 0.2431 59
56 470 Seok-assembly 80 -69.2911 66 -0.2911 61 23.9412 56 0.2993 55
57 337 FALCON-TBM 103 -34.0246 56 -0.3303 63 20.4454 57 0.1985 62
58 112 AWSEM 100 -23.2775 53 -0.1728 56 19.9510 58 0.1995 61
59 124 AWSEM-Suite 102 -23.3573 54 -0.2094 58 17.2701 59 0.1693 67
60 402 RBO-Aleph 95 -48.9760 60 -0.3471 64 16.8969 60 0.1779 65
61 004 YASARA 92 -55.3673 61 -0.3627 65 16.4714 61 0.1790 64
62 488 Delta-Gelly-Server 101 -64.6185 65 -0.6002 73 14.7707 62 0.1462 68
63 347 MESHI-server 49 -101.0119 71 0.1426 46 14.7179 63 0.3004 53
64 431 Laufer 40 -129.5158 81 -0.0879 54 14.5665 64 0.3642 47
65 432 Seok-naive_assembly 52 -125.1572 79 -0.4453 68 12.5700 65 0.2417 60
66 110 Distill 103 -40.1444 59 -0.3898 66 11.8993 66 0.1155 74
67 492 wf-BAKER-UNRES 96 -60.3354 63 -0.4827 69 11.2347 67 0.1170 73
68 047 chuo-u 92 -60.3666 64 -0.4170 67 11.1446 68 0.1211 72
69 085 BhageerathH-Plus 103 -59.8425 62 -0.5810 71 10.6151 69 0.1031 75
70 312 MUFold_server 103 -75.0671 68 -0.7288 75 10.4107 70 0.1011 76
71 397 PepBuilderJ 80 -92.4582 70 -0.5807 70 10.3576 71 0.1295 71
72 288 UNRES 100 -102.6246 72 -0.9662 81 7.2156 72 0.0722 78
73 358 Spider 97 -70.1504 67 -0.5995 72 7.0930 73 0.0731 77
74 351 DL-Haven 99 -86.6039 69 -0.7940 76 6.6137 74 0.0668 79
75 472 DELClab 97 -110.9983 76 -1.0206 86 6.0828 75 0.0627 81
76 097 Laufer_abinitio 37 -161.4873 90 -0.7970 77 4.8624 76 0.1314 70
77 077 qmo 27 -159.6144 89 -0.2820 60 4.6793 77 0.1733 66
78 152 PconsC4 103 -103.7969 73 -1.0077 85 4.1623 78 0.0404 84
79 407 rawMSA 92 -112.5744 77 -0.9845 83 4.0089 79 0.0436 82
80 380 Laufer_100 18 -185.1914 94 -0.8440 79 3.3486 80 0.1860 63
81 041 FALCON-Contact 103 -128.9150 80 -1.2516 90 2.7246 81 0.0265 86
82 122 Forbidden 85 -106.3184 75 -0.8273 78 2.5564 82 0.0301 85
83 092 Ricardo 10 -188.7195 97 -0.2719 59 2.4873 83 0.2487 58
84 389 UpsideUChicago 18 -186.5491 95 -0.9194 80 2.3838 84 0.1324 69
85 157 GAPF_LNCC 51 -153.5919 87 -0.9724 82 2.0997 85 0.0412 83
86 365 3D-JIGSAW_SL1 103 -118.4850 78 -1.1503 88 1.4378 86 0.0140 88
87 497 GaussDCA 103 -131.2521 82 -1.2743 92 1.3904 87 0.0135 90
88 381 GONGLAB-THU 102 -103.9218 74 -0.9992 84 1.1955 88 0.0117 91
89 414 BCLMeilerLab 59 -153.9534 88 -1.1179 87 0.8319 89 0.0141 87
90 473 Maurice 12 -189.5611 98 -0.6301 74 0.7577 90 0.0631 80
91 378 Cao-server 103 -151.3345 86 -1.4693 96 0.4141 91 0.0040 92
92 401 InnoUNRES 29 -184.3184 93 -1.2524 91 0.3923 92 0.0135 89
93 282 PRAYOG 91 -132.3808 83 -1.1910 89 0.2997 93 0.0033 93
94 007 ACOMPMOD 103 -138.6949 84 -1.3466 93 0.2768 94 0.0027 95
95 257 NOCONTACT 99 -164.0121 91 -1.5759 97 0.2703 95 0.0027 94
96 348 HMSCasper-Refiner 103 -140.3921 85 -1.3630 94 0.0000 96 0.0000 96
97 458 FOLDNET 66 -167.7272 92 -1.4201 95 0.0000 96 0.0000 96
98 476 Sun_Tsinghua 51 -188.5523 96 -1.6579 98 0.0000 96 0.0000 96
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis