14th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
Menu
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
    • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 427 AlphaFold2 23 72.7423 1 3.1627 1 73.1263 1 3.1794 1
2 403 BAKER-experimental 23 29.3544 2 1.2763 3 30.1617 2 1.3114 3
3 473 BAKER 23 28.5485 3 1.2412 4 29.5853 3 1.2863 4
4 480 FEIG-R2 23 23.8974 4 1.0390 5 24.3727 4 1.0597 5
5 042 QUARK 23 21.8233 5 0.9488 6 22.4019 5 0.9740 6
6 324 Zhang-Server 23 21.3322 6 0.9275 7 21.8136 6 0.9484 8
7 129 Zhang 23 20.2609 7 0.8809 10 20.7864 7 0.9038 10
8 024 DeepPotential 23 18.2855 8 0.7950 11 19.0069 9 0.8264 12
9 031 Zhang-CEthreader 23 17.1828 9 0.7471 12 20.1211 8 0.8748 11
10 009 tFold_human 23 16.8172 10 0.7312 13 18.0037 10 0.7828 13
11 226 Zhang-TBM 23 16.1050 11 0.7002 14 17.1815 11 0.7470 14
12 488 tFold-IDT_human 23 14.3833 12 0.6254 15 15.7990 13 0.6869 16
13 067 ProQ2 23 13.0303 13 0.5665 20 13.9889 15 0.6082 21
14 435 Zhang_Ab_Initio 23 12.8138 14 0.5571 21 15.8620 12 0.6897 15
15 368 tFold-CaT_human 23 12.6847 15 0.5515 22 13.7262 17 0.5968 23
16 362 Seok-refine 23 12.6208 16 0.5487 23 13.9279 16 0.6056 22
17 039 ropius0QA 23 12.5290 17 0.5447 24 14.3421 14 0.6236 19
18 498 VoroMQA-select 23 12.2854 18 0.5341 25 13.3205 18 0.5792 24
19 420 MULTICOM 23 11.1945 19 0.4867 26 12.5921 20 0.5475 27
20 200 Bilbul2020 23 11.1900 20 0.4865 27 12.9003 19 0.5609 26
21 216 EMAP_CHAE 23 10.3662 21 0.4507 28 12.1451 24 0.5280 31
22 409 UOSHAN 23 10.1776 22 0.4425 29 12.1778 22 0.5295 29
23 125 PreferredFold 23 9.5509 23 0.4153 30 11.4404 28 0.4974 35
24 220 McGuffin 23 9.4267 24 0.4099 31 11.2741 30 0.4902 37
25 288 DATE 23 9.3873 25 0.4081 32 12.3253 21 0.5359 28
26 253 Bhattacharya 23 9.3134 26 0.4049 33 10.6397 32 0.4626 39
27 005 Seder2020 23 9.0849 27 0.3950 34 11.9056 25 0.5176 32
28 026 NOVA 23 8.8195 28 0.3835 35 10.5602 33 0.4591 40
29 183 tFold-CaT 23 8.5461 29 0.3716 36 10.4147 35 0.4528 42
30 379 Wallner 23 8.4798 30 0.3687 37 11.3922 29 0.4953 36
31 062 SBROD-select 23 8.3905 31 0.3648 38 10.2751 38 0.4467 45
32 351 tFold-IDT 23 8.3427 32 0.3627 39 9.8608 40 0.4287 47
33 238 tFold 23 8.2796 33 0.3600 41 10.4146 36 0.4528 43
34 018 UNRES-template 23 7.9694 34 0.3465 42 11.5031 26 0.5001 33
35 254 ropius0 23 7.6960 35 0.3346 43 11.4759 27 0.4990 34
36 032 MESHI 23 7.4413 36 0.3235 44 10.3155 37 0.4485 44
37 376 E2E 23 7.3710 37 0.3205 45 12.1496 23 0.5282 30
38 015 AP_1 23 7.1150 38 0.3093 46 10.8171 31 0.4703 38
39 343 VoroCNN-select 23 6.2382 39 0.2712 50 8.0626 52 0.3505 62
40 257 P3De 23 6.1392 40 0.2669 51 10.5355 34 0.4581 41
41 428 Seder2020hard 23 6.1307 41 0.2666 52 9.8274 41 0.4273 48
42 140 Yang-Server 23 5.7330 42 0.2493 53 8.4599 48 0.3678 56
43 339 ProQ3D 23 5.4581 43 0.2373 54 8.3473 49 0.3629 57
44 375 Ornate-select 23 5.4177 44 0.2356 55 8.5792 46 0.3730 54
45 377 Yang_FM 23 4.9489 45 0.2152 56 8.0362 53 0.3494 63
46 187 MULTICOM-HYBRID 23 4.6836 46 0.2036 57 8.8296 45 0.3839 53
47 319 MULTICOM-DIST 23 4.2810 47 0.1861 59 8.1260 51 0.3533 61
48 252 MULTICOM-DEEP 23 4.1085 48 0.1786 60 8.5289 47 0.3708 55
49 209 BAKER-ROSETTASERVER 23 4.0881 49 0.1777 61 9.5547 42 0.4154 50
50 304 Jones-UCL 22 4.0081 50 0.2731 49 9.3125 44 0.4233 49
51 222 TOWER 23 3.7481 51 0.1630 62 7.8873 55 0.3429 65
52 367 FoldX 23 3.6500 52 0.1587 63 6.9916 60 0.3040 72
53 334 FEIG-R3 23 3.5081 53 0.1525 64 9.4779 43 0.4121 51
54 326 FALCON-DeepFolder 23 3.4822 54 0.1514 65 7.0297 57 0.3056 70
55 314 FEIG-R1 23 3.1519 55 0.1370 66 6.9934 59 0.3041 71
56 061 191227 23 3.0057 56 0.1307 67 8.2744 50 0.3598 59
57 198 MULTICOM-CONSTRUCT 23 2.9213 57 0.1270 68 7.9385 54 0.3452 64
58 328 FoldXpro 23 2.8731 58 0.1249 69 6.8206 62 0.2965 75
59 293 MUFOLD_H 23 2.6658 59 0.1159 71 10.0726 39 0.4379 46
60 460 Yang_TBM 23 2.5371 60 0.1103 73 6.9186 61 0.3008 73
61 487 RaptorX 23 1.8550 61 0.0807 74 5.4021 67 0.2349 83
62 075 MULTICOM-CLUSTER 23 1.6349 62 0.0711 75 7.4681 56 0.3247 68
63 337 CATHER 23 -0.3489 63 -0.0152 77 5.6027 64 0.2436 80
64 101 Destini 23 -0.4637 64 -0.0202 78 6.4624 63 0.2810 76
65 392 trfold 23 -0.5689 65 -0.0247 79 4.3378 73 0.1886 89
66 335 FEIG 23 -0.7647 66 -0.0332 80 5.5821 65 0.2427 81
67 468 FALCON-geom 21 -1.5979 67 0.1144 72 7.0109 58 0.3339 66
68 071 Kiharalab 23 -2.2281 68 -0.0969 81 4.6095 71 0.2004 88
69 013 FEIG-S 23 -3.0349 69 -0.1320 83 4.0602 74 0.1765 91
70 096 UNRES-contact 23 -4.9485 70 -0.2152 86 2.3639 82 0.1028 99
71 193 Seok 23 -5.1814 71 -0.2253 88 5.4399 66 0.2365 82
72 192 AILON 23 -5.2572 72 -0.2286 89 3.4483 77 0.1499 94
73 364 Kiharalab_Z_Server 23 -5.6855 73 -0.2472 91 2.2671 83 0.0986 101
74 323 DellaCorteLab 23 -6.0477 74 -0.2629 93 2.1995 84 0.0956 102
75 070 Seok-server 23 -6.8112 75 -0.2961 94 5.1340 69 0.2232 85
76 448 BaiduUSA 21 -8.5227 76 -0.2154 87 2.7548 80 0.1312 96
77 217 CAO-QA1 23 -10.0172 77 -0.4355 101 4.9284 70 0.2143 86
78 453 DMP2 21 -10.3690 78 -0.3033 95 2.9404 79 0.1400 95
79 341 Risoluto 23 -11.0200 79 -0.4791 102 1.7558 88 0.0763 104
80 277 FALCON-TBM 20 -11.1657 80 -0.2583 92 4.5605 72 0.2280 84
81 360 UNRES 23 -11.4905 81 -0.4996 104 1.7410 89 0.0757 105
82 003 SHORTLE 15 -12.9688 82 0.2021 58 5.3899 68 0.3593 60
83 097 AWSEM-Suite 23 -13.2462 83 -0.5759 106 0.8412 101 0.0366 112
84 342 CUTSP 19 -14.2018 84 -0.3264 96 1.9729 87 0.1038 98
85 278 BAKER-ROBETTA 23 -18.4947 85 -0.8041 108 2.1725 85 0.0945 103
86 301 Gonglab-THU 23 -18.5514 86 -0.8066 109 0.4183 110 0.0182 121
87 138 LAW 23 -19.1564 87 -0.8329 110 0.0159 133 0.0007 133
88 050 IntFOLD6 23 -19.4344 88 -0.8450 112 1.2001 96 0.0522 109
89 317 MASS 23 -19.6154 89 -0.8528 113 0.1546 123 0.0067 129
90 014 xianmingpan 23 -22.2709 90 -0.9683 116 3.8555 75 0.1676 92
91 352 laufer_ros 11 -22.7174 91 0.1166 70 3.5629 76 0.3239 69
92 259 AWSEM-CHEN 23 -23.2146 92 -1.0093 117 0.0780 126 0.0034 130
93 250 ferrari 12 -23.4609 93 -0.1217 82 1.9848 86 0.1654 93
94 349 Spider 21 -23.7197 94 -0.9390 115 0.9862 98 0.0470 111
95 472 Elofsson 13 -25.2685 95 -0.4053 100 2.7063 81 0.2082 87
96 373 HMSCasper-Seq 23 -25.3092 96 -1.1004 118 0.3978 113 0.0173 123
97 131 PerezLab_Gators 14 -26.8148 97 -0.6296 107 3.4406 78 0.2458 79
98 336 Bates_BMM 17 -27.4358 98 -0.9080 114 1.2764 94 0.0751 106
99 483 HMSCasper-MSA 12 -28.2019 99 -0.5168 105 1.2907 93 0.1076 97
100 151 RBO-PSP-CP 23 -28.6746 100 -1.2467 122 0.1667 122 0.0072 128
101 052 GAPF_LNCC_SERVER 20 -29.0624 101 -1.1531 119 0.0000 134 0.0000 134
102 340 Pharmulator 23 -29.2173 102 -1.2703 123 0.8141 102 0.0354 113
103 169 3D-JIGSAW-SwarmLoop 23 -29.2641 103 -1.2724 124 0.6340 106 0.0276 117
104 170 BhageerathH-Plus 23 -29.4672 104 -1.2812 126 0.3217 117 0.0140 125
105 458 HMSCasper-PSSM 23 -30.3497 105 -1.3196 127 0.0389 130 0.0017 131
106 305 CAO-SERVER 23 -31.1053 106 -1.3524 130 0.2491 120 0.0108 126
107 437 MUFOLD2 23 -31.6307 107 -1.3752 133 0.6422 105 0.0279 116
108 081 MUFOLD 22 -31.6650 108 -1.3484 129 0.0000 134 0.0000 134
109 369 DELCLAB 23 -31.8924 109 -1.3866 134 0.0349 131 0.0015 132
110 476 ict-ams 17 -32.3622 110 -1.1978 120 0.3799 115 0.0223 119
111 242 trioFold 16 -33.8755 111 -1.2422 121 0.2298 121 0.0144 124
112 063 ACOMPMOD 23 -34.4440 112 -1.4976 136 0.4130 111 0.0180 122
113 387 edmc_pf 6 -36.3654 113 -0.3942 99 0.3804 114 0.0634 107
114 107 FoldEM 16 -36.6027 114 -1.4127 135 0.3225 116 0.0202 120
115 298 Huang 4 -37.9869 115 0.0033 76 1.3217 92 0.3304 67
116 055 Takeda-Shitaka-Lab 4 -38.6480 116 -0.1620 84 1.0270 97 0.2567 78
117 451 Seok-assembly 4 -38.7375 117 -0.1844 85 1.5490 90 0.3873 52
118 132 PBuild 10 -38.7532 118 -1.2753 125 0.0000 134 0.0000 134
119 029 Venclovas 4 -39.5720 119 -0.3930 98 0.7460 103 0.1865 90
120 173 Vakser 4 -39.9509 120 -0.4877 103 0.4086 112 0.1021 100
121 060 m3g 3 -40.7190 121 -0.2397 90 0.0989 125 0.0330 115
122 354 FALCON 2 -40.8326 122 0.5837 18 1.2185 95 0.6092 20
123 027 SSThread 3 -41.1139 123 -0.3713 97 0.1021 124 0.0340 114
124 066 LamoureuxLab 2 -41.2798 124 0.3601 40 0.7202 104 0.3601 58
125 033 ishidalab 7 -41.5452 125 -1.3636 132 0.0000 134 0.0000 134
126 221 Kozakov-Vajda 1 -42.6856 126 1.3144 2 1.3788 91 1.3788 2
127 279 PierceLab 1 -43.0863 127 0.9137 8 0.9137 100 0.9137 9
128 467 ricardo 1 -43.1139 128 0.8861 9 0.9685 99 0.9685 7
129 196 bioinsilico_sbi 6 -43.2141 129 -1.5357 137 0.0477 128 0.0079 127
130 177 Zou 1 -43.3763 130 0.6237 16 0.6237 108 0.6237 18
131 275 MULTICOM-AI 1 -43.4080 131 0.5920 17 0.6244 107 0.6244 17
132 285 Kiharalab_Assembly 1 -43.4300 132 0.5700 19 0.5726 109 0.5726 25
133 004 GAPF_LNCC 2 -43.6760 133 -0.8380 111 0.0000 134 0.0000 134
134 182 Zhang-Assembly 1 -43.7024 134 0.2976 47 0.2976 118 0.2976 74
135 099 Fernandez-Recio 1 -43.7233 135 0.2767 48 0.2767 119 0.2767 77
136 211 MESHI_server 3 -43.9978 136 -1.3326 128 0.0000 134 0.0000 134
137 491 Seok-naive_assembly 3 -45.1900 137 -1.7300 140 0.0000 134 0.0000 134
138 195 ShanghaiTech 1 -45.3570 138 -1.3570 131 0.0590 127 0.0590 108
139 477 CoDock 1 -45.6024 139 -1.6024 138 0.0250 132 0.0250 118
140 103 CAPRI-Shen 1 -45.6073 140 -1.6073 139 0.0476 129 0.0476 110
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2020, University of California, Davis