13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
Menu
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
    • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
      The ranking of the groups is based on the analysis of zscores for GDT_TS.
    • TBM-easy
    • TBM-hard
    • TBM/FM
    • FM
    • FM_sp (Combination of EUs: T0953s2-D23, T0984, T1000, T1002)
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 322 Zhang 61 53.9389 1 0.8842 1 53.9389 1 0.8842 1
2 043 A7D 61 42.1095 6 0.6903 6 49.7481 2 0.8155 2
3 089 MULTICOM 61 49.2604 2 0.8075 2 49.2604 3 0.8075 3
4 261 Zhang-Server 61 47.4510 3 0.7779 3 47.4510 4 0.7779 4
5 460 McGuffin 61 45.6619 4 0.7486 4 46.3340 5 0.7596 5
6 145 QUARK 61 45.2981 5 0.7426 5 45.3458 6 0.7434 6
7 222 Seok-refine 61 39.0742 9 0.6406 10 43.2178 7 0.7085 7
8 274 MUFold 61 38.9485 10 0.6385 11 41.9283 8 0.6873 9
9 135 SBROD 59 36.7027 13 0.6899 7 41.3832 9 0.7014 8
10 324 RaptorX-DeepModeller 61 40.6231 7 0.6660 8 41.3440 10 0.6778 10
11 354 wfAll-Cheng 61 39.3019 8 0.6443 9 40.5704 11 0.6651 11
12 221 RaptorX-TBM 61 37.5694 11 0.6159 12 39.3056 12 0.6444 13
13 344 Kiharalab 61 36.3260 14 0.5955 14 38.9248 13 0.6381 14
14 192 Elofsson 61 37.3508 12 0.6123 13 38.3967 14 0.6295 15
15 197 MESHI 61 35.9076 15 0.5886 15 38.3485 15 0.6287 16
16 055 VoroMQA-select 61 34.5358 16 0.5662 17 37.6757 16 0.6176 18
17 086 BAKER 60 31.1540 20 0.5526 19 37.2977 17 0.6216 17
18 068 Seok 61 29.2387 24 0.4793 25 36.6995 18 0.6016 19
19 196 Grudinin 61 34.0761 17 0.5586 18 35.8773 19 0.5882 20
20 406 Seder3mm 61 30.0232 21 0.4922 22 35.7006 20 0.5853 21
21 156 Seok-server 61 31.2794 19 0.5128 21 34.9880 21 0.5736 22
22 390 Bhattacharya 61 29.7270 22 0.4873 23 34.4246 22 0.5643 23
23 243 MULTICOM-CONSTRUCT 61 31.3192 18 0.5134 20 32.2509 23 0.5287 25
24 418 Seder3nc 61 11.3970 41 0.1868 49 32.0860 24 0.5260 26
25 241 Bhageerath-Star 61 21.0154 29 0.3445 35 31.8985 25 0.5229 27
26 044 ProQ2 60 20.9700 30 0.3828 30 31.8704 26 0.5312 24
27 368 BAKER-ROSETTASERVER 61 22.2805 28 0.3653 32 31.8182 27 0.5216 28
28 071 Seder3full 61 10.6556 43 0.1747 52 31.2562 28 0.5124 31
29 441 FALCON 61 26.1694 25 0.4290 28 31.0125 29 0.5084 33
30 023 MULTICOM-NOVEL 61 29.3393 23 0.4810 24 30.8570 30 0.5059 34
31 366 Venclovas 46 -3.1727 48 0.5832 16 30.2870 31 0.6584 12
32 214 wfRosetta-ModF7 59 16.5728 38 0.3487 34 30.2627 32 0.5129 30
33 208 KIAS-Gdansk 57 17.6562 36 0.4501 26 29.0634 33 0.5099 32
34 058 MULTICOM_CLUSTER 61 26.1353 26 0.4284 29 28.9977 34 0.4754 36
35 309 Seder1 61 13.6991 40 0.2246 47 28.5790 35 0.4685 38
36 246 IntFOLD5 61 19.1097 33 0.3133 40 28.4900 36 0.4670 39
37 457 Wallner 60 17.7942 35 0.3299 37 28.1461 37 0.4691 37
38 426 AP_1 61 18.5272 34 0.3037 41 28.0128 38 0.4592 40
39 117 Jones-UCL 61 19.9144 32 0.3265 38 27.1657 39 0.4453 43
40 164 Yang-Server 59 17.0327 37 0.3565 33 26.8897 40 0.4558 41
41 329 D-Haven 61 20.1310 31 0.3300 36 26.6674 41 0.4372 44
42 224 Destini 61 22.7764 27 0.3734 31 25.2010 42 0.4131 45
43 446 slbio 50 -7.4869 52 0.2903 42 24.7750 43 0.4955 35
44 116 Zhang-CEthreader 61 11.2563 42 0.1845 50 24.0717 44 0.3946 48
45 281 SHORTLE 46 -10.1177 54 0.4322 27 23.8328 45 0.5181 29
46 471 CPClab 60 9.9581 45 0.1993 48 23.6806 46 0.3947 47
47 149 Zhou-SPOT-3D 61 13.8544 39 0.2271 46 23.3770 47 0.3832 50
48 266 slbio_server 52 -3.0356 47 0.2878 43 23.1704 48 0.4456 42
49 377 wfRstta-Maghrabi-TQA 59 -6.0685 51 -0.0351 54 22.6661 49 0.3842 49
50 279 ZHOU-SPOT 59 6.4081 46 0.1764 51 21.2588 50 0.3603 52
51 163 Bates_BMM 50 -6.0177 50 0.3196 39 20.6294 51 0.4126 46
52 160 CMA-align 59 10.2675 44 0.2418 44 20.2748 52 0.3436 54
53 244 Seder3hard 61 -36.4659 67 -0.5978 73 18.7596 53 0.3075 56
54 470 Seok-assembly 50 -26.5001 63 -0.0900 56 18.6498 54 0.3730 51
55 337 FALCON-TBM 61 -9.9848 53 -0.1637 58 18.5887 55 0.3047 57
56 335 wfRosetta-PQ2-AngQA 61 -13.3341 56 -0.2186 62 17.7187 56 0.2905 60
57 498 RaptorX-Contact 61 -3.3549 49 -0.0550 55 17.0731 57 0.2799 62
58 004 YASARA 55 -22.1268 59 -0.1841 60 15.4062 58 0.2801 61
59 347 MESHI-server 41 -30.3569 65 0.2352 45 14.3127 59 0.3491 53
60 432 Seok-naive_assembly 39 -56.5697 70 -0.3223 66 11.5009 60 0.2949 59
61 402 RBO-Aleph 56 -19.9127 58 -0.1770 59 11.4946 61 0.2053 64
62 397 PepBuilderJ 57 -25.0086 61 -0.2984 65 11.2458 62 0.1973 65
63 110 Distill 61 -13.3054 55 -0.2181 61 11.1473 63 0.1827 66
64 047 chuo-u 52 -29.5482 64 -0.2221 63 10.8654 64 0.2090 63
65 085 BhageerathH-Plus 61 -25.8176 62 -0.4232 68 10.4735 65 0.1717 67
66 312 MUFold_server 61 -34.6397 66 -0.5679 72 10.1265 66 0.1660 68
67 488 Delta-Gelly-Server 59 -41.6072 68 -0.6374 75 9.0658 67 0.1537 69
68 112 AWSEM 60 -19.4894 57 -0.2915 64 8.8993 68 0.1483 70
69 124 AWSEM-Suite 60 -22.5097 60 -0.3418 67 6.8644 69 0.1144 72
70 472 DELClab 57 -59.3302 72 -0.9005 77 6.0828 70 0.1067 74
71 358 Spider 55 -42.2425 69 -0.5499 71 5.9321 71 0.1079 73
72 431 Laufer 14 -99.9509 84 -0.4251 69 4.3485 72 0.3106 55
73 092 Ricardo 10 -103.4606 88 -0.1461 57 3.0036 73 0.3004 58
74 492 wf-BAKER-UNRES 54 -58.5956 71 -0.8258 76 2.8979 74 0.0537 76
75 288 UNRES 58 -76.4374 76 -1.2144 83 2.0972 75 0.0362 78
76 097 Laufer_abinitio 15 -109.9431 92 -1.1962 82 2.0789 76 0.1386 71
77 365 3D-JIGSAW_SL1 61 -70.0006 73 -1.1476 79 1.4378 77 0.0236 81
78 407 rawMSA 51 -84.5056 80 -1.2648 85 1.3695 78 0.0269 79
79 077 qmo 13 -102.6308 87 -0.5101 70 1.2146 79 0.0934 75
80 351 DL-Haven 57 -76.1183 75 -1.1951 81 1.1200 80 0.0196 82
81 157 GAPF_LNCC 24 -101.5280 86 -1.1470 78 1.0653 81 0.0444 77
82 041 FALCON-Contact 61 -96.2097 83 -1.5772 90 0.3681 82 0.0060 85
83 122 Forbidden 48 -81.2367 77 -1.1508 80 0.3383 83 0.0070 84
84 007 ACOMPMOD 61 -82.8476 79 -1.3582 87 0.2768 84 0.0045 87
85 257 NOCONTACT 57 -107.5900 90 -1.7472 98 0.2703 85 0.0047 86
86 381 GONGLAB-THU 61 -75.8924 74 -1.2441 84 0.2400 86 0.0039 88
87 152 PconsC4 61 -82.8160 78 -1.3576 86 0.2154 87 0.0035 89
88 389 UpsideUChicago 6 -119.8170 96 -1.6362 93 0.1494 88 0.0249 80
89 282 PRAYOG 55 -93.0361 82 -1.4734 88 0.0653 89 0.0012 90
90 250 Meilerlab 1 -119.9843 97 0.0157 53 0.0157 90 0.0157 83
91 473 Maurice 1 -120.6202 99 -0.6202 74 0.0000 91 0.0000 91
92 497 GaussDCA 61 -93.0002 81 -1.5246 89 0.0000 91 0.0000 91
93 414 BCLMeilerLab 20 -113.5729 93 -1.5786 91 0.0000 91 0.0000 91
94 401 InnoUNRES 9 -118.2221 94 -1.5802 92 0.0000 91 0.0000 91
95 458 FOLDNET 35 -109.7082 91 -1.6488 94 0.0000 91 0.0000 91
96 348 HMSCasper-Refiner 61 -100.7238 85 -1.6512 95 0.0000 91 0.0000 91
97 380 Laufer_100 6 -120.2270 98 -1.7045 96 0.0000 91 0.0000 91
98 378 Cao-server 61 -104.9321 89 -1.7202 97 0.0000 91 0.0000 91
99 476 Sun_Tsinghua 25 -118.3959 95 -1.8558 99 0.0000 91 0.0000 91
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis