13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
Menu
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
    • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
      The ranking of the groups is based on the analysis of zscores for GDT_TS.
    • TBM-easy
    • TBM-hard
    • TBM/FM
    • FM
    • FM_sp (Combination of EUs: T0953s2-D23, T0984, T1000, T1002)
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 043 A7D 104 116.6089 1 1.1212 1 125.7370 1 1.2090 1
2 322 Zhang 104 96.6936 2 0.9297 2 96.6936 2 0.9297 2
3 089 MULTICOM 104 94.5294 3 0.9089 3 94.9325 3 0.9128 3
4 354 wfAll-Cheng 104 88.3423 4 0.8494 4 88.8507 4 0.8543 4
5 197 MESHI 104 86.7349 6 0.8340 7 88.5575 5 0.8515 5
6 055 VoroMQA-select 104 86.9170 5 0.8357 6 87.6026 6 0.8423 6
7 135 SBROD 102 81.2874 11 0.8362 5 85.6199 7 0.8394 7
8 192 Elofsson 103 82.3882 9 0.8193 8 85.3607 8 0.8287 8
9 390 Bhattacharya 104 83.4917 8 0.8028 10 84.3004 9 0.8106 10
10 224 Destini 104 84.1260 7 0.8089 9 84.1260 10 0.8089 11
11 309 Seder1 104 78.6179 16 0.7559 18 83.0715 11 0.7988 12
12 344 Kiharalab 104 80.5499 12 0.7745 12 81.5785 12 0.7844 13
13 261 Zhang-Server 104 81.4993 10 0.7836 11 81.4993 13 0.7836 14
14 196 Grudinin 104 80.0349 14 0.7696 14 81.2470 14 0.7812 15
15 406 Seder3mm 104 79.4608 15 0.7640 17 81.0565 15 0.7794 16
16 145 QUARK 104 80.2613 13 0.7717 13 80.2796 16 0.7719 19
17 457 Wallner 103 76.9575 17 0.7666 16 80.2014 17 0.7787 17
18 044 ProQ2 103 72.7042 19 0.7253 19 79.9838 18 0.7765 18
19 426 AP_1 104 75.2884 18 0.7239 20 78.2490 19 0.7524 20
20 241 Bhageerath-Star 104 71.9825 20 0.6921 21 76.6176 20 0.7367 21
21 418 Seder3nc 104 60.4396 22 0.5811 25 69.0685 21 0.6641 23
22 324 RaptorX-DeepModeller 104 62.9300 21 0.6051 23 67.2546 22 0.6467 25
23 086 BAKER 102 55.6846 25 0.5851 24 67.1571 23 0.6584 24
24 274 MUFold 104 57.6071 23 0.5539 26 65.8105 24 0.6328 26
25 460 McGuffin 104 56.3706 24 0.5420 27 63.3923 25 0.6095 27
26 222 Seok-refine 104 43.2208 27 0.4156 31 60.6461 26 0.5831 28
27 366 Venclovas 74 -3.2341 45 0.7671 15 60.2112 27 0.8137 9
28 071 Seder3full 104 47.6655 26 0.4583 29 59.9015 28 0.5760 29
29 208 KIAS-Gdansk 100 41.5636 29 0.4956 28 55.6729 29 0.5567 30
30 368 BAKER-ROSETTASERVER 103 41.8525 28 0.4258 30 55.2063 30 0.5360 31
31 446 slbio 73 -12.1558 50 0.6828 22 51.9337 31 0.7114 22
32 068 Seok 104 27.7943 32 0.2673 36 49.3561 32 0.4746 34
33 117 Jones-UCL 104 36.3197 31 0.3492 33 48.8048 33 0.4693 35
34 214 wfRosetta-ModF7 100 22.6464 35 0.3065 35 48.0462 34 0.4805 33
35 221 RaptorX-TBM 104 38.0024 30 0.3654 32 47.4766 35 0.4565 36
36 244 Seder3hard 104 -4.3886 46 -0.0422 53 44.7838 36 0.4306 37
37 498 RaptorX-Contact 104 13.0698 37 0.1257 41 42.3342 37 0.4071 38
38 163 Bates_BMM 82 -17.3185 51 0.3254 34 40.5822 38 0.4949 32
39 377 wfRstta-Maghrabi-TQA 102 -7.4788 47 -0.0341 52 37.8469 39 0.3710 40
40 243 MULTICOM-CONSTRUCT 104 25.4187 33 0.2444 37 36.5384 40 0.3513 42
41 441 FALCON 104 10.5216 40 0.1012 45 34.4023 41 0.3308 43
42 058 MULTICOM_CLUSTER 104 22.9657 34 0.2208 38 33.9729 42 0.3267 44
43 329 D-Haven 104 12.4622 39 0.1198 43 33.8883 43 0.3258 45
44 023 MULTICOM-NOVEL 104 18.7299 36 0.1801 39 32.2108 44 0.3097 47
45 335 wfRosetta-PQ2-AngQA 104 -20.6408 53 -0.1985 58 31.9431 45 0.3071 48
46 156 Seok-server 104 -11.4058 49 -0.1097 54 31.5833 46 0.3037 50
47 279 ZHOU-SPOT 101 3.4862 43 0.0939 46 30.6792 47 0.3038 49
48 149 Zhou-SPOT-3D 104 12.7335 38 0.1224 42 30.1179 48 0.2896 52
49 281 SHORTLE 81 -33.7014 57 0.1518 40 29.8292 49 0.3683 41
50 116 Zhang-CEthreader 104 9.0425 41 0.0869 47 28.5718 50 0.2747 53
51 164 Yang-Server 101 5.8308 42 0.1171 44 27.6488 51 0.2738 54
52 246 IntFOLD5 104 -3.1899 44 -0.0307 51 26.8531 52 0.2582 55
53 470 Seok-assembly 80 -58.1596 62 -0.1270 55 25.3180 53 0.3165 46
54 471 CPClab 103 -17.6065 52 -0.1515 56 24.5121 54 0.2380 57
55 266 slbio_server 91 -50.4079 58 -0.2682 61 21.6816 55 0.2383 56
56 160 CMA-align 100 -8.9752 48 -0.0098 49 19.6939 56 0.1969 60
57 112 AWSEM 101 -21.4781 54 -0.1532 57 19.0400 57 0.1885 61
58 337 FALCON-TBM 104 -30.2404 56 -0.2908 63 18.8384 58 0.1811 62
59 124 AWSEM-Suite 103 -30.0525 55 -0.2724 62 16.0047 59 0.1554 66
60 432 Seok-naive_assembly 52 -114.5688 73 -0.2032 59 15.6412 60 0.3008 51
61 431 Laufer 40 -128.6951 79 -0.0174 50 15.2002 61 0.3800 39
62 004 YASARA 93 -56.2539 60 -0.3683 65 15.1416 62 0.1628 65
63 488 Delta-Gelly-Server 102 -61.9862 64 -0.5685 69 14.2048 63 0.1393 67
64 402 RBO-Aleph 96 -59.2943 63 -0.4510 67 12.7776 64 0.1331 68
65 347 MESHI-server 50 -106.2933 70 0.0341 48 11.5826 65 0.2317 58
66 047 chuo-u 95 -57.4799 61 -0.4156 66 9.9510 66 0.1047 70
67 312 MUFold_server 104 -76.4781 67 -0.7354 75 9.3248 67 0.0897 72
68 110 Distill 104 -55.0605 59 -0.5294 68 8.8490 68 0.0851 73
69 397 PepBuilderJ 81 -95.7217 69 -0.6138 74 8.6014 69 0.1062 69
70 492 wf-BAKER-UNRES 97 -72.6199 66 -0.6043 72 7.7588 70 0.0800 74
71 085 BhageerathH-Plus 104 -62.8657 65 -0.6045 73 7.2569 71 0.0698 75
72 097 Laufer_abinitio 37 -156.3360 86 -0.6037 71 6.4952 72 0.1755 64
73 407 rawMSA 92 -115.7490 74 -0.9973 80 5.8530 73 0.0636 76
74 358 Spider 98 -88.2507 68 -0.7781 76 4.6173 74 0.0471 78
75 288 UNRES 101 -111.0554 71 -1.0402 82 4.3853 75 0.0434 79
76 472 DELClab 101 -125.3768 78 -1.1819 87 3.8529 76 0.0381 80
77 007 ACOMPMOD 104 -131.0321 80 -1.2599 89 3.4567 77 0.0332 81
78 380 Laufer_100 18 -186.0264 94 -0.7792 77 3.1711 78 0.1762 63
79 152 PconsC4 104 -119.5391 77 -1.1494 86 3.0041 79 0.0289 83
80 351 DL-Haven 100 -113.3653 72 -1.0537 83 2.8999 80 0.0290 82
81 077 qmo 27 -169.9453 90 -0.5906 70 2.4639 81 0.0913 71
82 092 Ricardo 11 -189.7554 95 -0.3414 64 2.2283 82 0.2026 59
83 122 Forbidden 87 -118.4106 76 -0.9702 79 2.1021 83 0.0242 85
84 497 GaussDCA 104 -142.8197 83 -1.3733 93 1.4674 84 0.0141 87
85 041 FALCON-Contact 104 -143.6816 84 -1.3816 94 1.2393 85 0.0119 88
86 389 UpsideUChicago 18 -190.6566 96 -1.0365 81 1.1115 86 0.0617 77
87 157 GAPF_LNCC 51 -164.5613 88 -1.1483 85 1.0466 87 0.0205 86
88 365 3D-JIGSAW_SL1 104 -134.3012 81 -1.2914 91 0.9007 88 0.0087 90
89 381 GONGLAB-THU 104 -117.1747 75 -1.1267 84 0.7079 89 0.0068 91
90 257 NOCONTACT 100 -177.1067 91 -1.6911 98 0.5673 90 0.0057 92
91 282 PRAYOG 92 -141.8202 82 -1.2807 90 0.4654 91 0.0051 93
92 401 InnoUNRES 29 -184.8492 93 -1.2017 88 0.3203 92 0.0110 89
93 473 Maurice 12 -193.3875 98 -0.7823 78 0.2999 93 0.0250 84
94 348 HMSCasper-Refiner 104 -155.9198 85 -1.4992 95 0.2223 94 0.0021 94
95 414 BCLMeilerLab 59 -169.3656 89 -1.3452 92 0.1216 95 0.0021 95
96 250 Meilerlab 1 -206.2142 99 -0.2142 60 0.0000 96 0.0000 96
97 378 Cao-server 104 -158.2197 87 -1.5213 96 0.0000 96 0.0000 96
98 458 FOLDNET 66 -177.1365 92 -1.5324 97 0.0000 96 0.0000 96
99 476 Sun_Tsinghua 51 -193.1777 97 -1.7094 99 0.0000 96 0.0000 96
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis