CASP1 - CASP9
(* results recalculated with new /updated structure comparison programs in 2019)
`
TS Analysis : Z-score based relative group performance

    Models:

    • Ranking on the models designated as "1"
    • Ranking on best models

    Groups:

    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets

    Formula and Domains:

      The ranking of groups is based on the analysis of zscores for GDT_TS.
    • easy (TBM)
    • medium (TBM/FM)
    • hard (FM)
 
 
  #   GR
  code 
  GR
  name
  Domains   
  Count
  SUM Zscore   
  (>-2.0)
  Rank SUM Zscore   
  (>-2.0)
  AVG Zscore   
  (>-2.0)
  Rank AVG Zscore   
  (>-2.0)
  SUM Zscore   
  (>0.0)
  Rank SUM Zscore   
  (>0.0)
  AVG Zscore   
  (>0.0)
  Rank AVG Zscore   
  (>0.0)
1 024 Zhang 123 120.6670 1 0.9810 1 120.9700 1 0.9835 1
2 025 Zhang-Server 123 97.6230 2 0.7937 3 99.6960 2 0.8105 3
3 050 SBC 121 88.1230 4 0.7283 5 94.0200 3 0.7770 4
4 664 CIRCLE-FAMS 122 89.4820 3 0.7335 4 91.8120 4 0.7526 5
5 651 verify 122 86.6580 5 0.7103 6 89.4480 5 0.7332 6
6 005 luethy 123 83.3990 7 0.6780 8 88.3500 6 0.7183 8
7 698 MQAP-Consensus 122 85.0970 6 0.6975 7 88.1960 7 0.7229 7
8 675 FAMS_ACE 122 81.6310 8 0.6691 9 85.9260 8 0.7043 9
9 047 Pmodeller6 123 68.6320 11 0.5580 13 78.0790 9 0.6348 12
10 658 hPredGrp 122 70.6820 9 0.5794 11 77.8060 10 0.6378 11
11 671 FAMS-MULTI 122 70.0550 10 0.5742 12 73.7730 11 0.6047 14
12 004 ROBETTA 122 63.2410 12 0.5184 14 69.9460 12 0.5733 15
13 307 MetaTasser 122 54.8990 13 0.4500 16 68.5620 13 0.5620 16
14 214 BayesHH 122 48.3240 18 0.3961 20 65.0000 14 0.5328 17
15 710 Ligand-Circle 105 50.9020 16 0.4848 15 64.9450 15 0.6185 13
16 213 HHpred2 116 44.9070 20 0.3871 21 61.3090 16 0.5285 18
17 046 Pcons6 123 53.7280 14 0.4368 18 61.0420 17 0.4963 21
18 298 CIRCLE 122 51.4790 15 0.4220 19 59.2740 18 0.4859 22
19 418 HHpred3 115 43.6700 23 0.3797 23 57.7540 19 0.5022 19
20 034 ROKKO 119 42.0650 24 0.3535 26 56.1890 20 0.4722 23
21 105 andante 112 49.4350 17 0.4414 17 56.1660 21 0.5015 20
22 349 FAMSD 122 46.9620 19 0.3849 22 54.4410 22 0.4462 24
23 267 RAPTOR-ACE 122 44.1690 21 0.3620 24 53.4270 23 0.4379 25
24 245 UNI-EID_expm 122 34.3920 30 0.2819 33 53.2920 24 0.4368 26
25 351 FAMS 122 44.1010 22 0.3615 25 51.9420 25 0.4258 28
26 248 RAPTOR 122 37.2870 27 0.3056 30 50.6700 26 0.4153 29
27 275 beautshot 122 38.7820 25 0.3179 29 50.4880 27 0.4138 30
28 414 SP3 122 36.5130 29 0.2993 32 49.5960 28 0.4065 31
29 212 HHpred1 114 30.8400 31 0.2705 34 49.5740 29 0.4349 27
30 415 SP4 122 37.0460 28 0.3037 31 49.4810 30 0.4056 32
31 137 3Dpro 122 29.5210 32 0.2420 36 49.3630 31 0.4046 33
32 091 Ma-OPUS 121 38.4820 26 0.3180 28 48.1670 32 0.3981 34
33 383 UNI-EID_bnmx 122 29.0800 35 0.2384 38 47.5220 33 0.3895 35
34 435 RAPTORESS 122 29.0860 34 0.2384 37 45.5640 34 0.3735 36
35 029 PROTINFO-AB 121 19.3520 42 0.1599 45 43.1450 35 0.3566 38
36 092 Ma-OPUS-server 122 18.1530 44 0.1488 47 43.1020 36 0.3533 41
37 035 ROKKY 121 20.6680 41 0.1708 44 42.3980 37 0.3504 43
38 347 beautshotbase 119 27.4940 36 0.2310 39 42.3520 38 0.3559 39
39 028 PROTINFO 119 22.0800 40 0.1855 43 42.2810 39 0.3553 40
40 609 GeneSilicoMetaServer 114 29.1790 33 0.2560 35 42.1140 40 0.3694 37
41 136 FOLDpro 122 15.2410 46 0.1249 50 41.4480 41 0.3397 45
42 318 FUNCTION 120 27.3110 37 0.2276 40 41.1200 42 0.3427 44
43 274 Shub 122 22.6690 39 0.1858 42 40.6990 43 0.3336 47
44 413 SPARKS2 122 23.8370 38 0.1954 41 40.5220 44 0.3321 48
45 389 SAM_T06_server 122 14.7140 48 0.1206 52 40.3890 45 0.3311 50
46 469 Phyre-2 120 16.2950 45 0.1358 48 39.7410 46 0.3312 49
47 135 CBSU 122 18.9310 43 0.1552 46 39.5430 47 0.3241 51
48 211 KIST 117 15.1040 47 0.1291 49 39.1420 48 0.3345 46
49 243 UNI-EID_sfst 118 4.4350 52 0.0376 54 33.6170 49 0.2849 55
50 277 keasar-server 116 4.0150 53 0.0346 55 33.1500 50 0.2858 54
51 179 Bilab-ENABLE 121 -0.4180 57 -0.0035 57 32.7400 51 0.2706 56
52 261 mGen-3D 105 13.0510 49 0.1243 51 30.5940 52 0.2914 53
53 083 LOOPP 121 2.2750 55 0.0188 56 29.9990 53 0.2479 57
54 319 FUGMOD 111 -0.7910 58 -0.0071 58 27.2100 54 0.2451 58
55 132 Softberry 116 -13.0890 62 -0.1128 61 27.1160 55 0.2338 59
56 654 NN_PUT_lab 118 -2.0540 59 -0.0174 59 26.6070 56 0.2255 61
57 063 FEIG 121 -15.9270 63 -0.1316 62 25.4990 57 0.2107 64
58 728 Ma-OPUS-server2 77 7.9700 50 0.1035 53 24.2810 58 0.3153 52
59 022 karypis.srv 100 -20.2330 67 -0.2023 68 22.8980 59 0.2290 60
60 706 TENETA 118 -21.3350 69 -0.1808 66 21.2470 60 0.1801 67
61 381 SAM-T02 115 -20.8470 68 -0.1813 67 21.1990 61 0.1843 65
62 242 FUGUE 119 -18.9670 66 -0.1594 63 20.9230 62 0.1758 68
63 380 SAM-T99 94 -5.9030 61 -0.0628 60 20.8760 63 0.2221 62
64 239 nFOLD 111 -18.0350 65 -0.1625 64 20.1480 64 0.1815 66
65 268 karypis.srv.2 95 -17.0430 64 -0.1794 65 20.0990 65 0.2116 63
66 468 Phyre-1 114 -24.7930 71 -0.2175 70 19.4680 66 0.1708 69
67 197 MTUNIC 117 -67.5210 80 -0.5771 78 18.8580 67 0.1612 71
68 247 3D-JIGSAW_POPULUS 117 -25.4160 72 -0.2172 69 18.1680 68 0.1553 72
69 203 forecast 117 -64.9990 79 -0.5555 77 17.5070 69 0.1496 73
70 316 FORTE2 123 -51.4600 76 -0.4184 75 17.3740 70 0.1413 75
71 102 Huber-Torda-Server 119 -57.3500 77 -0.4819 76 17.2910 71 0.1453 74
72 420 3D-JIGSAW_RECOM 116 -32.2630 73 -0.2781 71 16.0990 72 0.1388 76
73 257 FORTE1 123 -50.1460 75 -0.4077 74 14.8200 73 0.1205 78
74 302 3D-JIGSAW 116 -39.9870 74 -0.3447 72 12.7320 74 0.1098 79
75 333 forecast-s 114 -73.9820 81 -0.6490 79 12.4110 75 0.1089 80
76 168 Distill 122 -99.1650 83 -0.8128 81 11.5030 76 0.0943 81
77 494 CPHmodels 61 -24.3870 70 -0.3998 73 8.4320 77 0.1382 77
78 040 YASARA 23 7.6420 51 0.3323 27 8.1150 78 0.3528 42
79 550 ZIB-THESEUS 101 -85.9770 82 -0.8513 82 7.2280 79 0.0716 82
80 060 HIT-ITNLP 119 -120.4590 84 -1.0123 83 5.5190 80 0.0464 84
81 721 ROBETTA-late 6 3.8610 54 0.6435 10 4.1790 81 0.6965 10
82 427 CADCMLAB 116 -151.7270 86 -1.3080 85 2.9370 82 0.0253 85
83 586 MIG_FROST 51 -60.5500 78 -1.1873 84 2.5050 83 0.0491 83
84 495 largo 2 1.8330 56 0.9165 2 1.8330 84 0.9165 2
85 193 karypis.srv.4 82 -136.4080 85 -1.6635 86 0.6250 85 0.0076 86
86 588 MIG_FROST_FLEX 3 -2.1750 60 -0.7250 80 0.5030 86 0.1677 70
87 511 FPSOLVER-SERVER 115 -194.4460 87 -1.6908 87 0.1030 87 0.0009 87
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2026, University of California, Davis