CASP1 - CASP9
(* results recalculated with new /updated structure comparison programs in 2019)
`
TS Analysis : Z-score based relative group performance

    Models:

    • Ranking on the models designated as "1"
    • Ranking on best models

    Groups:

    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets

    Formula and Domains:

      The ranking of groups is based on the analysis of zscores for GDT_TS.
    • easy (TBM)
    • medium (TBM/FM)
    • hard (FM)
 
 
  #   GR
  code 
  GR
  name
  Domains   
  Count
  SUM Zscore   
  (>-2.0)
  Rank SUM Zscore   
  (>-2.0)
  AVG Zscore   
  (>-2.0)
  Rank AVG Zscore   
  (>-2.0)
  SUM Zscore   
  (>0.0)
  Rank SUM Zscore   
  (>0.0)
  AVG Zscore   
  (>0.0)
  Rank AVG Zscore   
  (>0.0)
1 208 SVMQA 1 -2.0000 1 -2.0000 1 0.0000 1 0.0000 1
2 418 slbio_h 1 -2.0000 1 -2.0000 1 0.0000 1 0.0000 1
3 430 GOAL_COMPLEX 2 -4.0000 3 -2.0000 1 0.0000 1 0.0000 1
4 284 Seok-naive_assembly 2 -4.0000 3 -2.0000 1 0.0000 1 0.0000 1
5 140 updppf 2 -4.0000 3 -2.0000 1 0.0000 1 0.0000 1
6 151 Ricardo 5 -10.0000 6 -2.0000 1 0.0000 1 0.0000 1
7 187 Grudinin-DeepL 9 -18.0000 7 -2.0000 1 0.0000 1 0.0000 1
8 295 Grudinin 9 -18.0000 7 -2.0000 1 0.0000 1 0.0000 1
9 436 MELDingKScons 11 -22.0000 9 -2.0000 1 0.0000 1 0.0000 1
10 367 StructPre 13 -26.0000 10 -2.0000 1 0.0000 1 0.0000 1
11 322 SSThread 17 -34.0000 11 -2.0000 1 0.0000 1 0.0000 1
12 229 Sun_Tsinghua 17 -34.0000 11 -2.0000 1 0.0000 1 0.0000 1
13 282 Rosetta_at_Kingston 20 -40.0000 13 -2.0000 1 0.0000 1 0.0000 1
14 330 Laufer_seed 20 -40.0000 13 -2.0000 1 0.0000 1 0.0000 1
15 083 Laufer 21 -42.0000 15 -2.0000 1 0.0000 1 0.0000 1
16 300 wf-BAKER-UNRES 22 -44.0000 16 -2.0000 1 0.0000 1 0.0000 1
17 218 TheoChemBiotech 24 -48.0000 17 -2.0000 1 0.0000 1 0.0000 1
18 495 Seok-assembly 30 -60.0000 18 -2.0000 1 0.0000 1 0.0000 1
19 356 TSlab-assembly 30 -60.0000 18 -2.0000 1 0.0000 1 0.0000 1
20 145 InnoUNRES 33 -66.0000 20 -2.0000 1 0.0000 1 0.0000 1
21 441 wfRstta-PQ-MESHI-MSC 36 -72.0000 21 -2.0000 1 0.0000 1 0.0000 1
22 475 wfDB_BW_SVGroup 37 -74.0000 22 -2.0000 1 0.0000 1 0.0000 1
23 028 M4T-SmotifTF 37 -74.0000 22 -2.0000 1 0.0000 1 0.0000 1
24 474 SHORTLE 38 -76.0000 24 -2.0000 1 0.0000 1 0.0000 1
25 325 wfRosetta-MUfold 39 -78.0000 25 -2.0000 1 0.0000 1 0.0000 1
26 173 wfRosetta-ProQ-MESHI 39 -78.0000 25 -2.0000 1 0.0000 1 0.0000 1
27 126 EdaRose 40 -80.0000 27 -2.0000 1 0.0000 1 0.0000 1
28 046 uv-SAtree 41 -82.0000 28 -2.0000 1 0.0000 1 0.0000 1
29 064 Jones-UCL 43 -86.0000 29 -2.0000 1 0.0000 1 0.0000 1
30 264 LNCCUnB 44 -88.0000 30 -2.0000 1 0.0000 1 0.0000 1
31 432 Pcons-net 45 -90.0000 31 -2.0000 1 0.0000 1 0.0000 1
32 101 Thifault 48 -96.0000 32 -2.0000 1 0.0000 1 0.0000 1
33 230 WY_C 48 -96.0000 32 -2.0000 1 0.0000 1 0.0000 1
34 166 FFAS03 53 -106.0000 34 -2.0000 1 0.0000 1 0.0000 1
35 042 Elofsson 54 -108.0000 35 -2.0000 1 0.0000 1 0.0000 1
36 182 wfCPUNK 57 -114.0000 36 -2.0000 1 0.0000 1 0.0000 1
37 489 CARLBio 58 -116.0000 37 -2.0000 1 0.0000 1 0.0000 1
38 359 Atome2_CBS 58 -116.0000 37 -2.0000 1 0.0000 1 0.0000 1
39 213 ProQ3 59 -118.0000 39 -2.0000 1 0.0000 1 0.0000 1
40 066 ProQ3_2_diso 59 -118.0000 39 -2.0000 1 0.0000 1 0.0000 1
41 079 iFold_1 59 -118.0000 39 -2.0000 1 0.0000 1 0.0000 1
42 089 Pcons 59 -118.0000 39 -2.0000 1 0.0000 1 0.0000 1
43 095 ProQ3_1_diso 59 -118.0000 39 -2.0000 1 0.0000 1 0.0000 1
44 270 RSA_SS_CONS 59 -118.0000 39 -2.0000 1 0.0000 1 0.0000 1
45 302 ProQ3_1 59 -118.0000 39 -2.0000 1 0.0000 1 0.0000 1
46 421 MUfold2 60 -120.0000 46 -2.0000 1 0.0000 1 0.0000 1
47 162 UNRES 60 -120.0000 46 -2.0000 1 0.0000 1 0.0000 1
48 443 GAPF_LNCC 60 -120.0000 46 -2.0000 1 0.0000 1 0.0000 1
49 452 ZHOU-SPARKS-X 60 -120.0000 46 -2.0000 1 0.0000 1 0.0000 1
50 455 ACOMPMOD 61 -122.0000 50 -2.0000 1 0.0000 1 0.0000 1
51 207 rluethy 61 -122.0000 50 -2.0000 1 0.0000 1 0.0000 1
52 192 ALAdeGAP 61 -122.0000 50 -2.0000 1 0.0000 1 0.0000 1
53 303 wfMESHI-TIGRESS 61 -122.0000 50 -2.0000 1 0.0000 1 0.0000 1
54 252 wfRosetta-ProQ-ModF6 61 -122.0000 50 -2.0000 1 0.0000 1 0.0000 1
55 232 Chicken_George 62 -124.0000 55 -2.0000 1 0.0000 1 0.0000 1
56 188 chuo-u 63 -126.0000 56 -2.0000 1 0.0000 1 0.0000 1
57 275 slbio 63 -126.0000 56 -2.0000 1 0.0000 1 0.0000 1
58 179 Skwark 64 -128.0000 58 -2.0000 1 0.0000 1 0.0000 1
59 251 myprotein-me 64 -128.0000 58 -2.0000 1 0.0000 1 0.0000 1
60 456 wfRosetta-Wallner 64 -128.0000 58 -2.0000 1 0.0000 1 0.0000 1
61 102 Kiharalab 64 -128.0000 58 -2.0000 1 0.0000 1 0.0000 1
62 022 CAMD-BIR_Cuba 64 -128.0000 58 -2.0000 1 0.0000 1 0.0000 1
63 451 RaptorX-Contact 65 -130.0000 63 -2.0000 1 0.0000 1 0.0000 1
64 382 RBO_Aleph 65 -130.0000 63 -2.0000 1 0.0000 1 0.0000 1
65 446 YASARA 65 -130.0000 63 -2.0000 1 0.0000 1 0.0000 1
66 498 AP_1 65 -130.0000 63 -2.0000 1 0.0000 1 0.0000 1
67 420 KF-Consensus 65 -130.0000 63 -2.0000 1 0.0000 1 0.0000 1
68 067 wfRstta-PQ2-Seder 65 -130.0000 63 -2.0000 1 0.0000 1 0.0000 1
69 321 GAPF_LNCC_SERVER 65 -130.0000 63 -2.0000 1 0.0000 1 0.0000 1
70 407 Distill 65 -130.0000 63 -2.0000 1 0.0000 1 0.0000 1
71 239 wfAll-Cheng 65 -130.0000 63 -2.0000 1 0.0000 1 0.0000 1
72 114 Kloczkowski 65 -130.0000 63 -2.0000 1 0.0000 1 0.0000 1
73 171 DELCLAB 65 -130.0000 63 -2.0000 1 0.0000 1 0.0000 1
74 363 Faraggi 66 -132.0000 74 -2.0000 1 0.0000 1 0.0000 1
75 220 GOAL 66 -132.0000 74 -2.0000 1 0.0000 1 0.0000 1
76 247 BAKER 66 -132.0000 74 -2.0000 1 0.0000 1 0.0000 1
77 048 ToyPred_email 67 -134.0000 77 -2.0000 1 0.0000 1 0.0000 1
78 060 KIAS-Gdansk 67 -134.0000 77 -2.0000 1 0.0000 1 0.0000 1
79 040 FLOUDAS 67 -134.0000 77 -2.0000 1 0.0000 1 0.0000 1
80 342 ToyPred 67 -134.0000 77 -2.0000 1 0.0000 1 0.0000 1
81 411 Pcomb-domain 67 -134.0000 77 -2.0000 1 0.0000 1 0.0000 1
82 417 VoroMQA-select 67 -134.0000 77 -2.0000 1 0.0000 1 0.0000 1
83 019 CPCLab 67 -134.0000 77 -2.0000 1 0.0000 1 0.0000 1
84 320 raghavagps 67 -134.0000 77 -2.0000 1 0.0000 1 0.0000 1
85 349 HHPred1 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
86 393 MESHI 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
87 357 FLOUDAS_SERVER 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
88 384 wfMESHI-Seok 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
89 380 chuo-u-server 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
90 026 chuo-u2 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
91 486 TASSER 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
92 483 Pareto 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
93 480 FONT 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
94 004 Zhang 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
95 073 Wallner 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
96 077 FALCON_TOPO 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
97 005 BAKER-ROSETTASERVER 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
98 479 Zhang-Server 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
99 011 LEE 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
100 092 RaptorX 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
101 016 FFAS-3D 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
102 467 Pareto-server 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
103 119 HHPred0 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
104 464 tsspred2 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
105 450 LEEab 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
106 180 PhyreTopoAlpha 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
107 183 QUARK 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
108 444 BhageerathH-Plus 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
109 203 ProQ2 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
110 001 Bates_BMM 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
111 439 MULTICOM 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
112 434 MULTICOM-REFINE 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
113 425 FALCON_TOPOX 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
114 236 MULTICOM-CONSTRUCT 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
115 243 Seok-refine 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
116 250 Seok-server 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
117 258 MUfold1 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
118 017 McGuffin 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
119 287 MULTICOM-CLUSTER 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
120 313 HHGG 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
121 405 IntFOLD4 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
122 324 MUFOLD 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
123 399 Spiders 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
124 396 PML 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
125 345 MULTICOM-NOVEL 68 -136.0000 85 -2.0000 1 0.0000 1 0.0000 1
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2026, University of California, Davis