13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
Menu
TS Analysis : Group performance based on combined z-scores
Results Home
Table Browser
Estimate of Model Accuracy Results
RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
GDT_TS based
Assessors' formula
Models:
Analysis on the models designated as "1"
Analysis on the models with the best scores
Groups:
All groups on 'all groups' targets
Server groups on 'all groups' + 'server only' targets
Targets:
The ranking of the groups is based on the analysis of zscores for
GDT_TS
.
TBM-easy
TBM-hard
TBM/FM
FM
FM_sp (Combination of EUs: T0953s2-D23, T0984, T1000, T1002)
#
GR
code
GR
name
Domains Count
SUM Zscore
(>-2.0)
Rank SUM Zscore
(>-2.0)
AVG Zscore
(>-2.0)
Rank AVG Zscore
(>-2.0)
SUM Zscore
(>0.0)
Rank SUM Zscore
(>0.0)
AVG Zscore
(>0.0)
Rank AVG Zscore
(>0.0)
1
043
A7D
104
120.4307
1
1.1580
1
128.0693
1
1.2314
1
2
322
Zhang
104
107.5948
2
1.0346
2
108.1948
2
1.0403
2
3
089
MULTICOM
104
99.4661
3
0.9564
3
99.9886
3
0.9614
3
4
145
QUARK
104
90.9915
4
0.8749
4
91.5625
4
0.8804
4
5
261
Zhang-Server
104
88.9540
5
0.8553
5
89.7597
5
0.8631
5
6
460
McGuffin
104
81.6353
6
0.7850
6
84.4019
6
0.8116
6
7
354
wfAll-Cheng
104
77.7039
7
0.7472
7
80.9951
7
0.7788
8
8
135
SBROD
102
71.5656
9
0.7408
8
78.9792
8
0.7743
9
9
324
RaptorX-DeepModeller
104
75.4891
8
0.7259
9
78.5878
9
0.7557
10
10
197
MESHI
104
70.9761
10
0.6825
11
76.6354
10
0.7369
11
11
274
MUFold
104
67.6859
13
0.6508
14
74.8175
11
0.7194
12
12
055
VoroMQA-select
104
68.1251
12
0.6550
13
74.1152
12
0.7126
13
13
222
Seok-refine
104
63.5532
15
0.6111
18
73.8150
13
0.7098
14
14
196
Grudinin
104
68.6515
11
0.6601
12
73.0821
14
0.7027
15
15
192
Elofsson
103
63.2400
16
0.6334
15
70.5126
15
0.6846
17
16
086
BAKER
102
58.4564
18
0.6123
17
70.1197
16
0.6874
16
17
418
Seder3nc
104
41.3330
28
0.3974
30
68.1145
17
0.6549
18
18
224
Destini
104
64.6331
14
0.6215
16
68.0121
18
0.6540
19
19
344
Kiharalab
104
61.5877
17
0.5922
19
66.1616
19
0.6362
21
20
208
KIAS-Gdansk
100
49.5927
22
0.5759
20
64.2864
20
0.6429
20
21
406
Seder3mm
104
49.6520
21
0.4774
23
63.7275
21
0.6128
22
22
071
Seder3full
104
33.5201
32
0.3223
37
62.7909
22
0.6038
23
23
117
Jones-UCL
104
53.8029
20
0.5173
22
62.3192
23
0.5992
25
24
221
RaptorX-TBM
104
55.1223
19
0.5300
21
62.2473
24
0.5985
26
25
044
ProQ2
103
45.1157
23
0.4574
24
61.8821
25
0.6008
24
26
366
Venclovas
74
-7.1946
47
0.7136
10
59.0580
26
0.7981
7
27
241
Bhageerath-Star
104
41.7269
27
0.4012
28
58.9014
27
0.5664
28
28
068
Seok
104
37.4878
30
0.3605
34
58.0870
28
0.5585
30
29
457
Wallner
103
44.1458
25
0.4480
25
57.5828
29
0.5591
29
30
390
Bhattacharya
104
45.0749
24
0.4334
26
56.7238
30
0.5454
31
31
309
Seder1
104
34.0518
31
0.3274
36
56.0000
31
0.5385
34
32
368
BAKER-ROSETTASERVER
103
39.1776
29
0.3998
29
55.7125
32
0.5409
33
33
426
AP_1
104
41.7657
26
0.4016
27
55.4932
33
0.5336
35
34
498
RaptorX-Contact
104
30.1406
34
0.2898
38
54.7082
34
0.5260
36
35
214
wfRosetta-ModF7
100
30.1534
33
0.3815
32
54.5354
35
0.5454
32
36
244
Seder3hard
104
-32.1971
55
-0.3096
63
43.0708
36
0.4141
39
37
281
SHORTLE
81
-14.8039
50
0.3851
31
42.4221
37
0.5237
37
38
156
Seok-server
104
9.1623
43
0.0881
48
42.0803
38
0.4046
40
39
163
Bates_BMM
82
-15.7656
51
0.3443
35
41.9079
39
0.5111
38
40
243
MULTICOM-CONSTRUCT
104
29.1028
35
0.2798
39
40.9359
40
0.3936
42
41
446
slbio
72
-37.8750
57
0.3628
33
40.8002
41
0.5667
27
42
279
ZHOU-SPOT
101
14.6736
40
0.2047
42
40.2107
42
0.3981
41
43
329
D-Haven
103
15.6189
39
0.1711
45
39.8413
43
0.3868
43
44
441
FALCON
104
11.8340
42
0.1138
47
39.5169
44
0.3800
45
45
377
wfRstta-Maghrabi-TQA
102
-3.3075
46
0.0068
52
39.2878
45
0.3852
44
46
058
MULTICOM_CLUSTER
104
25.8366
36
0.2484
40
38.1878
46
0.3672
46
47
023
MULTICOM-NOVEL
104
24.7793
37
0.2383
41
37.2177
47
0.3579
49
48
164
Yang-Server
101
12.9065
41
0.1872
43
36.9795
48
0.3661
47
49
149
Zhou-SPOT-3D
104
18.3074
38
0.1760
44
36.9652
49
0.3554
50
50
246
IntFOLD5
104
7.4185
45
0.0713
50
35.5401
50
0.3417
51
51
116
Zhang-CEthreader
104
8.8938
44
0.0855
49
33.9457
51
0.3264
52
52
335
wfRosetta-PQ2-AngQA
104
-17.6284
52
-0.1695
57
31.2134
52
0.3001
55
53
471
CPClab
103
-9.7849
49
-0.0756
54
28.5686
53
0.2774
57
54
266
slbio_server
91
-38.7075
58
-0.1396
56
27.7775
54
0.3052
54
55
160
CMA-align
100
-7.9443
48
0.0006
53
24.3400
55
0.2434
59
56
470
Seok-assembly
80
-71.2911
67
-0.2911
62
23.9412
56
0.2993
56
57
337
FALCON-TBM
104
-36.0458
56
-0.3466
64
20.4454
57
0.1966
62
58
112
AWSEM
101
-24.7237
54
-0.1854
58
19.8718
58
0.1968
61
59
124
AWSEM-Suite
103
-23.8014
53
-0.2117
60
17.2203
59
0.1672
67
60
402
RBO-Aleph
96
-50.1994
60
-0.3562
65
16.8927
60
0.1760
65
61
004
YASARA
93
-57.3989
61
-0.3806
66
16.4714
61
0.1771
64
62
347
MESHI-server
50
-100.3421
71
0.1532
46
15.3248
62
0.3065
53
63
488
Delta-Gelly-Server
102
-66.5664
65
-0.6134
74
14.7707
63
0.1448
68
64
431
Laufer
40
-131.5158
81
-0.0879
55
14.5665
64
0.3642
48
65
432
Seok-naive_assembly
52
-127.1572
79
-0.4453
69
12.5700
65
0.2417
60
66
110
Distill
104
-40.9965
59
-0.3942
67
11.8993
66
0.1144
74
67
397
PepBuilderJ
81
-91.6118
70
-0.5631
71
11.2458
67
0.1388
69
68
492
wf-BAKER-UNRES
97
-61.8975
64
-0.4938
70
11.2347
68
0.1158
73
69
047
chuo-u
93
-60.8332
62
-0.4176
68
11.1581
69
0.1200
72
70
085
BhageerathH-Plus
104
-61.2193
63
-0.5886
73
10.6151
70
0.1021
75
71
312
MUFold_server
104
-75.3131
68
-0.7242
76
10.4107
71
0.1001
76
72
358
Spider
98
-69.6586
66
-0.5884
72
7.5807
72
0.0774
77
73
288
UNRES
101
-104.6051
73
-0.9763
83
7.2156
73
0.0714
78
74
351
DL-Haven
100
-87.4296
69
-0.7943
77
6.6137
74
0.0661
79
75
472
DELClab
98
-111.9239
76
-1.0196
87
6.0828
75
0.0621
81
76
097
Laufer_abinitio
37
-163.4873
90
-0.7970
78
4.8624
76
0.1314
71
77
077
qmo
27
-161.6144
89
-0.2820
61
4.6793
77
0.1733
66
78
152
PconsC4
104
-105.8939
74
-1.0182
86
4.1623
78
0.0400
84
79
407
rawMSA
92
-114.5704
77
-0.9845
84
4.0089
79
0.0436
82
80
380
Laufer_100
18
-187.1914
94
-0.8440
80
3.3486
80
0.1860
63
81
092
Ricardo
11
-188.2031
95
-0.2003
59
3.0036
81
0.2731
58
82
041
FALCON-Contact
104
-130.8969
80
-1.2586
92
2.7246
82
0.0262
86
83
122
Forbidden
86
-107.6411
75
-0.8330
79
2.5975
83
0.0302
85
84
389
UpsideUChicago
18
-188.5491
96
-0.9194
81
2.3838
84
0.1324
70
85
157
GAPF_LNCC
51
-155.5700
87
-0.9720
82
2.0997
85
0.0412
83
86
365
3D-JIGSAW_SL1
104
-120.4425
78
-1.1581
89
1.4378
86
0.0138
89
87
497
GaussDCA
104
-133.2599
82
-1.2813
93
1.3904
87
0.0134
91
88
381
GONGLAB-THU
103
-104.5146
72
-0.9953
85
1.1955
88
0.0116
92
89
414
BCLMeilerLab
59
-155.9339
88
-1.1175
88
0.8319
89
0.0141
88
90
473
Maurice
12
-191.5611
98
-0.6301
75
0.7577
90
0.0631
80
91
378
Cao-server
104
-153.3308
86
-1.4743
97
0.4141
91
0.0040
93
92
401
InnoUNRES
29
-186.3184
93
-1.2524
91
0.3923
92
0.0135
90
93
282
PRAYOG
92
-133.5929
83
-1.1912
90
0.2997
93
0.0033
94
94
007
ACOMPMOD
104
-140.6796
84
-1.3527
94
0.2768
94
0.0027
96
95
257
NOCONTACT
100
-166.0129
91
-1.5801
98
0.2703
95
0.0027
95
96
250
Meilerlab
1
-205.9843
99
0.0157
51
0.0157
96
0.0157
87
97
348
HMSCasper-Refiner
104
-142.2495
85
-1.3678
95
0.0000
97
0.0000
97
98
458
FOLDNET
66
-169.7272
92
-1.4201
96
0.0000
97
0.0000
97
99
476
Sun_Tsinghua
51
-190.5818
97
-1.6585
99
0.0000
97
0.0000
97
Protein Structure Prediction Center
Sponsored by the
US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis