13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
Group performance based on MODEL 1 analysis
  Model 1   Best model
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
    • TBM easy (max gdt_ts >=50 )
    • TBM hard (max gdt_ts < 50 )
    • TBM/FM
    • FM
    • OTHER
    #     GR #     GR name     Domains Count     SUM Zscore
    (GDT_TS)
    AVG Zscore
    (GDT_TS)
    AVG GDT_TS     No.models
    ranked 1
    No.models
    in Top3
    No.models
    in Top10
    No.models
    GDT_TS>30
    No.models
    GDT_TS>40
    No.models
    GDT_TS>50
    No.models
    GDT_TS>80
    AVG ZScore
(GDT_HA)
    AVG Mammoth
(Z-Score)
    AVG Dali
(Z-Score)
    AVG response time, min
1. 043 A7D 104 126.781 1.219 64.415 29 38 53 98 93 85 15 1.374 8.070 16.463 N/A
2. 089 MULTICOM 129 118.394 0.918 60.612 6 30 65 120 106 93 18 0.963 7.664 15.364 N/A
3. 196 Grudinin 156 117.047 0.750 55.962 18 42 76 143 121 97 13 0.734 7.347 13.554 N/A
4. 322 Zhang 104 108.914 1.047 64.502 10 21 52 100 96 85 21 1.079 8.408 16.552 N/A
5. 135 SBROD 135 106.954 0.792 58.675 14 28 68 122 109 94 17 0.807 8.173 15.418 N/A
6. 208 KIAS-Gdansk 157 99.847 0.636 52.739 10 39 71 139 120 87 9 0.604 6.954 12.273 N/A
7. 145 s QUARK 104 93.953 0.903 62.149 2 9 29 100 94 79 16 0.874 8.116 15.632 N/A
8. 261 s Zhang-Server 104 91.912 0.884 62.167 1 7 31 97 93 79 15 0.865 8.094 15.695 N/A
9. 460 McGuffin 105 86.761 0.826 61.804 5 15 33 96 90 77 16 0.849 8.173 15.914 N/A
10. 354 wfAll-Cheng 104 83.485 0.803 60.937 1 5 32 95 87 78 15 0.841 7.909 15.776 N/A
11. 324 s RaptorX-DeepModeller 104 80.801 0.777 60.382 1 9 32 96 89 76 13 0.789 7.828 15.315 N/A
12. 197 MESHI 105 78.317 0.746 59.190 5 13 28 97 84 73 14 0.748 7.924 15.186 N/A
13. 055 VoroMQA-select 104 75.203 0.723 59.246 2 7 36 94 84 71 17 0.751 7.650 15.530 N/A
14. 274 MUFold 104 75.126 0.722 59.439 3 14 33 93 81 73 19 0.790 7.600 15.500 N/A
15. 222 Seok-refine 104 74.621 0.718 58.845 5 19 32 90 77 70 18 0.771 7.531 15.558 N/A
16. 192 Elofsson 103 73.624 0.715 59.158 1 4 18 92 87 75 13 0.696 7.615 15.150 N/A
17. 224 Destini 104 72.972 0.702 58.304 0 4 13 100 91 77 7 0.582 7.913 13.608 N/A
18. 086 BAKER 103 71.866 0.698 57.382 4 9 33 87 80 70 12 0.705 7.555 15.179 N/A
19. 418 Seder3nc 104 69.893 0.672 54.446 1 6 21 83 77 64 13 0.699 7.037 13.675 N/A
20. 344 Kiharalab 105 68.324 0.651 58.463 2 8 24 95 86 70 16 0.663 7.647 14.842 N/A
21. 117 Jones-UCL 112 67.730 0.605 55.675 2 11 23 104 85 69 9 0.558 7.769 13.825 N/A
22. 071 Seder3full 104 64.808 0.623 53.200 0 5 19 81 74 64 13 0.644 6.876 13.366 N/A
23. 406 Seder3mm 104 64.783 0.623 55.932 4 6 24 84 80 68 14 0.657 7.137 14.294 N/A
24. 221 s RaptorX-TBM 104 64.590 0.621 57.730 1 2 15 92 83 65 12 0.633 7.353 14.387 N/A
25. 044 ProQ2 103 64.500 0.626 56.408 4 6 26 86 77 69 15 0.639 7.521 14.530 N/A
26. 366 Venclovas 74 61.671 0.833 59.992 4 8 15 68 61 53 8 0.822 8.180 15.486 N/A
27. 068 Seok 105 61.427 0.585 55.785 2 7 19 82 77 69 15 0.619 7.210 14.438 N/A
28. 457 Wallner 104 61.173 0.588 55.281 1 2 15 88 79 65 11 0.581 7.295 14.176 N/A
29. 241 Bhageerath-Star 104 60.970 0.586 55.516 2 6 22 84 74 63 13 0.610 7.059 14.099 N/A
30. 390 Bhattacharya 105 59.534 0.567 56.112 1 3 15 89 78 66 15 0.591 7.327 14.645 N/A
31. 309 Seder1 105 59.395 0.566 52.878 2 4 15 85 71 59 12 0.566 6.631 12.918 N/A
32. 498 s RaptorX-Contact 104 57.619 0.554 52.781 2 4 14 90 83 64 3 0.481 6.669 11.760 N/A
33. 368 s BAKER-ROSETTASERVER 103 57.410 0.557 54.027 1 5 25 83 73 64 9 0.589 7.112 14.069 N/A
34. 426 AP_1 104 57.158 0.550 55.023 2 3 18 87 76 59 13 0.546 7.015 13.850 N/A
35. 214 wfRosetta-ModF7 100 56.004 0.560 54.019 2 8 17 78 69 59 12 0.585 7.218 14.442 N/A
36. 329 D-Haven 139 49.453 0.356 47.773 3 5 38 101 88 66 9 0.348 6.160 11.784 N/A
37. 156 s Seok-server 105 45.502 0.433 51.594 2 3 13 75 71 63 15 0.465 6.630 13.523 N/A
38. 281 SHORTLE 82 45.311 0.553 56.140 1 4 12 70 63 51 14 0.577 7.675 13.282 N/A
39. 163 Bates_BMM 82 45.068 0.550 54.853 0 2 10 70 65 53 6 0.484 7.580 13.716 N/A
40. 243 s MULTICOM-CONSTRUCT 104 44.096 0.424 53.727 1 1 6 84 73 59 13 0.433 6.706 13.467 N/A
41. 244 Seder3hard 104 43.940 0.423 40.691 1 6 15 54 48 40 11 0.436 3.798 9.110 N/A
42. 279 ZHOU-SPOT 101 43.867 0.434 50.703 1 2 5 82 61 50 8 0.429 6.471 12.857 N/A
43. 446 slbio 72 42.593 0.592 57.251 2 4 14 59 52 46 12 0.604 7.107 15.360 N/A
44. 441 s FALCON 104 41.777 0.402 50.545 0 2 8 74 63 54 14 0.425 6.604 12.913 N/A
45. 377 wfRstta-Maghrabi-TQA 102 41.168 0.404 47.315 3 4 13 69 58 49 11 0.395 6.171 12.280 N/A
46. 058 s MULTICOM_CLUSTER 104 41.156 0.396 52.870 0 2 3 86 74 56 11 0.407 6.789 13.337 N/A
47. 149 s Zhou-SPOT-3D 104 40.693 0.391 51.177 0 2 6 81 66 52 9 0.366 6.445 12.813 N/A
48. 164 s Yang-Server 101 40.388 0.400 52.518 0 0 6 82 67 53 10 0.387 6.782 13.165 N/A
49. 023 s MULTICOM-NOVEL 104 40.235 0.387 52.914 0 0 5 85 72 58 12 0.391 6.559 13.090 N/A
50. 246 s IntFOLD5 104 37.912 0.365 49.943 0 0 7 76 62 56 11 0.372 6.503 12.691 N/A
51. 116 s Zhang-CEthreader 104 36.988 0.356 50.060 0 1 4 81 64 56 5 0.327 6.673 12.719 N/A
52. 335 wfRosetta-PQ2-AngQA 104 33.737 0.324 43.301 1 1 7 65 55 41 6 0.351 5.460 10.420 N/A
53. 266 s slbio_server 91 31.573 0.347 47.022 1 1 6 58 53 44 9 0.358 5.813 11.030 N/A
54. 471 CPClab 103 31.245 0.303 47.746 0 3 8 73 59 50 11 0.314 5.985 11.999 N/A
55. 431 Laufer 51 29.600 0.580 47.878 9 12 14 41 30 19 5 0.626 4.156 6.282 N/A
56. 160 s CMA-align 100 28.828 0.288 49.714 0 1 4 74 64 51 6 0.242 6.330 12.096 N/A
57. 470 s Seok-assembly 80 25.804 0.323 43.598 1 2 6 45 43 39 5 0.327 5.574 10.560 N/A
58. 337 s FALCON-TBM 104 22.933 0.221 41.516 0 2 4 54 46 39 10 0.225 5.294 10.801 N/A
59. 112 AWSEM 102 22.158 0.217 45.793 1 1 5 74 63 43 2 0.184 5.274 9.816 N/A
60. 402 s RBO-Aleph 96 20.078 0.209 42.363 0 2 2 59 49 40 6 0.188 5.164 9.391 N/A
61. 004 s YASARA 94 19.816 0.211 43.027 1 1 1 56 46 38 6 0.230 5.675 11.346 N/A
62. 000 3Dbio 18 19.117 1.062 45.866 10 12 18 13 11 10 0 1.221 4.720 8.544 N/A
63. 124 s AWSEM-Suite 103 18.803 0.183 44.898 0 2 5 76 57 42 2 0.160 5.687 9.757 N/A
64. 347 s MESHI-server 50 18.292 0.366 60.624 0 0 2 45 43 38 6 0.378 9.606 17.920 N/A
65. 492 wf-BAKER-UNRES 157 18.131 0.115 38.410 0 8 58 107 71 36 2 0.074 4.460 6.635 N/A
66. 488 s Delta-Gelly-Server 102 17.088 0.168 36.676 0 0 4 49 37 29 5 0.172 4.478 8.128 N/A
67. 288 UNRES 167 15.995 0.096 32.332 1 11 66 90 46 13 0 0.071 3.074 4.415 N/A
68. 110 s Distill 104 14.755 0.142 42.340 0 0 0 66 49 38 6 0.135 5.292 9.597 N/A
69. 085 s BhageerathH-Plus 104 14.207 0.137 37.475 0 0 1 52 42 31 3 0.120 4.669 8.832 N/A
70. 047 chuo-u 93 14.031 0.151 42.228 0 0 2 55 43 37 5 0.149 5.272 10.226 N/A
71. 432 s Seok-naive_assembly 52 13.927 0.268 43.257 0 0 2 30 29 25 5 0.292 6.000 12.127 N/A
72. 397 PepBuilderJ 80 13.532 0.169 46.186 0 1 2 56 47 37 4 0.170 6.341 11.476 N/A
73. 312 s MUFold_server 107 13.414 0.125 34.861 0 0 3 51 37 30 3 0.119 4.354 8.355 N/A
74. 358 Spider 99 10.816 0.109 37.460 0 1 1 47 40 31 4 0.088 4.712 8.591 N/A
75. 359 s 3DCNN 10 8.776 0.878 48.199 6 9 10 8 7 4 0 0.887 5.927 12.770 N/A
76. 105 RBO-Human 27 8.474 0.314 35.206 2 9 26 18 10 4 1 0.362 4.512 5.537 N/A
77. 472 DELClab 98 6.948 0.071 30.755 1 1 1 35 29 22 3 0.070 4.092 8.306 N/A
78. 351 DL-Haven 100 6.884 0.069 33.232 0 0 1 43 27 19 1 0.055 2.959 4.600 N/A
79. 122 Forbidden 141 6.762 0.048 32.609 1 5 55 71 39 19 1 0.042 2.537 3.857 N/A
80. 207 s SBROD-plus 11 6.395 0.581 58.190 4 4 11 9 8 8 2 0.611 12.991 24.109 N/A
81. 250 Meilerlab 11 5.774 0.525 53.939 2 5 9 10 8 7 0 0.483 5.442 11.045 N/A
82. 364 s SBROD-server 12 5.402 0.450 56.373 0 6 12 10 9 8 2 0.501 12.628 24.300 N/A
83. 077 qmo 27 5.048 0.187 41.604 0 0 1 20 13 5 1 0.209 8.173 7.544 N/A
84. 097 Laufer_abinitio 37 4.933 0.133 34.272 0 1 2 16 6 5 3 0.140 2.105 2.476 N/A
85. 407 s rawMSA 93 4.547 0.049 28.351 0 0 2 34 17 11 1 0.055 1.602 2.283 N/A
86. 152 s PconsC4 104 4.433 0.043 30.834 0 0 0 48 31 15 0 0.026 2.799 3.928 N/A
87. 092 Ricardo 11 3.579 0.325 60.139 0 0 0 8 8 8 3 0.347 7.749 22.918 N/A
88. 380 Laufer_100 18 3.458 0.192 38.300 0 0 0 7 4 4 2 0.206 2.155 2.394 N/A
89. 414 BCLMeilerLab 71 3.151 0.044 23.917 3 3 11 10 8 5 1 0.041 1.305 2.599 N/A
90. 041 s FALCON-Contact 104 3.018 0.029 22.053 0 0 1 23 10 7 0 0.018 0.931 1.870 N/A
91. 321 ASDP_baseline_NoEC 10 2.822 0.282 47.571 1 4 10 8 6 5 1 0.300 3.385 6.380 N/A
92. 389 UpsideUChicago 18 2.458 0.137 33.887 0 0 0 7 4 2 1 0.146 1.960 1.650 N/A
93. 157 GAPF_LNCC 51 2.433 0.048 32.738 0 0 0 22 14 8 2 0.048 2.147 4.092 N/A
94. 365 s 3D-JIGSAW_SL1 104 2.030 0.020 28.688 0 0 0 39 28 17 1 0.013 2.024 3.295 N/A
95. 271 kozakov-vajda 8 2.013 0.252 36.177 0 2 8 4 3 3 0 0.209 2.363 3.462 N/A
96. 452 comp_biolo_course 3 1.577 0.526 66.001 0 0 0 3 3 2 0 0.516 8.738 23.100 N/A
97. 497 s GaussDCA 104 1.527 0.015 25.450 0 0 0 30 17 6 0 0.008 1.920 2.168 N/A
98. 313 ASDP.BEC 7 1.417 0.202 51.376 1 2 7 6 6 4 0 0.216 3.997 7.086 N/A
99. 459 ASP_baseline_PEC 8 1.416 0.177 45.255 1 4 8 6 5 3 0 0.218 2.927 6.125 N/A
100. 381 GONGLAB-THU 103 1.395 0.014 31.578 0 0 0 48 26 13 1 0.018 2.874 4.678 N/A
101. 183 QUARK_T0969_qa 1 1.369 1.369 51.342 0 0 1 1 1 1 0 1.314 8.454 25.300 N/A
102. 087 Zhang_T0969_qa 1 1.279 1.279 49.859 0 0 1 1 1 0 0 1.258 8.222 24.000 N/A
103. 195 Seminoles 1 1.084 1.084 68.710 0 0 0 1 1 1 0 1.286 7.483 16.600 N/A
104. 102 s Bhattacharya-Server 1 1.014 1.014 67.903 0 0 0 1 1 1 0 1.097 7.229 16.200 N/A
105. 473 Maurice 12 0.762 0.064 33.911 0 0 0 5 2 1 1 0.115 1.492 1.100 N/A
106. 007 s ACOMPMOD 104 0.739 0.007 24.309 0 0 0 27 21 15 1 0.009 2.387 4.539 N/A
107. 190 DC_refine 1 0.610 0.610 63.226 0 0 0 1 1 1 0 0.613 7.229 13.200 N/A
108. 229 METAPSICOV_baseline 1 0.555 0.555 83.832 0 0 0 1 1 1 1 0.630 13.063 49.300 N/A
109. 217 Boniecki_pred 1 0.484 0.484 61.774 0 0 0 1 1 1 0 0.371 6.551 14.500 N/A
110. 174 Zhang-Refinement 1 0.470 0.470 61.613 0 0 0 1 1 1 0 0.458 6.805 15.900 N/A
111. 282 s PRAYOG 92 0.467 0.005 27.964 0 0 0 36 19 8 0 0.004 2.202 3.304 N/A
112. 356 FEIGLAB 1 0.456 0.456 61.452 0 0 0 1 1 1 0 0.544 6.296 14.500 N/A
113. 378 s Cao-server 104 0.449 0.004 17.894 0 0 0 15 3 1 0 0.003 0.403 0.371 N/A
114. 425 BAKER-AUTOREFINE 1 0.415 0.415 60.968 0 0 0 1 1 1 0 0.474 7.314 15.100 N/A
115. 401 InnoUNRES 29 0.395 0.014 24.958 0 0 0 8 2 0 0 0.005 0.734 0.414 N/A
116. 270 Huang 1 0.331 0.331 60.000 0 0 0 1 1 1 0 0.354 6.466 13.100 N/A
117. 257 s NOCONTACT 100 0.326 0.003 14.760 0 0 0 5 2 0 0 0.002 0.155 0.151 N/A
118. 433 AIR 1 0.000 0.000 54.032 0 0 0 1 1 1 0 0.000 6.296 12.800 N/A
119. 332 NSCCGZ1 1 0.000 0.000 32.812 0 0 0 1 0 0 0 0.000 4.136 10.400 N/A
120. 328 Kiharalab_RF2 1 0.000 0.000 53.065 0 0 0 1 1 1 0 0.000 5.449 11.200 N/A
121. 458 s FOLDNET 66 0.000 0.000 16.642 0 0 0 5 2 0 0 0.000 0.254 0.114 N/A
122. 387 playmolecule 9 0.000 0.000 33.210 0 0 0 4 2 1 0 0.000 0.995 0.478 N/A
123. 348 s HMSCasper-Refiner 104 0.000 0.000 24.137 0 0 0 29 13 1 0 0.000 0.857 0.353 N/A
124. 476 Sun_Tsinghua 51 0.000 0.000 15.899 0 0 0 1 0 0 0 0.000 0.108 0.051 N/A
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis