16th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
Group performance based on MODEL 1 analysis
  Model 1   Best model
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
    • TBM easy (max gdt_ts >=50 )
    • TBM hard (max gdt_ts < 50 )
    • TBM/FM
    • FM
    • OTHER
    #     GR #     GR name     Domains Count     SUM Zscore
    (GDT_TS)
    AVG Zscore
    (GDT_TS)
    AVG GDT_TS     No.models
    ranked 1
    No.models
    in Top3
    No.models
    in Top10
    No.models
    GDT_TS>30
    No.models
    GDT_TS>40
    No.models
    GDT_TS>50
    No.models
    GDT_TS>80
    AVG ZScore
(GDT_HA)
    AVG Mammoth
(Z-Score)
    AVG Dali
(Z-Score)
    AVG response time, min
1. 052 s Yang-Server 84 36.275 0.432 87.610 6 13 25 84 83 83 69 0.483 0.000 0.000 N/A
2. 022 Yang 84 35.389 0.421 87.561 7 13 25 84 83 83 70 0.482 0.000 0.000 N/A
3. 456 s Yang-Multimer 84 33.471 0.398 87.107 1 8 22 84 83 83 68 0.450 0.000 0.000 N/A
4. 019 s Zheng-Server 84 32.764 0.390 87.126 0 3 16 84 83 83 69 0.427 0.000 0.000 N/A
5. 028 s NKRNA-s 69 31.055 0.450 88.307 2 6 16 69 69 69 55 0.498 0.000 0.000 N/A
6. 051 MULTICOM 84 31.038 0.370 86.329 8 10 18 84 83 83 64 0.421 0.000 0.000 N/A
7. 294 KiharaLab 84 30.924 0.368 85.997 5 11 22 84 84 84 62 0.404 0.000 0.000 N/A
8. 319 s MULTICOM_LLM 84 30.753 0.366 86.156 7 8 17 84 83 83 64 0.412 0.000 0.000 N/A
9. 110 s MIEnsembles-Server 84 30.206 0.360 86.979 1 2 17 84 83 83 66 0.415 0.000 0.000 N/A
10. 462 Zheng 84 29.965 0.357 86.796 7 9 17 84 83 83 65 0.401 0.000 0.000 N/A
11. 208 s falcon2 79 29.755 0.377 86.414 5 11 21 79 77 77 63 0.448 0.000 0.000 N/A
12. 425 s MULTICOM_GATE 84 29.693 0.353 86.087 2 5 17 84 83 83 62 0.402 0.000 0.000 N/A
13. 075 s GHZ-ISM 80 29.170 0.365 85.587 4 10 21 79 78 78 64 0.420 0.000 0.000 N/A
14. 287 plmfold 84 29.136 0.347 85.351 6 9 21 84 83 83 62 0.400 0.000 0.000 N/A
15. 301 GHZ-MAN 83 29.095 0.351 85.181 3 9 18 82 81 81 65 0.396 0.000 0.000 N/A
16. 147 s Zheng-Multimer 84 29.081 0.346 86.556 3 5 15 84 83 83 66 0.381 0.000 0.000 N/A
17. 331 s MULTICOM_AI 84 29.029 0.346 86.098 3 5 13 84 83 83 63 0.376 0.000 0.000 N/A
18. 284 s Unicorn 80 29.023 0.363 85.553 4 10 20 79 78 78 64 0.415 0.000 0.000 N/A
19. 345 MULTICOM_human 84 28.987 0.345 86.137 4 6 17 84 83 83 62 0.382 0.000 0.000 N/A
20. 465 Wallner 83 28.854 0.348 83.200 2 6 12 82 80 78 58 0.353 0.000 0.000 N/A
21. 475 s ptq 77 27.765 0.361 85.016 4 6 18 76 75 75 59 0.398 0.000 0.000 N/A
22. 164 McGuffin 84 27.641 0.329 85.275 1 5 12 83 83 83 63 0.347 0.000 0.000 N/A
23. 241 elofsson 84 27.499 0.327 85.692 3 5 14 84 82 82 63 0.374 0.000 0.000 N/A
24. 163 s MultiFOLD2 84 27.135 0.323 84.913 3 5 12 83 82 82 61 0.338 0.000 0.000 N/A
25. 264 GuijunLab-Human 83 26.125 0.315 85.464 4 8 22 83 83 82 61 0.351 0.000 0.000 N/A
26. 304 s AF3-server 83 25.812 0.311 86.306 5 7 13 83 82 81 65 0.379 0.000 0.000 N/A
27. 293 MRAH 84 25.556 0.304 84.365 2 6 18 83 81 81 62 0.315 0.000 0.000 N/A
28. 079 s MRAFold 84 25.147 0.299 84.350 2 6 17 83 81 81 62 0.317 0.000 0.000 N/A
29. 375 s milliseconds 69 24.975 0.362 84.170 3 8 18 69 67 67 50 0.391 0.000 0.000 N/A
30. 122 s MQA_server 74 24.938 0.337 85.876 4 9 14 74 72 72 57 0.384 0.000 0.000 N/A
31. 419 CSSB-Human 84 24.458 0.291 85.332 0 3 13 84 84 84 63 0.247 0.000 0.000 N/A
32. 312 s GuijunLab-Assembly 83 24.329 0.293 84.869 2 6 15 83 83 82 60 0.328 0.000 0.000 N/A
33. 235 isyslab-hust 82 24.288 0.296 83.389 1 5 13 80 78 78 61 0.303 0.000 0.000 N/A
34. 148 s Guijunlab-Complex 84 24.179 0.288 85.225 2 5 14 84 84 83 61 0.324 0.000 0.000 N/A
35. 015 PEZYFoldings 83 23.434 0.282 84.037 5 6 18 83 82 80 62 0.302 0.000 0.000 N/A
36. 267 s kiharalab_server 84 23.355 0.278 83.596 5 5 18 83 81 81 60 0.294 0.000 0.000 N/A
37. 269 s CSSB_server 70 22.500 0.321 85.823 1 5 13 69 68 68 55 0.289 0.000 0.000 N/A
38. 298 ShanghaiTech-human 72 21.972 0.305 85.262 3 6 15 70 69 69 55 0.338 0.000 0.000 N/A
39. 369 Bhattacharya 76 21.888 0.288 84.620 1 3 11 76 74 74 57 0.352 0.000 0.000 N/A
40. 314 s GuijunLab-PAthreader 80 21.837 0.273 84.393 2 3 12 79 78 78 59 0.315 0.000 0.000 N/A
41. 286 CSSB_experimental 82 21.661 0.264 85.069 2 6 11 82 81 80 61 0.226 0.000 0.000 N/A
42. 145 s colabfold_baseline 69 21.247 0.308 83.985 2 6 11 67 67 67 51 0.328 0.000 0.000 N/A
43. 388 s DeepFold-server 84 21.244 0.253 81.695 2 6 13 83 81 79 55 0.234 0.000 0.000 N/A
44. 196 HYU_MLLAB 84 21.028 0.250 83.155 1 4 12 83 80 80 62 0.260 0.000 0.000 N/A
45. 262 CoDock 67 19.415 0.290 84.278 1 3 5 66 66 65 51 0.266 0.000 0.000 N/A
46. 014 Cool-PSP 84 19.368 0.231 83.143 0 0 10 83 81 81 58 0.211 0.000 0.000 N/A
47. 221 CSSB_FAKER 84 19.359 0.230 84.249 1 3 7 84 83 83 60 0.180 0.000 0.000 N/A
48. 031 MassiveFold 67 19.296 0.288 85.004 4 7 13 67 65 65 51 0.333 0.000 0.000 N/A
49. 272 GromihaLab 76 18.740 0.247 80.465 1 3 10 74 71 69 52 0.291 0.000 0.000 N/A
50. 091 Huang-HUST 66 18.577 0.281 85.346 4 5 8 66 65 65 50 0.300 0.000 0.000 N/A
51. 198 s colabfold 69 17.631 0.256 83.266 1 3 12 69 67 66 48 0.278 0.000 0.000 N/A
52. 423 s ShanghaiTech-server 65 17.241 0.265 82.748 1 3 12 63 62 62 45 0.285 0.000 0.000 N/A
53. 059 DeepFold 84 16.972 0.202 82.257 1 3 11 84 82 80 56 0.200 0.000 0.000 N/A
54. 112 Seder2024easy 65 16.738 0.258 82.754 1 2 7 64 64 64 45 0.278 0.000 0.000 N/A
55. 274 kozakovvajda 41 16.302 0.398 88.019 4 4 12 41 41 41 34 0.397 0.000 0.000 N/A
56. 017 Seder2024hard 65 16.143 0.248 81.901 0 1 5 64 64 62 43 0.258 0.000 0.000 N/A
57. 494 ClusPro 41 16.053 0.392 87.992 3 3 10 41 41 41 34 0.391 0.000 0.000 N/A
58. 311 RAGfold_Prot1 62 15.669 0.253 82.921 0 3 7 62 60 59 44 0.262 0.000 0.000 N/A
59. 489 Fernandez-Recio 44 15.521 0.353 85.317 1 3 8 44 43 43 32 0.335 0.000 0.000 N/A
60. 212 PIEFold_human 83 15.364 0.185 78.625 0 1 5 77 75 73 56 0.139 0.000 0.000 N/A
61. 204 Zou 45 14.840 0.330 86.869 2 4 8 45 45 45 35 0.346 0.000 0.000 N/A
62. 322 XGroup 38 12.629 0.332 89.637 1 3 7 38 38 38 33 0.378 0.000 0.000 N/A
63. 023 FTBiot0119 47 11.731 0.250 77.291 0 2 2 43 43 42 29 0.247 0.000 0.000 N/A
64. 219 s XGroup-server 32 10.483 0.328 89.369 0 0 6 32 32 32 27 0.362 0.000 0.000 N/A
65. 358 PerezLab_Gators 38 10.329 0.272 81.655 1 4 7 38 37 37 25 0.305 0.000 0.000 N/A
66. 323 Yan 31 9.965 0.321 87.359 1 1 5 31 30 29 26 0.383 0.000 0.000 N/A
67. 393 GuijunLab-QA 34 9.643 0.284 88.158 0 0 6 34 34 33 29 0.321 0.000 0.000 N/A
68. 290 Pierce 27 9.396 0.348 90.049 2 3 5 27 27 27 25 0.410 0.000 0.000 N/A
69. 481 Vfold 28 9.184 0.328 82.834 0 0 2 28 28 28 18 0.363 0.000 0.000 N/A
70. 450 s OpenComplex_Server 82 9.043 0.110 68.083 0 1 5 74 69 63 31 0.135 0.000 0.000 N/A
71. 167 OpenComplex 84 9.013 0.107 69.361 0 1 4 79 75 68 27 0.125 0.000 0.000 N/A
72. 171 ChaePred 23 8.694 0.378 89.805 0 1 4 23 23 23 20 0.436 0.000 0.000 N/A
73. 397 smg_ulaval 19 8.635 0.454 85.358 1 1 8 19 19 19 13 0.488 0.000 0.000 N/A
74. 261 UNRES 54 8.370 0.155 80.263 0 0 2 52 51 50 36 0.093 0.000 0.000 N/A
75. 218 HIT-LinYang 21 8.015 0.382 90.947 1 1 5 21 21 21 20 0.467 0.000 0.000 N/A
76. 085 Bates 25 7.632 0.305 86.363 1 1 2 24 24 23 22 0.359 0.000 0.000 N/A
77. 120 Cerebra 77 7.166 0.093 68.009 3 4 4 75 71 67 20 0.095 0.000 0.000 N/A
78. 191 Schneidman 24 6.675 0.278 88.674 2 2 2 24 24 23 21 0.295 0.000 0.000 N/A
79. 033 Diff 18 6.606 0.367 82.911 0 2 4 18 18 18 10 0.368 0.000 0.000 N/A
80. 231 B-LAB 18 5.905 0.328 83.125 1 1 2 18 18 18 10 0.320 0.000 0.000 N/A
81. 139 DeepFold-refine 84 5.453 0.065 78.398 0 1 2 84 82 78 48 0.048 0.000 0.000 N/A
82. 159 406 17 5.358 0.315 83.456 0 0 0 17 17 17 11 0.313 0.000 0.000 N/A
83. 040 DELCLAB 72 4.754 0.066 73.914 0 0 1 69 64 61 39 0.040 0.000 0.000 N/A
84. 187 Ayush 26 4.678 0.180 75.230 0 1 2 23 23 21 16 0.180 0.000 0.000 N/A
85. 189 LCBio 11 4.027 0.366 79.818 0 1 3 11 11 11 5 0.396 0.000 0.000 N/A
86. 325 405 13 3.986 0.307 82.761 0 0 0 13 13 13 8 0.299 0.000 0.000 N/A
87. 361 s Cerebra_server 77 3.214 0.042 65.541 1 2 2 70 68 64 16 0.057 0.000 0.000 N/A
88. 380 mialab_prediction 15 3.205 0.214 82.808 0 0 1 14 14 14 12 0.202 0.000 0.000 N/A
89. 376 OFsingleseq 11 2.718 0.247 60.797 0 0 2 7 7 7 6 0.294 0.000 0.000 N/A
90. 338 GeneSilico 12 2.537 0.211 75.659 0 0 2 12 12 12 5 0.244 0.000 0.000 N/A
91. 008 HADDOCK 9 2.023 0.225 86.137 0 0 0 9 9 9 7 0.161 0.000 0.000 N/A
92. 468 MIALAB_gong 10 1.590 0.159 82.265 0 0 0 9 9 9 8 0.136 0.000 0.000 N/A
93. 337 s APOLLO 15 1.423 0.095 66.763 0 0 0 12 12 11 7 0.064 0.000 0.000 N/A
94. 276 FrederickFolding 3 1.388 0.463 94.745 0 0 1 3 3 3 3 0.542 0.000 0.000 N/A
95. 386 ShanghaiTech-Ligand 1 0.735 0.735 95.272 1 1 1 1 1 1 1 0.791 0.000 0.000 N/A
96. 117 Vakser 25 0.722 0.029 73.618 0 0 1 25 24 22 8 0.026 0.000 0.000 N/A
97. 174 s colabfold_foldseek 1 0.622 0.622 92.073 0 1 1 1 1 1 1 0.683 0.000 0.000 N/A
98. 400 OmniFold 3 0.597 0.199 75.891 0 0 0 3 3 3 1 0.295 0.000 0.000 N/A
99. 408 SNU-CHEM-lig 1 0.580 0.580 94.062 0 0 1 1 1 1 1 0.521 0.000 0.000 N/A
100. 351 digiwiser-ensemble 8 0.574 0.072 72.828 0 0 0 8 8 6 2 0.006 0.000 0.000 N/A
101. 049 UTMB 1 0.562 0.562 91.006 0 0 0 1 1 1 1 0.605 0.000 0.000 N/A
102. 227 KUMC 1 0.551 0.551 93.835 0 0 0 1 1 1 1 0.699 0.000 0.000 N/A
103. 102 Psi-Phi 1 0.531 0.531 93.684 0 0 0 1 1 1 1 0.620 0.000 0.000 N/A
104. 207 MULTICOM_ligand 1 0.498 0.498 93.419 0 0 0 1 1 1 1 0.604 0.000 0.000 N/A
105. 464 PocketTracer 1 0.493 0.493 93.381 0 0 0 1 1 1 1 0.493 0.000 0.000 N/A
106. 271 mialab_prediction2 1 0.475 0.475 89.482 0 0 0 1 1 1 1 0.476 0.000 0.000 N/A
107. 143 dMNAfold 1 0.454 0.454 83.852 0 0 0 1 1 1 1 0.451 0.000 0.000 N/A
108. 300 s ARC 15 0.387 0.026 64.317 0 0 0 12 12 11 6 0.014 0.000 0.000 N/A
109. 114 s COAST 15 0.322 0.021 66.071 0 0 0 13 12 11 7 0.009 0.000 0.000 N/A
110. 132 s profold2 7 0.265 0.038 48.669 0 0 0 5 5 5 0 0.026 0.000 0.000 N/A
111. 355 CMOD 1 0.079 0.079 57.377 0 0 0 1 1 1 0 0.305 0.000 0.000 N/A
112. 197 D3D 1 0.048 0.048 57.172 0 0 0 1 1 1 0 0.305 0.000 0.000 N/A
113. 020 comppharmunibas 1 0.000 0.000 76.853 0 0 0 1 1 1 0 0.000 0.000 0.000 N/A
114. 281 T2DUCC 1 0.000 0.000 58.079 0 0 0 1 1 1 0 0.000 0.000 0.000 N/A
115. 202 test001 1 0.000 0.000 81.997 0 0 0 1 1 1 1 0.000 0.000 0.000 N/A
116. 357 UTAustin 2 0.000 0.000 52.778 0 0 0 2 2 2 0 0.000 0.000 0.000 N/A
117. 138 Shengyi 2 0.000 0.000 27.939 0 0 0 1 0 0 0 0.000 0.000 0.000 N/A
118. 461 forlilab 1 0.000 0.000 55.522 0 0 0 1 1 1 0 0.000 0.000 0.000 N/A
119. 105 PFSC-PFVM 42 0.000 0.000 13.674 0 0 0 1 1 0 0 0.000 0.000 0.000 N/A
120. 055 LCDD-team 1 0.000 0.000 89.523 0 0 0 1 1 1 1 0.000 0.000 0.000 N/A
121. 039 arosko 1 0.000 0.000 87.027 0 0 0 1 1 1 1 0.000 0.000 0.000 N/A
122. 275 Seminoles 1 0.000 0.000 78.707 0 0 0 1 1 1 0 0.000 0.000 0.000 N/A
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2024, University of California, Davis
Terms of Use