3D-ReSE-VN: Advanced Deep Learning for Protein Ligand Affinity Prediction in Cancer-Associated Targets
Main Article Content
Abstract
Accurate protein-ligand binding affinity prediction is important for structure-based anticancer drug discovery. This study presents 3D-ReSE-VN, a three-dimensional residual attention network that combines voxelized docking-derived complexes with residual learning, squeeze-and-excitation channel attention, and spatial attention. The model was evaluated on 4,620 protein-ligand complexes using random five-fold cross-validation and a predefined train/validation/test split. In cross-validation, 3D-ReSE-VN achieved an RMSE of 1.9679 ± 0.8242, an MAE of 0.6952 ± 0.1079, a Pearson correlation of 0.8169 ± 0.1095, and an R2 of 0.6724 ± 0.1755. On the fixed hold-out test set of 693 complexes, the model achieved an RMSE of 1.3251, an MAE of 0.6420, a Pearson correlation of 0.9098, and an R2 of 0.8271. The model showed competitive performance against the reported architectures, although performance varied across data partitions and affinity ranges. These findings support further evaluation on larger, chemically diverse, and disjoint protein-ligand datasets.
Article Details
Conflict of Interest

© 2026 The authors. This is an open access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License.
References
Abdelkader, G. A., & Kim, J.-D. (2024). Advances in protein-ligand binding affinity prediction via deep learning: A comprehensive study of datasets, data preprocessing techniques, and model architectures. Current Drug Targets, 25(15), 1041–1065. https://doi.org/10.2174/0113894501330963240905083020
Adeshakin, F. O., Adeshakin, A. O., Afolabi, L. O., Yan, D., Zhang, G., & Wan, X. (2021). Mechanisms for modulating anoikis resistance in cancer and the relevance of metabolic reprogramming. Frontiers in Oncology, 11, 626577. https://doi.org/10.3389/fonc.2021.626577
Born, J., Huynh, T., Stroobants, A., Cornell, W. D., & Manica, M. (2022). Active site sequence representations of human kinases outperform full sequence representations for affinity prediction and inhibitor generation: 3D effects in a 1D model. Journal of Chemical Information and Modeling, 62(2), 240–257. https://doi.org/10.1021/acs.jcim.1c00889
Burley, S. K., Bhatt, R., Bhikadiya, C., Bi, C., Biester, A., Biswas, P., Bittrich, S., Blaumann, S., Brown, R., Chao, H., … & Zardecki, C. (2025). Updated resources for exploring experimentally-determined PDB structures and computed structure models at the RCSB Protein Data Bank. Nucleic Acids Research, 53(D1), D564–D574. https://doi.org/10.1093/nar/gkae1091
Eberhardt, J., Santos-Martins, D., Tillack, A. F., & Forli, S. (2021). AutoDock Vina 1.2.0: New docking methods, expanded force field, and Python bindings. Journal of Chemical Information and Modeling, 61(8), 3891–3898. https://doi.org/10.1021/acs.jcim.1c00203
Guo, J. (2024). Improving structure-based protein-ligand affinity prediction by graph representation learning and ensemble learning. PLOS ONE, 19(1), e0296676. https://doi.org/10.1371/journal.pone.0296676
Huang, K., Xiao, C., Glass, L. M., & Sun, J. (2021). MolTrans: Molecular interaction transformer for drug-target interaction prediction. Bioinformatics, 37(6), 830–836. https://doi.org/10.1093/bioinformatics/btaa880
Isert, C., Atz, K., Riniker, S., & Schneider, G. (2024). Exploring protein-ligand binding affinity prediction with electron density-based geometric deep learning. RSC Advances, 14, 4492–4502. https://doi.org/10.1039/D3RA08650J
Jiang, D., Hsieh, C.-Y., Wu, Z., Kang, Y., Wang, J., Wang, E., Liao, B., Shen, C., Xu, L., Wu, J., Cao, D., & Hou, T. (2021). InteractionGraphNet: A novel and efficient deep graph representation learning framework for accurate protein-ligand interaction predictions. Journal of Medicinal Chemistry, 64(24), 18209–18232. https://doi.org/10.1021/acs.jmedchem.1c01830
Jiang, M., Shao, Y., Zhang, Y., Zhou, W., & Pang, S. (2023). A deep learning method for drug-target affinity prediction based on sequence interaction information mining. PeerJ, 11, e16625. https://doi.org/10.7717/peerj.16625
Kim, H., Taslakjian, B., Kim, S., Tirrell, M. V., & Guler, M. O. (2024). Therapeutic peptides, proteins and their nanostructures for drug delivery and precision medicine. ChemBioChem, 25(8), e202300831. https://doi.org/10.1002/cbic.202300831
Kyro, G. W., Brent, R. I., & Batista, V. S. (2023). HAC-Net: A hybrid attention-based convolutional neural network for highly accurate protein-ligand binding affinity prediction. Journal of Chemical Information and Modeling, 63(7), 1947–1960. https://doi.org/10.1021/acs.jcim.3c00251
Lai, H., Wang, L., Qian, R., Huang, J., Zhou, P., Ye, G., Wu, F., Wu, F., Zeng, X., & Liu, W. (2024). Interformer: An interaction-aware model for protein-ligand docking and affinity prediction. Nature Communications, 15, 10223. https://doi.org/10.1038/s41467-024-54440-6
Liang, L., Duan, Y., Zeng, C., Wan, B., Yao, H., Liu, H., Lu, T., Zhang, Y., Chen, Y., & Shen, J. (2024a). CPIScore: A deep learning approach for rapid scoring and interpretation of protein-ligand binding interactions. Journal of Chemical Information and Modeling, 64(23), 8809–8823. https://doi.org/10.1021/acs.jcim.4c01175
Liu, H., Chen, P., Zhai, X., Huo, K.-G., Zhou, S., Han, L., & Fan, G. (2024b). PPB-Affinity: Protein-protein binding affinity dataset for AI-based protein drug discovery. Scientific Data, 11, 1316. https://doi.org/10.1038/s41597-024-03997-4
Liu, H., Hu, B., Chen, P., Wang, X., Wang, H., Wang, S., Wang, J., Lin, B., & Cheng, M. (2024c). Docking Score ML: Target-specific machine learning models improving docking-based virtual screening in 155 targets. Journal of Chemical Information and Modeling, 64(14), 5413–5426. https://doi.org/10.1021/acs.jcim.4c00072
Liu, M., Meng, X., Mao, Y., Li, H., & Liu, J. (2024d). ReduMixDTI: Prediction of drug-target interaction with feature redundancy reduction and interpretable attention mechanism. Journal of Chemical Information and Modeling, 64(23), 8952–8962. https://doi.org/10.1021/acs.jcim.4c01554
Liu, Y., Wang, Y., Wang, Q., Peng, M., Chen, Y., Lin, Y., Shen, D., Liu, X., Xu, S., & Liu, B. (2026). An electron-density point-cloud framework for robust protein-ligand interaction prediction. Nature Communications, 17, 7424. https://doi.org/10.1038/s41467-026-74196-5
Mastropietro, A., Pasculli, G., & Bajorath, J. (2023). Learning characteristics of graph neural networks predicting protein-ligand affinities. Nature Machine Intelligence, 5, 1427–1436. https://doi.org/10.1038/s42256-023-00756-9
Morehead, A., Giri, N., Liu, J., Neupane, P., & Cheng, J. (2026). Assessing the potential of deep learning for protein-ligand docking. Nature Machine Intelligence, 8, 32–41. https://doi.org/10.1038/s42256-025-01160-1
Mursal, M., Hussain, S., Ahmad, M., & Khan, M. F. (2024). Navigating the computational seas: A comprehensive overview of molecular docking software in drug discovery. IntechOpen. https://doi.org/10.5772/intechopen.1004802
Nguyen, T., Le, H., Quinn, T. P., Nguyen, T., Le, T. D., & Venkatesh, S. (2021). GraphDTA: Predicting drug-target binding affinity with graph neural networks. Bioinformatics, 37(8), 1140–1147. https://doi.org/10.1093/bioinformatics/btaa921
Poziemski, J., & Siedlecki, P. (2026). Application of vision transformers to protein-ligand affinity prediction. Scientific Reports. https://doi.org/10.1038/s41598-026-62430-5
Rayka, M., & Naghavi, S. S. (2025). Uncertainty quantification enables reliable deep learning for protein-ligand binding affinity prediction. Scientific Reports, 15, 43156. https://doi.org/10.1038/s41598-025-27167-7
Rezaei, M. A., Li, X., Wu, D., Li, C., & Li, Y. (2022). Deep learning in drug design: Protein-ligand binding affinity prediction. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 19(1), 407–417. https://doi.org/10.1109/TCBB.2020.3046945
Smith, G. L., Banegas, M. P., Acquati, C., Chang, S., Chino, F., Conti, R. M., Greenup, R. A., Kroll, J. L., Liang, M. I., Pisu, M., Primm, K. M., Roth, M. E., Shankaran, V., & Yabroff, K. R. (2022). Navigating financial toxicity in patients with cancer: A multidisciplinary management approach. CA: A Cancer Journal for Clinicians, 72(5), 437–453. https://doi.org/10.3322/caac.21730
Wang, C., Wang, W., Wang, M., Deng, J., Sun, C., Hu, Y., & Luo, S. (2024a). Different evasion strategies in multiple myeloma. Frontiers in Immunology, 15, 1346211. https://doi.org/10.3389/fimmu.2024.1346211
Wang, D. D., Wu, W., & Wang, R. (2024b). Structure-based, deep-learning models for protein-ligand binding affinity prediction. Journal of Cheminformatics, 16, 2. https://doi.org/10.1186/s13321-023-00795-9
Wang, H., Liu, H., Ning, S., Zeng, C., & Zhao, Y. (2022). DLSSAffinity: Protein-ligand binding affinity prediction via a deep learning model. Physical Chemistry Chemical Physics, 24(17), 10124–10133. https://doi.org/10.1039/D1CP05558E
Wang, Y., Qiu, Z., Jiao, Q., Chen, C., Meng, Z., & Cui, X. (2021). Structure-based protein-drug affinity prediction with spatial attention mechanisms. In 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (pp. 92–97). IEEE. https://doi.org/10.1109/BIBM52615.2021.9669781
Wu, M.-H., Xie, Z., & Zhi, D. (2025). A Folding-Docking-Affinity framework for protein-ligand binding affinity prediction. Communications Chemistry, 8, 108. https://doi.org/10.1038/s42004-025-01506-1
Yu, J., Sheng, X., Fan, Z., Wang, Z., Cao, D., Tang, Y., Hao, Y., Zhang, Y., Shao, P., Ma, H., Cao, T., Zeng, C., Rao, J., Chen, M., Chen, K., Li, X., Teng, D., Luo, X., Wang, M., Zhang, S., & Zheng, M. (2026). Atomic-level protein-ligand recognition with PBCNet2.0 for probe discovery. Nature Chemical Biology, 22, 1299–1310. https://doi.org/10.1038/s41589-026-02241-x
Zdrazil, B., Felix, E., Hunter, F., Manners, E. J., Blackshaw, J., Corbett, S., de Veij, M., Ioannidis, H., Mendez Lopez, D., Mosquera, J. F., Magarinos, M. P., Bosc, N., Arcila, R., Kizilören, T., Gaulton, A., Bento, A. P., Adasme, M. F., Monecke, P., Landrum, G. A., & Leach, A. R. (2024). The ChEMBL database in 2023: A drug discovery platform spanning multiple bioactivity data types and time periods. Nucleic Acids Research, 52(D1), D1180–D1192. https://doi.org/10.1093/nar/gkad1004
Zhang, X., Ma, H., Gao, Y., Liang, Y., Du, Y., Hao, S., & Ni, T. (2024). The tumor microenvironment: Signal transduction. Biomolecules, 14(4), 438. https://doi.org/10.3390/biom14040438
Zhou, G., & DiMaio, F. (2025). Protein ligand structure prediction: From empirical to deep learning approaches. Current Opinion in Structural Biology, 91, 102998. https://doi.org/10.1016/j.sbi.2025.102998