Multi-Scale CSPResNet50 with Feature Pyramid Aggregation and SE Attention for Breast Cancer Histopathological Subtype Classification and Malignancy Detection
Research Article  ·  Published: 31 May 2026
Issue cover
ICCK Journal of Image Analysis and Processing
Volume 2, Issue 3, 2026: 122-140
Research Article Open Access

Multi-Scale CSPResNet50 with Feature Pyramid Aggregation and SE Attention for Breast Cancer Histopathological Subtype Classification and Malignancy Detection

1 University of Swat, Swat 01923, Pakistan
* Corresponding Author: Muhammad Hamza, [email protected]
Volume 2, Issue 3

Article Information

Abstract

Breast cancer is a leading cause of cancer-related mortality worldwide, making accurate histopathological subtype discrimination critical for timely clinical intervention. Existing deep learning approaches often evaluate limited settings (binary or multi-class, single magnification), restricting comparative utility and clinical interpretability. This study proposes a unified Cross Stage Partial Network (CSPNet)-based framework for comprehensive classification on the BreaKHis dataset. A CSPResNet50 backbone pre-trained on ImageNet was extended with a multi-scale Feature Pyramid-style aggregation head, Squeeze-and-Excitation channel attention, dual Global Average and Max Pooling per scale (1536-dimensional descriptor), and a dense classification neck, trained via two-phase progressive fine-tuning. Four tasks were evaluated under a stratified 70/15/15 split: multi-class (8 subtypes) and binary classification at whole-dataset and per-magnification levels (40×, 100×, 200×, 400×), with GradCAM providing interpretable visualisations. For whole-dataset binary classification, the model achieves 95.53% accuracy, 94.80% F1-score, 96.93% sensitivity, and 98.53% AUC. In multi-class classification, it attains 78.10% accuracy, 81.40% balanced accuracy, 76.76% macro F1-score, and 97.72% AUC. Per-magnification analysis shows best performance at 40×, with binary and multi-class accuracy reaching 95.00% and 77.00%, respectively, while AUC remains above 92% across all magnifications. A key limitation is image-level rather than patient-level splitting, which may introduce optimistic bias. Overall, the proposed framework provides a robust, interpretable, and computationally efficient solution for breast cancer histopathological image classification.

Graphical Abstract

Multi-Scale CSPResNet50 with Feature Pyramid Aggregation and SE Attention for Breast Cancer Histopathological Subtype Classification and Malignancy Detection

Keywords

breast cancer histopathology CSPResNet50 GradCAM deep learning classification

Data Availability Statement

The dataset used in this study is publicly available and can be accessed via the Kaggle repository: https://www.kaggle.com/datasets/ambarish/breakhis. The source code for this study is available on Kaggle: https://www.kaggle.com/code/mhamza35157/cspresnet-50.

Funding

This work was supported without any funding.

Conflicts of Interest

The authors declare no conflicts of interest.

AI Use Statement

The authors declare that generative artificial intelligence (AI) was used solely for language editing and proofreading to improve the clarity, readability, and overall quality of the manuscript. The AI tool utilized was Claude Sonnet 4.6. All AI-assisted outputs were carefully reviewed, verified, and revised by the authors. The authors take full responsibility for the content of the manuscript, including the accuracy of the information, the originality of the work, and the integrity of the research.

Ethical Approval and Consent to Participate

This study used the publicly available BreaKHis dataset (http://web.inf.ufpr.br/vri/databases/breast-cancer-histopathological-database-breakhis/), which was originally collected under institutional ethical approval at the P&D Laboratory – Pathological Anatomy and Cytopathology, Parana, Brazil. No new patient data were collected for this study, and all images in the dataset were anonymised prior to public release. Therefore, additional ethical approval was not required for this work.

References

  1. Tanveer, H., Faheem, M., Khan, A. H., & Adam, M. A. (2025). AI-powered diagnosis: a machine learning approach to early detection of breast cancer. International Journal of Engineering Development and Research, 13(2), 153-166. https://www.researchgate.net/publication/391015863
    [Google Scholar]
  2. Arravalli, T., Chadaga, K., Muralikrishna, H., Sampathila, N., Cenitta, D., Chadaga, R., & Swathi, K. S. (2025). Detection of breast cancer using machine learning and explainable artificial intelligence. Scientific Reports, 15(1), 26931.
    [CrossRef] [Google Scholar]
  3. Khan, M. M. R., Zafar, M., Majid, A., & Khan, F. A. (2025). Recent Advances in Breast Cancer Detection: A Review on Segmentation and Classification Techniques. ICCK Journal of Image Analysis and Processing, 1(4), 147-161.
    [CrossRef] [Google Scholar]
  4. Wahed, M. A., Alqaraleh, M., Alzboon, M. S., & Al-Batah, M. S. (2025). Evaluating AI and Machine Learning Models in Breast Cancer Detection: A Review of Convolutional Neural Networks (CNN) and Global Research Trends. LatIA, 3, 117-117.
    [CrossRef] [Google Scholar]
  5. Jahan, I., Chowdhury, M. E., Vranic, S., Al Saady, R. M., Kabir, S., Pranto, Z. H., ... & Nobi, S. F. (2025). Deep learning and vision transformers-based framework for breast cancer and subtype identification. Neural Computing and Applications, 37(16), 9311-9330.
    [CrossRef] [Google Scholar]
  6. Chinta, P. C. R., Moore, C. S., Karaka, L. M., Sakuru, M., & Bodepudi, V. (2025). Predictive Analytics for Disease Diagnosis: A Study on Healthcare Data with Machine Learning Algorithms and Big Data. J Cancer Sci, 10(1), 1.
    [CrossRef] [Google Scholar]
  7. Hamza, M., Ali, I., Ali, S., Khan, W., Shah, S. M., & Haq, I. U. (2025). Leveraging machine learning and deep learning for advanced malaria detection through blood cell images. ICCK Journal of Image Analysis and Processing, 1(1), 17-26.
    [CrossRef] [Google Scholar]
  8. Khan, S. S., Khan, M., & Khan, R. S. (2023, November). Automatic segmentation and classification to diagnose coronary artery disease (AuSC-CAD) using angiographic images: a novel framework. In 2023 18th International Conference on Emerging Technologies (ICET) (pp. 110-115). IEEE.
    [CrossRef] [Google Scholar]
  9. Rezayi, S., Nilashi, M., Esmaeeli, E., Ramezanghorbani, N., Arji, G., Ahmadi, H., ... & Zahmatkeshan, M. (2025). A scoping and bibliometric review of deep learning techniques in breast cancer imaging: mapping the landscape and future directions. Neural Computing and Applications, 37(22), 17759-17823.
    [CrossRef] [Google Scholar]
  10. Nasser, M., & Yusof, U. K. (2023). Deep learning based methods for breast cancer diagnosis: a systematic review and future direction. Diagnostics, 13(1), 161.
    [CrossRef] [Google Scholar]
  11. Bohra, M., Singh, K. U., Kumar, I., & Shah, M. A. (2026). Wavelet-CNN Feature Fusion Architecture for Robust Breast Cancer Classification in Histopathological Imaging. International Journal of Computational Intelligence Systems, 19(1), 136.
    [CrossRef] [Google Scholar]
  12. Ahmad, F., Jaffar, A., Latif, G., Alghazo, J., & Bhatti, S. M. (2026). Ensemble Deep Learning-Based High-Precision Framework for Breast Cancer Detection from Histopathological Images. Diagnostics, 16(5), 653.
    [CrossRef] [Google Scholar]
  13. Kushwah, S. S., Punn, N. S., & Bhattacharya, M. (2026). EVC-Net: A Hybrid Deep Learning Network for Breast Cancer Classification from Histopathological Images. ACM Transactions on Intelligent Systems and Technology, 17(4), 1-21.
    [CrossRef] [Google Scholar]
  14. Alshohoumi, F., & Al-Hamdani, A. (2026). Comparative Evaluation of Fusion Strategies Using Multi-Pretrained Deep Learning Fusion-Based (MPDLF) Model for Histopathology Image Classification. Applied Sciences, 16(4), 1964.
    [CrossRef] [Google Scholar]
  15. Makina, M., Chacha, W. M., & Mwangi, R. W. (2026). A Hybrid SwinTConvNeXt with Learnable Dynamic Gating Fusion for Breast Cancer Histopathology Image Classification. Engineering Reports, 8(2), e70655.
    [CrossRef] [Google Scholar]
  16. Behzadpour, M., Ortiz, B. L., Azizi, E., & Wu, K. (2026, February). A Novel Deep Learning Approach for Breast Tumor Applications Using Histopathological Images. In SoutheastCon 2026 (pp. 1-6). IEEE.
    [CrossRef] [Google Scholar]
  17. Jaikumar, S. S., & Praveena, S. M. (2026). Breast cancer diagnosis from histopathological images and molecular signatures by fusing features with an explainable AI-based residual tabular network model. Journal of Computer-Aided Molecular Design, 40(1), 3.
    [CrossRef] [Google Scholar]
  18. Vijay, S., Raja, M. A. M., & Mangayakarasi, J. (2026, January). AENN: An Integrated Attention-Enhanced Neural Network Architecture for Automated Histopathology Image Assessment. In 2026 International Conference on Innovative Computing, Intelligent Communication and Smart Electrical Systems (ICSES) (pp. 1-9). IEEE.
    [CrossRef] [Google Scholar]
  19. Opoku, D., Owusu-Agyemang, K., Hayfron-Acquah, J. B., & Gyening, R. M. O. M. (2026). SwinCNN+ OE: A Swin Transformer and CNN Architecture for Breast Histopathology Classification With OOD and Grad-CAM Integration. IEEE Access, 14, 3897-3909.
    [CrossRef] [Google Scholar]
  20. Nguyen, T. T., Nguyen, T. H., Nguyen, T. N., & Ngo, B. V. (2026). Dual-view colorized mammogram ROIs with EfficientNet-B7 and attention network for breast lesion classification. IEEE Access, 14, 35511--35526.
    [CrossRef] [Google Scholar]
  21. Rafiq, A., Jaffar, A., Latif, G., Masood, S., & Abdelhamid, S. E. (2025). Enhanced multi-class breast cancer classification from whole-slide histopathology images using a proposed deep learning model. Diagnostics, 15(5), 582.
    [CrossRef] [Google Scholar]
  22. Desai, A., & Mahto, R. (2025). Multi-class classification of breast cancer subtypes using ResNet architectures on histopathological images. Journal of Imaging, 11(8), 284.
    [CrossRef] [Google Scholar]
  23. Alaeddine, H., & Tekari, L. (2025). Application and Deployment of a Fine-Tuned Pre-trained Deep Model for Breast Cancer Classification. ICCK Journal of Image Analysis and Processing, 1(4), 162-171.
    [CrossRef] [Google Scholar]
  24. Hossain, M. S., Rahman, A., Ahmed, M., Fatema, K., & Mahbubul, M. M. (2025). Vision transformer for the categorization of breast cancer from H&E histopathology images. J Image Gr, 13(4).
    [CrossRef] [Google Scholar]
  25. Kaczmarek, M., Kowal, M., & Korbicz, J. (2025). Exploring data preparation strategies: A comparative analysis of vision transformer and ConvNeXT architectures in breast cancer histopathology classification. International Journal of Applied Mathematics and Computer Science, 35(2).
    [CrossRef] [Google Scholar]
  26. Abimouloud, M. L., Bensid, K., Elleuch, M., Ammar, M. B., & Kherallah, M. (2025). Advancing breast cancer diagnosis: token vision transformers for faster and accurate classification of histopathology images. Visual computing for industry, biomedicine, and art, 8(1), 1.
    [CrossRef] [Google Scholar]
  27. Zhou, Y., Jin, F., Suo, G., & Yang, J. (2025). ResViT-GANNet: a deep learning framework for classifying breast cancer histopathology images using multimodal attention and GAN-based augmentation. BMC Medical Imaging, 25(1), 401.
    [CrossRef] [Google Scholar]
  28. Osmani, N., Esmaeeli, E., & Rezayi, S. (2025). Fusion strategies for deep convolutional neural network representations in histopathological image classification. The Journal of Supercomputing, 81(2), 395.
    [CrossRef] [Google Scholar]
  29. Rahi, A. (2025). Ensemble Deep Learning for Histopathological Breast Cancer Detection. medRxiv, 2025-08.
    [CrossRef] [Google Scholar]
  30. Yuan, B., Hu, Y., Liang, Y., Zhu, Y., Zhang, L., Cai, S., ... & Hu, J. (2025). Comparative analysis of convolutional neural networks and transformer architectures for breast cancer histopathological image classification. Frontiers in Medicine, 12, 1606336.
    [CrossRef] [Google Scholar]
  31. Sreelekshmi, V., Pavithran, K., & Nair, J. J. (2024). SwinCNN: An integrated Swin Transformer and CNN for improved breast cancer grade classification. IEEE Access, 12, 68697--68710.
    [CrossRef] [Google Scholar]
  32. Aldakhil, L. A., Alhasson, H. F., & Alharbi, S. S. (2024). Attention-based deep learning approach for breast cancer histopathological image multi-classification. Diagnostics, 14(13), 1402.
    [CrossRef] [Google Scholar]
  33. Abioye, O. A., Evwiekpaefe, A. E., & Awujoola, A. J. (2024). Performance evaluation of efficientnetv2 models on the classification of histopathological benign breast cancer images. Science Journal of University of Zakho, 12(2), 208-214.
    [CrossRef] [Google Scholar]
  34. Eshun, R. B., Bikdash, M., & Islam, A. K. (2024). A deep convolutional neural network for the classification of imbalanced breast cancer dataset. Healthcare Analytics, 5, 100330.
    [CrossRef] [Google Scholar]
  35. Taheri, S., Golrizkhatami, Z., Basabrain, A. A., & Hazzazi, M. S. (2024). A comprehensive study on classification of breast cancer histopathological images: Binary versus multi-category and magnification-specific versus magnification-independent. IEEE Access, 12, 50431-50443.
    [CrossRef] [Google Scholar]
  36. Spanhol, F. A., Oliveira, L. S., Petitjean, C., & Heutte, L. (2015). A dataset for breast cancer histopathological image classification. IEEE transactions on biomedical engineering, 63(7), 1455-1462.
    [CrossRef] [Google Scholar]
  37. PyTorch Contributors. (2024). PyTorch Documentation. Retrieved May 1, 2026, from https://pytorch.org/docs/stable/index.html.
    [Google Scholar]
  38. Wightman, R. (2019). timm: PyTorch Image Models. Retrieved May 1, 2026, from https://github.com/huggingface/pytorch-image-models.
    [Google Scholar]
  39. Wang, C. Y., Liao, H. Y. M., Wu, Y. H., Chen, P. Y., Hsieh, J. W., & Yeh, I. H. (2020). CSPNet: A new backbone that can enhance learning capability of CNN. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops (pp. 390-391).
    [Google Scholar]
  40. Lin, T. Y., Dollár, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017). Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2117-2125).
    [Google Scholar]
  41. Hu, J., Shen, L., & Sun, G. (2018). Squeeze-and-excitation networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 7132-7141).
    [Google Scholar]
  42. Lin, M., Chen, Q., & Yan, S. (2013). Network in network. arXiv preprint arXiv:1312.4400.
    [CrossRef] [Google Scholar]
  43. Sarker, M. M. K., Akram, F., Alsharid, M., Singh, V. K., Yasrab, R., & Elyan, E. (2022). Efficient breast cancer classification network with dual squeeze and excitation in histopathological images. Diagnostics, 13(1), 103.
    [CrossRef] [Google Scholar]
  44. Lin, T. Y., Goyal, P., Girshick, R., He, K., & Dollár, P. (2017). Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision (pp. 2980-2988).
    [Google Scholar]
  45. Howard, J., & Ruder, S. (2018, July). Universal language model fine-tuning for text classification. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 328-339).
    [CrossRef] [Google Scholar]
  46. Loshchilov, I., & Hutter, F. (2017). Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101.
    [CrossRef] [Google Scholar]
  47. Micikevicius, P., Narang, S., Alben, J., Diamos, G., Elsen, E., Garcia, D., ... & Wu, H. (2017). Mixed precision training. arXiv preprint arXiv:1710.03740.
    [CrossRef] [Google Scholar]
  48. Youden, W. J. (1950). Index for rating diagnostic tests. Cancer, 3(1), 32-35.
    [CrossRef] [Google Scholar]
  49. Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017). Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE international conference on computer vision (pp. 618-626).
    [CrossRef] [Google Scholar]

Cite This Article

APA Style
Hamza, M., Ali, I., Ali, S., & Khan, S. (2026). Multi-Scale CSPResNet50 with Feature Pyramid Aggregation and SE Attention for Breast Cancer Histopathological Subtype Classification and Malignancy Detection. ICCK Journal of Image Analysis and Processing, 2(3), 122-140. https://doi.org/10.62762/JIAP.2026.746947
Export Citation
RIS Format
Compatible with EndNote, Zotero, Mendeley, and other reference managers
TY  - JOUR
AU  - Hamza, Muhammad
AU  - Ali, Ibrar
AU  - Ali, Sikandar
AU  - Khan, Shayan
PY  - 2026
DA  - 2026/05/31
TI  - Multi-Scale CSPResNet50 with Feature Pyramid Aggregation and SE Attention for Breast Cancer Histopathological Subtype Classification and Malignancy Detection
JO  - ICCK Journal of Image Analysis and Processing
T2  - ICCK Journal of Image Analysis and Processing
JF  - ICCK Journal of Image Analysis and Processing
VL  - 2
IS  - 3
SP  - 122
EP  - 140
DO  - 10.62762/JIAP.2026.746947
UR  - https://www.icck.org/article/abs/JIAP.2026.746947
KW  - breast cancer
KW  - histopathology
KW  - CSPResNet50
KW  - GradCAM
KW  - deep learning
KW  - classification
AB  - Breast cancer is a leading cause of cancer-related mortality worldwide, making accurate histopathological subtype discrimination critical for timely clinical intervention. Existing deep learning approaches often evaluate limited settings (binary or multi-class, single magnification), restricting comparative utility and clinical interpretability. This study proposes a unified Cross Stage Partial Network (CSPNet)-based framework for comprehensive classification on the BreaKHis dataset. A CSPResNet50 backbone pre-trained on ImageNet was extended with a multi-scale Feature Pyramid-style aggregation head, Squeeze-and-Excitation channel attention, dual Global Average and Max Pooling per scale (1536-dimensional descriptor), and a dense classification neck, trained via two-phase progressive fine-tuning. Four tasks were evaluated under a stratified 70/15/15 split: multi-class (8 subtypes) and binary classification at whole-dataset and per-magnification levels (40×, 100×, 200×, 400×), with GradCAM providing interpretable visualisations. For whole-dataset binary classification, the model achieves 95.53% accuracy, 94.80% F1-score, 96.93% sensitivity, and 98.53% AUC. In multi-class classification, it attains 78.10% accuracy, 81.40% balanced accuracy, 76.76% macro F1-score, and 97.72% AUC. Per-magnification analysis shows best performance at 40×, with binary and multi-class accuracy reaching 95.00% and 77.00%, respectively, while AUC remains above 92% across all magnifications. A key limitation is image-level rather than patient-level splitting, which may introduce optimistic bias. Overall, the proposed framework provides a robust, interpretable, and computationally efficient solution for breast cancer histopathological image classification.
SN  - 3068-6679
PB  - Institute of Central Computation and Knowledge
LA  - English
ER  - 
BibTeX Format
Compatible with LaTeX, BibTeX, and other reference managers
@article{Hamza2026MultiScale,
  author = {Muhammad Hamza and Ibrar Ali and Sikandar Ali and Shayan Khan},
  title = {Multi-Scale CSPResNet50 with Feature Pyramid Aggregation and SE Attention for Breast Cancer Histopathological Subtype Classification and Malignancy Detection},
  journal = {ICCK Journal of Image Analysis and Processing},
  year = {2026},
  volume = {2},
  number = {3},
  pages = {122-140},
  doi = {10.62762/JIAP.2026.746947},
  url = {https://www.icck.org/article/abs/JIAP.2026.746947},
  abstract = {Breast cancer is a leading cause of cancer-related mortality worldwide, making accurate histopathological subtype discrimination critical for timely clinical intervention. Existing deep learning approaches often evaluate limited settings (binary or multi-class, single magnification), restricting comparative utility and clinical interpretability. This study proposes a unified Cross Stage Partial Network (CSPNet)-based framework for comprehensive classification on the BreaKHis dataset. A CSPResNet50 backbone pre-trained on ImageNet was extended with a multi-scale Feature Pyramid-style aggregation head, Squeeze-and-Excitation channel attention, dual Global Average and Max Pooling per scale (1536-dimensional descriptor), and a dense classification neck, trained via two-phase progressive fine-tuning. Four tasks were evaluated under a stratified 70/15/15 split: multi-class (8 subtypes) and binary classification at whole-dataset and per-magnification levels (40×, 100×, 200×, 400×), with GradCAM providing interpretable visualisations. For whole-dataset binary classification, the model achieves 95.53\% accuracy, 94.80\% F1-score, 96.93\% sensitivity, and 98.53\% AUC. In multi-class classification, it attains 78.10\% accuracy, 81.40\% balanced accuracy, 76.76\% macro F1-score, and 97.72\% AUC. Per-magnification analysis shows best performance at 40×, with binary and multi-class accuracy reaching 95.00\% and 77.00\%, respectively, while AUC remains above 92\% across all magnifications. A key limitation is image-level rather than patient-level splitting, which may introduce optimistic bias. Overall, the proposed framework provides a robust, interpretable, and computationally efficient solution for breast cancer histopathological image classification.},
  keywords = {breast cancer, histopathology, CSPResNet50, GradCAM, deep learning, classification},
  issn = {3068-6679},
  publisher = {Institute of Central Computation and Knowledge}
}

Article Metrics

Citations
Crossref
0
Scopus
0
Views
641
PDF Downloads
144

Publisher's Note

ICCK stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and Permissions

CC BY Copyright © 2026 by the Author(s). Published by Institute of Central Computation and Knowledge. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
ICCK Journal of Image Analysis and Processing
ICCK Journal of Image Analysis and Processing
ISSN: 3068-6679 (Online)
Portico
Preserved at
Portico