-
CiteScore
-
Impact Factor
Volume 2, Issue 3, ICCK Transactions on Emerging Topics in Artificial Intelligence
Volume 2, Issue 3, 2025
Submit Manuscript Edit a Special Issue
Academic Editor
Dharmalingam Muthusamy
Dharmalingam Muthusamy
Bharathiar University, Coimbatore, India
Article QR Code
Article QR Code
Scan the QR code for reading
Popular articles
ICCK Transactions on Emerging Topics in Artificial Intelligence, Volume 2, Issue 3, 2025: 131-147

Open Access | Research Article | 16 August 2025
A Novel Interpretable Lightweight Ensemble Learning Method for Static and Dynamic Medical and Healthcare Data Classification
1 Department of Automatic Control and Systems Engineering, School of Electrical and Electronic Engineering, The University of Sheffield, Sheffield, United Kingdom
2 NSIGNEO Institute for in Silico Medicine, The University of Sheffield, Sheffield, United Kingdom
3 Centre of Machine Intelligence (CMI), The University of Sheffield, Sheffield, United Kingdom
* Corresponding Author: Hua-Liang Wei, [email protected]
Received: 02 July 2025, Accepted: 11 August 2025, Published: 16 August 2025  
Abstract
In the medical field, efficient and accurate classification of sequential and structured data is crucially important and useful for early diagnosis and treatment. Traditional machine learning models struggle with the complexity and nonlinearity of dynamic datasets, whereas deep learning models, despite their effectiveness, require extensive resources and lack transparency. This paper proposes a novel lightweight ensemble framework integrating a parameterized SoftMax function with a non-parametric Random Forest method through a soft voting mechanism, supported by the Nonlinear AutoRegressive eXogenous (NARX) model and optimized using a forward orthogonal search and selection (FOSS) algorithm for feature selection. This innovative approach enhances the accuracy and robustness of classifiers for both static and dynamic medical datasets, while improving interpretability and computational efficiency. Extensive validation on various medical datasets demonstrates the model's superior performance and adaptability, offering a reliable solution for complex medical data scenarios. It is expected that the results achieved in this study paves the way for future innovations in medical data analysis and the broader application of artificial intelligence in healthcare.

Graphical Abstract
A Novel Interpretable Lightweight Ensemble Learning Method for Static and Dynamic Medical and Healthcare Data Classification

Keywords
healthcare
medical data
static data
dynamic data
classification
soft voting
machine learning

Data Availability Statement
Data will be made available on request.

Funding
This work was supported without any funding.

Conflicts of Interest
The authors declare no conflicts of interest.

Ethical Approval and Consent to Participate
Not applicable.

References
  1. Faust, O., Hagiwara, Y., Hong, T. J., Lih, O. S., & Acharya, U. R. (2018). Deep learning for healthcare applications based on physiological signals: A review. Computer Methods and Programs in Biomedicine, 161, 1-13.
    [CrossRef]   [Google Scholar]
  2. Sun, B., & Wei, H. L. (2022). Machine learning for medical and healthcare data analysis and modelling: Case studies and performance comparisons of different methods. 2022 27th International Conference on Automation and Computing (ICAC), 1-6.
    [CrossRef]   [Google Scholar]
  3. Lim, B., & Zohren, S. (2021). Time-series forecasting with deep learning: a survey. Philosophical Transactions of the Royal Society A, 379(2194), 20200209.
    [CrossRef]   [Google Scholar]
  4. Khojaste-Sarakhsi, M., Haghighi, S. S., Ghomi, S. F., & Marchiori, E. (2022). Deep learning for Alzheimer's disease diagnosis: A survey. Artificial Intelligence in Medicine, 130, 102332.
    [CrossRef]   [Google Scholar]
  5. Chen, S. (1988). Representation of non-linear systems: the NARMAX model. International Journal of Control, 49(3), 303-344.
    [CrossRef]   [Google Scholar]
  6. Billings, S. A. (2013). Nonlinear system identification: NARMAX methods in the time, frequency, and spatio-temporal domains. John Wiley & Sons.
    [Google Scholar]
  7. Nayyar, A., Gadhavi, L., & Zaman, N. (2021). Machine learning in healthcare: review, opportunities and challenges. Machine Learning and the Internet of Medical Things in Healthcare, 23-45.
    [CrossRef]   [Google Scholar]
  8. Wu, J., Roy, J., & Stewart, W. F. (2010). Prediction modeling using EHR data: challenges, strategies, and a comparison of machine learning approaches. Medical Care, 48(6), S106-S113.
    [CrossRef]   [Google Scholar]
  9. Hosseini, M. P., Hosseini, A., & Ahi, K. (2020). A review on machine learning for EEG signal processing in bioengineering. IEEE Reviews in Biomedical Engineering, 14, 204-218.
    [CrossRef]   [Google Scholar]
  10. Stiglic, G., Kocbek, P., Fijacko, N., Zitnik, M., Verbert, K., & Cilar, L. (2020). Interpretability of machine learning-based prediction models in healthcare. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 10(5), e1379.
    [CrossRef]   [Google Scholar]
  11. Jiang, K., Fujii, F., & Shiinoki, T. (2019). Prediction of lung tumor motion using nonlinear autoregressive model with exogenous input. Physics in Medicine & Biology, 64(21), 21NT02.
    [CrossRef]   [Google Scholar]
  12. Sum, J. P. F., Kan, W. K., & Young, G. H. (1999). A note on the equivalence of NARX and RNN. Neural Computing & Applications, 8(1), 33-39.
    [CrossRef]   [Google Scholar]
  13. Wei, H. L., & Billings, S. A. (2006). Feature subset selection and ranking for data dimensionality reduction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(1), 162-166.
    [CrossRef]   [Google Scholar]
  14. Pang, S., Meng, F., Wang, X., Wang, J., Song, T., Wang, X., & Cheng, X. (2020). VGG16-T: a novel deep convolutional neural network with boosting to identify pathological type of lung cancer in early stage by CT images. International Journal of Computational Intelligence Systems, 13(1), 771-780.
    [CrossRef]   [Google Scholar]
  15. Kumari, S., Kumar, D., & Mittal, M. (2021). An ensemble approach for classification and prediction of diabetes mellitus using soft voting classifier. International Journal of Cognitive Computing in Engineering, 2, 40-46.
    [CrossRef]   [Google Scholar]
  16. Biau, G. (2012). Analysis of a random forests model. The Journal of Machine Learning Research, 13, 1063-1095.
    [CrossRef]   [Google Scholar]
  17. Yacouby, R., & Axman, D. (2020). Probabilistic extension of precision, recall, and f1 score for more thorough evaluation of classification models. Proceedings of the First Workshop on Evaluation and Comparison of NLP Systems, 79-91.
    [CrossRef]   [Google Scholar]
  18. Palechor, F. M., & De la Hoz Manotas, A. (2019). Dataset for estimation of obesity levels based on eating habits and physical condition in individuals from Colombia, Peru and Mexico. Data in Brief, 25, 104344.
    [CrossRef]   [Google Scholar]
  19. UCI Machine Learning Repository. (n.d.). UCI Machine Learning Repository. Retrieved from https://archive.ics.uci.edu/dataset/264/eeg+eye+state
    [Google Scholar]
  20. Vicchietti, M. L., Ramos, F. M., Betting, L. E., & Campanharo, A. S. (2023). Computational methods of EEG signals analysis for Alzheimer's disease classification. Scientific Reports, 13(1), 8184.
    [CrossRef]   [Google Scholar]

Cite This Article
APA Style
Sun, B., & Wei, H. (2025). A Novel Interpretable Lightweight Ensemble Learning Method for Static and Dynamic Medical and Healthcare Data Classification. ICCK Transactions on Emerging Topics in Artificial Intelligence, 2(3), 1–17. https://doi.org/10.62762/TETAI.2025.713474

Article Metrics
Citations:

Crossref

0

Scopus

0

Web of Science

0
Article Access Statistics:
Views: 50
PDF Downloads: 15

Publisher's Note
ICCK stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and Permissions
CC BY Copyright © 2025 by the Author(s). Published by Institute of Central Computation and Knowledge. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
ICCK Transactions on Emerging Topics in Artificial Intelligence

ICCK Transactions on Emerging Topics in Artificial Intelligence

ISSN: 3068-6652 (Online)

Email: [email protected]

Portico

Portico

All published articles are preserved here permanently:
https://www.portico.org/publishers/icck/