-
CiteScore
-
Impact Factor
Volume 1, Issue 1, ICCK Journal of Software Engineering
Volume 1, Issue 1, 2025
Submit Manuscript Edit a Special Issue
Academic Editor
Usama Ahmed
Usama Ahmed
University of Management and Technology, Pakistan
Article QR Code
Article QR Code
Scan the QR code for reading
Popular articles
ICCK Journal of Software Engineering, Volume 1, Issue 1, 2025: 46-62

Open Access | Review Article | 19 August 2025
Software Testing Evolution: Comparative Insights into Traditional and Emerging Practices
1 Department of Computer Science, Virtual University of Pakistan, Lahore 54000, Pakistan
* Corresponding Author: Samia Akhtar, [email protected]
Received: 11 July 2025, Accepted: 24 July 2025, Published: 19 August 2025  
Abstract
Software testing is a fundamental pillar of software engineering which ensures that applications function correctly, meet user requirements, and remain reliable under different conditions. As software systems become more complex and the demand for faster development grows, testing strategies have evolved to meet new challenges. This paper aims to comprehensively compare traditional and modern software testing techniques to provide practitioners with a structured understanding of their evolution, strengths, limitations, and applicability. It covers classical methods such as unit testing, integration testing, system testing, acceptance testing and other testing types like black-box, white-box, and grey-box. Each method is analyzed based on its purpose, advantages, limitations, and best use cases. The paper also explores current testing trends including AI-augmented testing, continuous testing in DevOps, shift-left and shift-right testing, and large scale automated testing. It highlights the growing importance of testing in cloud-native and microservices-based environments. These modern practices are evaluated for their impact on software quality assurance, particularly in improving test coverage, fault detection, usability, and security. The survey also identifies challenges faced by testing teams, such as flaky tests, tool complexity, test data management, and AI explainability. Finally, the paper offers future directions including smarter automation and more accessible testing tools. This work serves as a useful guide for software engineers, testers, researchers, and QA professionals seeking to understand the evolving role of software testing and apply effective strategies in modern development environments.

Graphical Abstract
Software Testing Evolution: Comparative Insights into Traditional and Emerging Practices

Keywords
software testing strategies
software quality assurance (SQA)
black box and white box testing
AI-augmented testing
test automation

Data Availability Statement
Data will be made available on request.

Funding
This work was supported without any funding.

Conflicts of Interest
The authors declare no conflicts of interest.

Ethical Approval and Consent to Participate
Not applicable.

References
  1. Kumar, S. (2023). Reviewing software testing models and optimization techniques: an analysis of efficiency and advancement needs. Journal of Computers, Mechanical and Management, 2(1), 32-46.
    [CrossRef]   [Google Scholar]
  2. Pargaonkar, S. (2023). A study on the benefits and limitations of software testing principles and techniques: software quality engineering.
    [CrossRef]   [Google Scholar]
  3. Khaliq, Z., Farooq, S. U., & Khan, D. A. (2022). Artificial intelligence in software testing: Impact, problems, challenges and prospect. arXiv preprint arXiv:2201.05371.
    [CrossRef]   [Google Scholar]
  4. Nama, P., Bhoyar, M., & Chinta, S. (2024). Autonomous test oracles: integrating ai for intelligent decision-making in automated software testing. Well Testing Journal, 33(S2), 326-353.
    [Google Scholar]
  5. Hunko, I. (2025). Adaptive Approaches to Software Testing with Embedded Artificial Intelligence in Dynamic Environments. International Journal of Current Science Research and Review, 8(05).
    [CrossRef]   [Google Scholar]
  6. Najihi, S., Elhadi, S., Ait Abdelouahid, R., & Marzak, A. (2022). Software Testing from an Agile and Traditional view. Procedia Computer Science, 203, 775-782.
    [CrossRef]   [Google Scholar]
  7. Formica, F., Fan, T., & Menghi, C. (2023). Search-based software testing driven by automatically generated and manually defined fitness functions. ACM Transactions on Software Engineering and Methodology, 33(2), 1-37.
    [CrossRef]   [Google Scholar]
  8. Delgado-Pérez, P., Medina-Bulo, I., Álvarez-García, M. Á., & Valle-Gómez, K. J. (2021, May). Mutation testing and self/peer assessment: analyzing their effect on students in a software testing course. In 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) (pp. 231-240). IEEE.
    [CrossRef]   [Google Scholar]
  9. Eisty, N. U., Kanewala, U., & Carver, J. C. (2025). Testing research software: an in-depth survey of practices, methods, and tools. Empirical Software Engineering, 30(3), 81.
    [CrossRef]   [Google Scholar]
  10. Krafft, T. D., Hauer, M. P., & Zweig, K. (2024). Black-Box Testing and Auditing of Bias in ADM Systems. Minds and Machines, 34(2), 15.
    [CrossRef]   [Google Scholar]
  11. Adu, G. (2024). Artificial Intelligence in Software Testing: Test scenario and case generation with an AI model (gpt-3.5-turbo) using Prompt engineering, Fine-tuning and Retrieval augmented generation techniques (Master's thesis, Itä-Suomen yliopisto).
    [Google Scholar]
  12. Vaddadi, S. A., Thatikonda, R., Padthe, A., & Arnepalli, P. R. R. (2023). Shift left testing paradigm process implementation for quality of software based on fuzzy. Soft Computing, 1-13.
    [CrossRef]   [Google Scholar]
  13. Dadwal, A., Washizaki, H., Fukazawa, Y., Iida, T., Mizoguchi, M., & Yoshimura, K. (2018). Prioritization in Automotive Software Testing: Systematic Literature Review. QuASoQ@ APSEC, 52-58.
    [Google Scholar]
  14. Patel, J. S. (2025). AI-Driven Test Automation: Transforming Software Quality Engineering. Journal of Computer Science and Technology Studies, 7(2), 339-347.
    [CrossRef]   [Google Scholar]
  15. Pham, P., Nguyen, V., & Nguyen, T. (2022, October). A review of ai-augmented end-to-end test automation tools. In Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering (pp. 1-4).
    [CrossRef]   [Google Scholar]
  16. Aghababaeyan, Z., Abdellatif, M., Briand, L., & Bagherzadeh, M. (2023). Black-box testing of deep neural networks through test case diversity. IEEE Transactions on Software Engineering, 49(5), 3182-3204.
    [CrossRef]   [Google Scholar]
  17. Hourani, H., Hammad, A., & Lafi, M. (2019, April). The impact of artificial intelligence on software testing. In 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT) (pp. 565-570). IEEE.
    [CrossRef]   [Google Scholar]
  18. Kulkarni, N. (2020). Automated testing as part of CI/CD pipeline-shift left implementation. North American Journal of Engineering Research, 1(3).
    [Google Scholar]
  19. Anwar, N., & Kar, S. (2019). Review paper on various software testing techniques & strategies. Global Journal of Computer Science and Technology, 19(2), 43-49.
    [Google Scholar]
  20. Burgess, C. J. (2025). Software testing using an automatic generator of test data. WIT Transactions on Information and Communication Technologies, 4.
    [Google Scholar]
  21. Baqar, M., & Khanda, R. (2025, June). The Future of Software Testing: AI–Powered Test Case Generation and Validation. In Intelligent Computing-Proceedings of the Computing Conference (pp. 276-300). Cham: Springer Nature Switzerland.
    [CrossRef]   [Google Scholar]
  22. Andriadi, K., Soeparno, H., Gaol, F. L., & Arifin, Y. (2023, August). The impact of shift-left testing to software quality in agile methodology: A case study. In 2023 International Conference on Information Management and Technology (ICIMTech) (pp. 259-264). IEEE.
    [CrossRef]   [Google Scholar]
  23. Gurcan, F., Dalveren, G. G. M., Cagiltay, N. E., Roman, D., & Soylu, A. (2022). Evolution of software testing strategies and trends: Semantic content analysis of software research corpus of the last 40 years. IEEE Access, 10, 106093-106109.
    [CrossRef]   [Google Scholar]
  24. Jalil, S., Rafi, S., LaToza, T. D., Moran, K., & Lam, W. (2023, April). Chatgpt and software testing education: Promises & perils. In 2023 IEEE international conference on software testing, verification and validation workshops (ICSTW) (pp. 4130-4137). IEEE.
    [CrossRef]   [Google Scholar]
  25. Raksawat, C., & Charoenporn, P. (2021). Software testing system development based on ISO 29119. Journal of Advances in Information Technology, 12(2), 128-134.
    [Google Scholar]
  26. Arcuri, A., Zhang, M., Golmohammadi, A., Belhadi, A., Galeotti, J. P., Marculescu, B., & Seran, S. (2023, April). Emb: A curated corpus of web/enterprise applications and library support for software testing research. In 2023 IEEE Conference on Software Testing, Verification and Validation (ICST) (pp. 433-442). IEEE.
    [CrossRef]   [Google Scholar]
  27. AbuSalim, S. W., Ibrahim, R., & Wahab, J. A. (2021, February). Comparative analysis of software testing techniques for mobile applications. In Journal of Physics: Conference Series (Vol. 1793, No. 1, p. 012036). IOP Publishing.
    [CrossRef]   [Google Scholar]
  28. Kassaymeh, S., Abdullah, S., Alweshah, M., & Hammouri, A. I. (2021, October). A hybrid salp swarm algorithm with artificial neural network model for predicting the team size required for software testing phase. In 2021 International Conference on Electrical Engineering and Informatics (ICEEI) (pp. 1-6). IEEE.
    [CrossRef]   [Google Scholar]
  29. Palani, N. (2021). Automated Software Testing with Cypress. Auerbach Publications.
    [CrossRef]   [Google Scholar]
  30. Bajjouk, M., Rana, M. E., Ramachandiran, C. R., & Chelliah, S. (2021). Software testing for reliability and quality improvement. Journal of Applied Technology and Innovation, 5(2), 40-46.
    [Google Scholar]
  31. Verma, A. S., Choudhary, A., & Tiwari, S. (2023). Software test case generation tools and techniques: A review. International Journal of Mathematical, Engineering and Management Sciences, 8(2), 293.
    [CrossRef]   [Google Scholar]
  32. Bernardo, S., Orviz, P., David, M., Gomes, J., Arce, D., Naranjo, D., ... & Pina, J. (2024). Software Quality Assurance as a Service: Encompassing the quality assessment of software and services. Future Generation Computer Systems, 156, 254-268.
    [CrossRef]   [Google Scholar]
  33. Atoum, I., Baklizi, M. K., Alsmadi, I., Otoom, A. A., Alhersh, T., Ababneh, J., ... & Alshahrani, S. M. (2021). Challenges of software requirements quality assurance and validation: A systematic literature review. IEEE Access, 9, 137613-137634.
    [CrossRef]   [Google Scholar]
  34. Pysmennyi, I., Kyslyi, R., & Kleshch, K. (2025). AI-driven tools in modern software quality assurance: an assessment of benefits, challenges, and future directions. arXiv preprint arXiv:2506.16586.
    [Google Scholar]
  35. Forgács, I., & Kovács, A. (2024). Modern software testing techniques. Apress.
    [CrossRef]   [Google Scholar]
  36. Pargaonkar, S. (2023). Advancements in Modern Computer Technology and Their Influence on Software Testing Practices: A Comprehensive Review. Beyond Silicon: Advancements and Trends in Modern Computer Technology, 221-237.
    [Google Scholar]
  37. Júnior, M. C., Amalfitano, D., Garcés, L., Fasolino, A. R., Andrade, S. A., & Delamaro, M. (2022). Dynamic testing techniques of non-functional requirements in mobile apps: A systematic mapping study. ACM Computing Surveys (CSUR), 54(10s), 1-38.
    [CrossRef]   [Google Scholar]
  38. Valle‐Gómez, K. J., García‐Domínguez, A., Delgado‐Pérez, P., & Medina‐Bulo, I. (2022). Mutation‐inspired symbolic execution for software testing. IET Software, 16(5), 478-492.
    [CrossRef]   [Google Scholar]
  39. Boukhlif, M., Kharmoum, N., & Hanine, M. (2024, April). Llms for intelligent software testing: a comparative study. In Proceedings of the 7th International Conference on Networking, Intelligent Systems and Security (pp. 1-8).
    [CrossRef]   [Google Scholar]
  40. Witte, F. (2022). Strategy, Planning and Organization of Test Processes. Wiesbaden: Springer.
    [CrossRef]   [Google Scholar]
  41. Ali, S., & Yue, T. (2023, May). Quantum software testing: A brief introduction. In 2023 IEEE/ACM 45th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (pp. 332-333). IEEE.
    [CrossRef]   [Google Scholar]
  42. Bhanushali, A. (2023). Ensuring Software Quality Through Effective Quality Assurance Testing: Best Practices and Case Studies. International Journal of Advances in Scientific Research and Engineering, 26(1), 1-18.
    [Google Scholar]
  43. Ahammad, A., El Bajta, M., & Radgui, M. (2024, October). Automated Software Testing Using Machine Learning: A Systematic Mapping Study. In 2024 10th International Conference on Optimization and Applications (ICOA) (pp. 1-6). IEEE.
    [CrossRef]   [Google Scholar]
  44. Pecorelli, F., Catolino, G., Ferrucci, F., De Lucia, A., & Palomba, F. (2022). Software testing and android applications: a large-scale empirical study. Empirical Software Engineering, 27(2), 31.
    [CrossRef]   [Google Scholar]
  45. Jha, P., Sahu, M., Bisoy, S. K., Pati, B., & Panigrahi, C. R. (2022, December). Application of Machine Learning in Software Testing of Healthcare Domain. In International Conference on Advanced Computing and Intelligent Engineering (pp. 63-73). Singapore: Springer Nature Singapore.
    [CrossRef]   [Google Scholar]
  46. Kaluarachchi, P. L., Wadasinghe, D. V., Ranaweera, E. T. M., Weerasooriya, W. M. S., De Silva, D. I., & Amarasinghe, J. V. A. A Comparative Analysis of Unit Testing and Integration Testing Based on Adding a New Feature in an E-commerce Application.
    [Google Scholar]

Cite This Article
APA Style
Akhtar, S. (2025). Software Testing Evolution: Comparative Insights into Traditional and Emerging Practices. ICCK Journal of Software Engineering, 1(1), 46–62. https://doi.org/10.62762/JSE.2025.246843

Article Metrics
Citations:

Crossref

0

Scopus

0

Web of Science

0
Article Access Statistics:
Views: 47
PDF Downloads: 10

Publisher's Note
ICCK stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and Permissions
CC BY Copyright © 2025 by the Author(s). Published by Institute of Central Computation and Knowledge. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
ICCK Journal of Software Engineering

ICCK Journal of Software Engineering

ISSN: request pending (Online) | ISSN: request pending (Print)

Email: [email protected]

Portico

Portico

All published articles are preserved here permanently:
https://www.portico.org/publishers/icck/