Methods for quality assessment of standardized software time indicators

Main Article Content

Mykola Kuz
Yaroslav Bezghachniuk
Taras Horodenko
Borys Nezamai
Andrii Oliinyk

Abstract

Time parameters of software quality indicators are among the most important when assessing the quality of software products, as they determine performance, stability and resource utilization efficiency. In the article time indicators of software product quality are researched in accordance with international standards ISO/IEC 25022 and ISO/IEC 25023. These standards provide a list of software quality indicators, but do not contain any methods or techniques for determining them. In particular, there are no any measurement techniques for time indicators of software quality. The purpose of this research is study and systematize time indicators of the software products quality and develop methods for their classification and evaluation on a time scale. The feasibility of forming a clear classification of time metrics is substantiated, which covers different time scales – from immediate system reactions to long-term effects of exploitation. The method of structuring indicators into four time ranges (seconds, minutes/hours, days, months), which provides a complex assessment of performance, reliability and stability of software products. An application has been developed that implements the measurement of basic time indicators, in particular, mean response time, median, 95-percentile and dispersion, based on multiple HTTP requests using high-precision timer. The experiment with SLA threshold equals to 150 ms confirms a practical efficiency of the proposed model and it eligibility to industry standards. The obtained results show high performance and stability of the system, that indicates research theoretical statements is relevant. The research emphasizes, that time indicators are a universal indicator of software quality, providing a basis for standardized performance assessment for different types of information system.

Article Details

Section

Articles

References

[1] ISO/IEC 25022:2016. Systems and software engineering – Systems and software quality requirements and evaluation (SQuaRE) – Measurement of quality in use. [First edition 2016-06-15]. Switzerland, 2016. 49 p.

[2] ISO/IEC 25023:2016. Systems and software engineering – Systems and software quality requirements and evaluation (SQuaRE) – Measurement of system and software product quality. [First edition 2016-06-15]. Switzerland, 2016. 55 p.

[3] Karnouskos S. et al. The Applicability of ISO/IEC 25023 Measures to the Integration of Agents and Automation Systems, in: 44th Annual Conference of the IEEE Industrial Electronics Society, 2018, pp. 2927–2934. https://doi.org/10.1109/IECON.2018.8592777.

[4] B. Jaradat, G. Weheba, A Practical Guide to ISO 25022: Measurement of Software Quality in Use, Journal of Management & Engineering Integration. 17(2024), 45–52.

[5] Ravanello A. et al. Associating Performance Measures with Perceived End User Performance: ISO 25023 Compliant Low Level Derived Measures, in: Cloud Computing, GRIDs and Virtualization, 2015, рр. 110-115.

[6] Tsuda N. et al. WSQF: Comprehensive Software Quality Evaluation Framework and Benchmark based on SQuaRE, in: International Conference on Software Engineering, 2019, pp. 61–70. https://doi.org/10.1109/ICSE-SEIP.2019.00045.

[7] Argotti Y. et al. An Operational Quality Model of Embedded Software Aligned with ISO 25000, in: ACM Transactions on Embedded Computing Systems, 2024, рр. 1-41. https://doi.org/10.1145/3691642.

[8] ISO/IEC 25010:2011. Systems and software engineering – Systems and software quality requirements and evaluation (SQuaRE) – System and software quality models. [First edition 2011-03-01]. Switzerland, 2011. 34 p.

[9] Y. Unuchak, T. Unuchak. Approaches to Comprehensive Performance Evaluation of Software Applications: A Systematic Literature Review, in: Human Being, AI & Organization, 2025, pp. 989–1000. https://doi.org/10.18690/um.fov.2.2025.75.

[10] M. Fryz, B. Mlynk, Determination of the characteristic function of discrete-time conditional linear random process and its application, Scientific Journal of TNTU (Tern.), vol. 109, no. 1 (2023), pp. 16-23. https://doi.org/10.33108/visnyk_tntu2023.01.016.

[11] M. Pikuliak, M. Kuz, I. Lazarovych, Y. Kuzyk, V. Skliarov,. Method of Determining the Parameter of Qualitative Evaluation of a Web Forum, Radio Electronics, Computer Science, Control, 3 (2024), pp. 151-159. https://doi.org/10.15588/1607-3274-2024-3-13.

[12] M. Kuz, I. Yaremiy, H. Yaremii, M. Pikuliak, I. Lazarovych, M. Kozlenko, D. Vekeryk, Methods for Evaluating Software Accessibility, Radio Electronics, Computer Science, Control, 3 (2025), pp. 163-172. https://doi.org/10.15588/1607-3274-2025-3-15.

[13] M. V. Kuz, V. M. Andreiko, Evaluation of Quality Characteristics of Software for the Reference Verification Installations for Gasmeters, Ukrainian Metrological Journal, 1 (2018), pp. 43-48. https://doi.org/10.24027/2306-7039.1.2018.134129 [In Ukrainian].

[14] Google Research. Milliseconds Make Millions. Google Cloud Performance Report, 2018. URL: https://services.google.com/fh/files/misc/millisecondsmakemillions.pdf (accessed: 03.10.2025).

[15] Nielsen J. Response Times: The 3 Important Limits. Nielsen Norman Group, 2020. URL: https://www.nngroup.com/articles/response-times-3-important-limits/ (accessed: 03.10.2025).

[16] Amazon Web Services. Monitoring Best Practices: Service Level Objectives. AWS Documentation, 2024. URL: https://docs.aws.amazon.com/ (accessed: 03.10.2025).