Software Quality Measurement for Functional Suitability, Performance Efficiency, and Reliability Characteristics Using Analytical Hierarchy Process

Sarwosri Sarwosri - Institut Teknologi Sepuluh Nopember, Keputih Sukolilo Surabaya, 60111, Indonesia
Siti Rochimah - Institut Teknologi Sepuluh Nopember, Keputih Sukolilo Surabaya, 60111, Indonesia
Umi Laili Yuhana - Institut Teknologi Sepuluh Nopember, Keputih Sukolilo Surabaya, 60111, Indonesia
Sultana Balqis Hidayat - Institut Teknologi Sepuluh Nopember, Keputih Sukolilo Surabaya, 60111, Indonesia

Citation Format:



The quality model used in this paper is ISO 25010. Functional Suitability, Performance Efficiency, and Reliability are the characteristics to be used. The case study used is the ITS Academic Information System, and the method used for the basis of calculation is the AHP (Analytical Hierarchy Process) method. The initial stage is to make a list of questionnaire questions, which are then filled out by three stakeholders: experts, students, and developers. With the AHP method, experts will analyze the questionnaire results to determine the required weight. This weight is used to calculate the quality of the software. There are two types of software measurements: student questionnaires and developer questionnaires. These two questionnaires become data input. Automatic measurements are carried out on Time Behavior aspects, namely Response Time Testing. In the automatic measurement stage, the URL to be tested by the tester is used as data input. From this automatic measurement, we experimented with the response time of the destination URL to respond to requests and conversion results on a scale of one hundred. The final value of these two types of measurements will be used in several equations to get the final value of the quality of the software. The study results are in the form of automatic measuring instruments of software quality. The measurement results can be used as feedback in making improvements so that the quality value increases when measured. Regarding Functional Suitability, the ITS Academic Information System has provided features according to user needs. In the aspect of Performance Efficiency, the ITS Academic Information System can provide performance and performance according to user needs. Meanwhile, regarding reliability, the ITS Academic Information System can carry out a function under certain conditions and times

Full Text:



A. Hussain and E. Mkpojiogu, “Armstrong & Nelles 4.pdf,” J. Teknol. (Sciences Eng., vol. 5, pp. 9–13, 2015, [Online]. Available:

L. A. Tilahun and B. Sekeroglu, “An intelligent and personalized course advising model for higher educational institutes,” SN Appl. Sci., vol. 2, no. 10, pp. 1–14, 2020, doi: 10.1007/s42452-020-03440-4.

L. Buglione, “248-1827-1-Pb,” vol. 4, no. 3, pp. 72–79, 2015.

I. Castillo, F. Losavio, A. Matteo, and J. Boegh, “REquirements, aspects and software quality: The REASQ model,” J. Object Technol., vol. 9, no. 4, pp. 69–91, 2010, doi: 10.5381/jot.2010.9.4.a4.

Y. Jiang et al., “Study on the Evolution and Optimization of the Spatial Structure of the Oasis in the Arid Area: A Case Study of the Aksu River Basin in China,” Int. J. Environ. Res. Public Health, vol. 20, no. 6, 2023, doi: 10.3390/ijerph20064920.

M. S. Rahman, S. M. Shuhidan, and M. N. Masrek, “The Influence between GIS Quality and User Satisfaction towards Individual Work Performance: A Proposed Conceptual Framework.,” Int. J. Emerg. Technol. Adv. Eng., vol. 11, no. 12, pp. 164–170, 2021, doi: 10.46338/ijetae1221_17.

S. J. R. Manglapuz and L. L. Lacatan, “Academic management android application for student performance analytics: A comprehensive evaluation using ISO 25010:2011,” Int. J. Innov. Technol. Explor. Eng., vol. 8, no. 12, pp. 5085–5089, 2019, doi: 10.35940/ijitee.L2735.1081219.

L. Souza-Pereira, S. Ouhbi, and N. Pombo, “A process model for quality in use evaluation of clinical decision support systems,” J. Biomed. Inform., vol. 123, no. September, p. 103917, 2021, doi: 10.1016/j.jbi.2021.103917.

F. Abdillah, P. H. Slamet, and Sukardi, “Test analysis of the development conversion and recognition prior learning models on vocational teachers’ education,” Int. J. Eng. Adv. Technol., vol. 8, no. 5, pp. 1456–1460, 2019, doi: 10.35940/ijeat.E1213.0585C19.

J. M. S. França, A. A. da Costa Junior, and M. S. Soares, “Architecture-Driven Development of an Electronic Health Record Considering the SOAQM Quality Model,” SN Comput. Sci., vol. 1, no. 3, pp. 1–21, 2020, doi: 10.1007/s42979-020-00150-x.

M. Haoues, R. Mokni, and A. Sellami, Machine learning for mHealth apps quality evaluation: An approach based on user feedback analysis, vol. 31, no. 4. Springer US, 2023. doi: 10.1007/s11219-023-09630-8.

N. Kadoić, D. Šimić, J. Mesarić, and N. B. Ređep, “Measuring quality of public hospitals in Croatia using a multi-criteria approach,” Int. J. Environ. Res. Public Health, vol. 18, no. 19, 2021, doi: 10.3390/ijerph18199984.

M. J. Blas, H. Leone, and S. Gonnet, “Modeling and simulation framework for quality estimation of web applications through architecture evaluation,” SN Appl. Sci., vol. 2, no. 3, pp. 1–21, 2020, doi: 10.1007/s42452-020-2171-z.

G. Chen, J. Zhang, W. Tan, S. Zhang, and B. Yan, “Customer knowledge management competence evaluation of agritourism enterprises by using the balanced scorecard and fuzzy-AHP: Evidence from Chengdu-Chongqing economic circle,” PLoS One, vol. 18, no. 2 February, pp. 1–22, 2023, doi: 10.1371/journal.pone.0280482.

T. Q. Nguyen, L. T. T. Ngo, N. T. Huynh, T. Le Quoc, and L. van Hoang, “Assessing port service quality: An application of the extension fuzzy AHP and importance-performance analysis,” PLoS One, vol. 17, no. 2 February, pp. 1–24, 2022, doi: 10.1371/journal.pone.0264590.

S. A. AlQahtani, “Cooperative-Aware Radio Resource Allocation Scheme for 5G Network Slicing in Cloud Radio Access Networks,” Sensors, vol. 23, no. 11, 2023, doi: 10.3390/s23115111.

J. L. Li et al., “The Efficacy and Safety of Acupuncture for Treating Osteoporotic Vertebral Compression Fracture-(OVCF-) Induced Pain: A Systematic Review and Meta-Analysis of Randomized Clinical Trials,” Evidence-based Complement. Altern. Med., vol. 2021, 2021, doi: 10.1155/2021/8574621.

B. Lee et al., “Implementation and quality assessment of a clinical orthopedic registry in a public hospital department,” BMC Health Serv. Res., vol. 20, no. 1, pp. 1–9, 2020, doi: 10.1186/s12913-020-05203-8.

T. Wang, N. Li, and H. Li, “Design and development of human resource management computer system for enterprise employees,” PLoS One, vol. 16, no. 12 December, pp. 1–21, 2021, doi: 10.1371/journal.pone.0261594.

R. Qiang and J. Yang, “Influential Spreader Identification in Complex Networks Based on Network Connectivity and Efficiency,” Wirel. Commun. Mob. Comput., vol. 2022, 2022, doi: 10.1155/2022/7896380.