Review On The Analysis Of Qoe Applied In Serious Virtual Reality Games

Main Article Content

Demostenes Zegarra Rodriguez
Fernando Caio SILVA AMARAL


Over time, electronic games have evolved from simple pixelated objects to complex expe-
riences with a wide variety of narratives and user interactions, including various forms of immersion
such as customized controls and games utilizing virtual reality (VR). VR allows users to interact with
and perceive virtual objects in a more immersive way. Transitioning beyond mere entertainment, games
have proven to be excellent educational tools for teaching various subjects and assisting in tasks like
professional training across diverse fields, known as serious games. Through the use of virtual reality,
individuals can visually learn through experiences such as virtual trips to aquariums, museums, and even
the lunar surface. Healthcare professionals can practice surgical techniques using virtual patients, and
production industry workers can operate machines without the need to halt real factory machinery for
training purposes. While this technology is considered revolutionary by some, certain factors still hinder
the widespread adoption of virtual reality by the general population. One primary concern reported by
VR users is the occurrence of motion sickness and discomfort. Research is underway to enhance the user
experience, but this remains an open challenge. Addressing this issue, user experience (QoE) research
can be applied to assess and identify improvements. Thus, QoE enhancements not only contribute to
user satisfaction but also maximize the educational benefits of these games. This study aims to evalu-
ate key user complaints regarding the experience with specific games. Once these issues are identified,
suggestions will be implemented, and a new round of user game experimentation, along with feedback
collection, will be conducted. This refinement process is intended to be repeated iteratively, allowing the
results to guide improvements in the Quality of Experience for serious games.

Article Details

How to Cite
Zegarra Rodriguez, D., & SILVA AMARAL, F. C. (2024). Review On The Analysis Of Qoe Applied In Serious Virtual Reality Games. INFOCOMP Journal of Computer Science, 22(2). Retrieved from


Ramos, B. L., Lasmar, E., Rosa, R. L., Rodriguez, D. Z., and Grutzman, A. Calculating the influence

of tagging people on sentiment analysis, 2018.

Rosa, R. L., Schwartz, G. M., Ruggiero, W. V., and Rodríguez, D. Z. A knowledge-based recommendation system that includes sentiment analysis and deep learning. IEEE Transactions on Indus-

trial Informatics, 15(4):2124–2135, 2018.

Silva, D. H., Maziero, E. G., Saadi, M., Rosa, R. L., Silva, J. C., Rodriguez, D. Z., and Igorevich, K. K. Big data analytics for critical information classification in online social networks using classifier chains. Peer-to-Peer Networking and

Applications, pages 1–16, 2022.

Rosa, R. L., Lasmar Junior, E. L., and Zegarra Rodríguez, D. A recommendation system for shared-

use mobility service through data extracted from online social networks. Journal of Communica-

tions Software and Systems, 14(4):359–366, 2018.

Lasmar, E. L., de Paula, F. O., Rosa, R. L., Abrahão, J. I., and Rodríguez, D. Z. Rsrs: Ridesharing recommendation system based on so-

cial networks to improve the user’s qoe. IEEE Transactions on Intelligent Transportation Sys-

tems, 20(12):4728–4740, 2019.

Ayub, M. S., Adasme, P., Melgarejo, D. C., Rosa, R. L., and Rodríguez, D. Z. Intelligent hello

dissemination model for fanet routing protocols. IEEE Access, 10:46513–46525, 2022.

Rodríguez, D. Z., da Silva, M. J., Silva, F. J. M., and Junior, L. C. B. Assessment of transmitted

speech signal degradations in rician and rayleigh channel models. INFOCOMP Journal of Computer Science, 17(2):23–31, 2018.

Vieira, S. T., Rosa, R. L., and Rodríguez, D. Z. A speech quality classifier based on tree-cnn algo-

rithm that considers network degradations. Journal of Communications Software and Systems,

(2):180–187, 2020.

Rodríguez, D. Z. and Junior, L. C. B. Determining a non-intrusive voice quality model using machine

learning and signal analysis in time. INFOCOMP Journal of Computer Science, 18(2), 2019.

Rodríguez, D. Z., Rosa, R. L., Almeida, F. L., Mittag, G., and Möller, S. Speech quality assessment

in wireless communications with mimo systems using a parametric model. IEEE Access, 7:35719–

, 2019.

Terra Vieira, S., Lopes Rosa, R., Zegarra Rodríguez, D., Arjona Ramírez, M., Saadi, M., and

Wuttisittikulkij, L. Q-meter: Quality monitoring system for telecommunication services based on

sentiment analysis using deep learning. Sensors, 21(5):1880, 2021.

Nunes, R. D., Rosa, R. L., and Rodríguez, D. Z. Performance improvement of a non-

intrusive voice quality metric in lossy networks. IET Communications, 13(20):3401–3408, 2019.

Yannakakis, G. N. and Melhart, D. Affective game computing: A survey. Proceedings of the IEEE,

(10):1423–1444, 2023.

Fernandes, L. V., Castanho, C. D., and Jacobi, R. P. A survey on game analytics in massive multi-

player online games. In 2018 17th Brazilian Symposium on Computer Games and Digital Enter-

tainment (SBGames), pages 21–2109, 2018.

Jang, Y. and Ryu, S. Exploring game leadership and online game community. In 2009 Conference

in Games and Virtual Worlds for Serious Applications, pages 178–181, 2009.

Saldana, J. On the effectiveness of an optimization method for the traffic of TCP-based multi-

player online games - Multimedia Tools and Applications — 2015. [Accessed


Tsipis, A., Komianos, V., and Oikonomou, K. A cloud gaming architecture leveraging fog for dy-

namic load balancing in cluster-based mmos. In 2019 4th South-East Europe Design Automation,

Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM),

pages 1–6, 2019.

Carrión, C. Research streams and open challenges in the metaverse. The Journal of Supercomputing,

Jul 2023.

Daengsi, T., Pornpongtechavanich, P., and Wuttidittachotti, P. A proposed audiovisual quality

assessment model associated with multiplayer on-line battle arena game: A pilot study with rov. In

22nd International Conference on Advanced Communication Technology (ICACT), pages 367–

, 2020.

Covaci, A., Ghinea, G., Lin, C.-H., Huang, S.-H., and Shih, J.-L. Multisensory games-based learn-

ing - lessons learnt from olfactory enhancement of a digital board game. Multimedia Tools and Applications, 77(16):21245–21263, Aug 2018.

Schmidt, S. Assessing the quality of experience of Cloud Gaming Services. Springer International

Publishing AG, 2023.

Ky, J. R., Mathieu, B., Lahmadi, A., and Boutaba, R. Assessing unsupervised machine learning solu-

tions for anomaly detection in cloud gaming sessions. In 2022 18th International Conference on

Network and Service Management (CNSM), pages 367–373, 2022.

Huang, H.-S. and Su, Y.-S. A practical study of qoe on cloud gaming in 5g networks. In 2023 In-

ternational Wireless Communications and Mobile Computing (IWCMC), pages 638–643, 2023.

Serrano, J., del Río, A., Nakimuli, W., Jiménez, D., Garcia-Reinoso, J., Contreras, L. M., and Al-

varez, F. Design, implementation, and validation of a multi-site gaming streaming service over

a 5g-enabled platform. IEEE Transactions on Broadcasting, 68(2):464–474, 2022.

Videnovik, M., Trajkovik, V., Kiønig, L. V., and Vold, T. Increasing quality of learning experience

using augmented reality educational games. Multimedia Tools and Applications, 79(33):23861–

, Sep 2020.

Nguyen-Viet, B. and Nguyen-Viet, B. Enhancing satisfaction among vietnamese students through

gamification: The mediating role of engagement and learning effectiveness bang nguyen-viet bac

nguyen-viet enhancing satisfaction among vietnamese students through gamification: The me-

diating role of engagement and learning effectiveness. Cogent Education, 10, 10 2023.

Gazis, A. and Katsiri, E. Serious games in digital gaming: A comprehensive review of applica-

tions, game engines and advancements. WSEAS TRANSACTIONS ON COMPUTER RESEARCH,

:10–22, 03 2023.

Stankovi ́c Elesini, U., Miha, H., Kristan, D., Korošec, A., Proti ́c, E., Uˇcakar, A., Vrabiˇc Brodnjak,

U., and Rugelj, J. Mobile serious game for enhancing user experience in museum. J. Comput.

Cult. Herit., 16(1), dec 2022.

Mellouk, A., Tran, H. A., and Hoceini, S. Quality of experience for multimedia: Application to

content delivery network architecture.

Marchal, X., Graff, P., Ky, J. R., Cholez, T., Tuffin, S., Mathieu, B., and Festor, O. An analysis

of cloud gaming platforms behaviour under synthetic network constraints and real cellular net-

works conditions. Journal of Network and Systems Management, 31(2):39, Feb 2023.

Cao, T., Jin, Y., Hu, X., Zhang, S., Qian, Z., Ye, B., and Lu, S. Adaptive provisioning for mo-

bile cloud gaming at edges. Computer Networks, 205:108704, 2022.

Suznjevic, M. and Matijasevic, M. Player behavior and traffic characterization for mmorpgs: a

survey. Multimedia Systems, 19(3):199–220, Jun 2013.

Li, H., Cui, C., and Jiang, S. Strategy for improving the football teaching quality by ai and

metaverse-empowered in mobile internet environment. Wireless Networks, Jun 2022.

Fiedler, M., Hossfeld, T., and Tran-Gia, P. A generic quantitative relationship between quality

of experience and quality of service. IEEE Network, 24(2):36–41, 2010.

Silva Barbosa, T. and Henrique Kronbauer, A. Panorama of researches related to the application

of virtual reality in the health area in svr. In 2019 21st Symposium on Virtual and Augmented Real-

ity (SVR), pages 69–76, 2019.

Weissker, T., Bimberg, P., Kodanda, A., and Froehlich, B. Holding hands for short-term group

navigation in social virtual reality. In 2022 IEEE Conference on Virtual Reality and 3D User In-

terfaces Abstracts and Workshops (VRW), pages 728–729, 2022.

Borghetti, D., Zanobini, C., Natola, I., Ottino, S., Parenti, A., Brugada-Ramentol, V., Jalali, H.,

and Bozorgzadeh, A. Evaluating cognitive performance using virtual reality gamified exercises.

Frontiers in Virtual Reality, 4, 11 2023.

Cardoso, A., Lamounier, E., Lima, G., Oliveira, L., Mattioli, L., Júnior, G., Silva, A., Nogueira, K., do Prado, P., and Newton, J. Vrcemig: A virtual reality system for real time control of electric

substations. In 2013 IEEE Virtual Reality (VR), pages 165–166, 2013.

Liu, Y., Sun, Q., Tang, Y., Li, Y., Jiang, W., and Wu, J. Virtual reality system for industrial train-

ing. In 2020 International Conference on Virtual Reality and Visualization (ICVRV), pages 338–

, 2020.

Schild, J., Misztal, S., Roth, B., Flock, L., Luiz, T., Lerner, D., Herkersdorf, M., Weaner, K., Neu-

beraer, M., Franke, A., Kemp, C., Pranqhofer, J., Seele, S., Buhler, H., and Herpers, R. Apply-

ing multi-user virtual reality to collaborative medical training. In 2018 IEEE Conference on Virtual

Reality and 3D User Interfaces (VR), pages 775–776, 2018.

Carrión, M., Santorum, M., Benavides, J., Aguilar, J., and Ortiz, Y. Developing a virtual

reality serious game to recreational therapy using iplus methodology. In 2019 International

Conference on Virtual Reality and Visualization (ICVRV), pages 133–137, 2019.

Jacobs, K. Importance of democratization for virtual reality in education. In 2023 IEEE Confer-

ence on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pages 536–540,

Handoko, E. and Gunawan, D. Parabolix: Educational simulation game on classical mechanics

based on virtual reality and perlin noise algorithm. In 2019 5th International Conference on New Me-

dia Studies (CONMEDIA), pages 165–170, 2019.

Aleksi ́c, V. and Politis, D. The characteristics of virtual reality usage in educational systems.

In 2020 International Conference on INnovations in Intelligent SysTems and Applications (INISTA),

pages 1–5, 2020.

Belter, M. and Lukosch, H. Towards a virtual reality math game for learning in schools - a user

study. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops

(VRW), pages 808–809, 2022.

Zojaji, S. and Peters, C. Towards virtual agents for supporting appropriate small group behaviors in

educational contexts. In 2019 11th International Conference on Virtual Worlds and Games for Se-

rious Applications (VS-Games), pages 1–2, 2019.

Hupont Torres, I., Gracia, J., Sanagustin, L., and Gracia, M. A. How do new visual immersive sys-

tems influence gaming qoe? a use case of serious gaming with oculus rift. 2015 7th International

Workshop on Quality of Multimedia Experience, QoMEX 2015, 07 2015.

Gunkel, S. N. [dc] multi-user (social) virtual reality commnunication. In 2019 IEEE Conference

on Virtual Reality and 3D User Interfaces (VR), pages 1359–1360, 2019.

Dittrich, F., Palige, S., Bullinger, A. C., Zeiler, A., and Krabbe, M. Effect of degrees of free-

dom on the quality of use of virtual theatre experiences. In 2023 IEEE International Symposium on

Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pages 637–641, 2023.

Gomes, G. D., Flynn, R., and Murray, N. A qoe evaluation of an immersive virtual reality au-

tonomous driving experience. In 2020 Twelfth International Conference on Quality of Multimedia

Experience (QoMEX), pages 1–4, 2020.

Moraes, A. N., Flynn, R., Hines, A., and Murray, N. Evaluating the user in a sound localisation task

in a virtual reality application. In 2020 Twelfth International Conference on Quality of Multimedia

Experience (QoMEX), pages 1–6, 2020.

Zheleva, A., Durnez, W., Bombeke, K., Van Wallendael, G., and De Marez, L. Seeing is believing:

The effect of video quality on quality of experience in virtual reality. In 2020 Twelfth Interna-

tional Conference on Quality of Multimedia Experience (QoMEX), pages 1–4, 2020.

Jabar, F., Ascenso, J., and Queluz, M. P. Field-of-view effect on the perceived quality of omnidirec-

tional images. In 2020 IEEE International Conference on Multimedia Expo Workshops (ICMEW),

pages 1–6, 2020.

Cortés, C., Pérez, P., and García, N. Understanding latency and qoe in social xr. IEEE Consumer

Electronics Magazine, pages 1–10, 2023.

Zhang, Y., Pu, L., Lin, T., and Yan, J. Qoe-oriented mobile virtual reality game in distributed

edge networks. IEEE Transactions on Multimedia, pages 1–14, 2023.

Lu, E., Bharadwaj, S., Dasari, M., Smith, C., Seshan, S., and Rowe, A. Renderfusion: Balanc-

ing local and remote rendering for interactive 3d scenes. In 2023 IEEE International Symposium

on Mixed and Augmented Reality (ISMAR), pages 312–321, 2023.

Yu, H., Shokrnezhad, M., Taleb, T., Li, R., and Song, J. Toward 6g-based metaverse: Support-

ing highly-dynamic deterministic multi-user extended reality services. IEEE Network, 37(4):30–

, 2023.

Alencar, D., Both, C., Antunes, R., Oliveira, H., Cerqueira, E., and Rosário, D. Dynamic microser-

vice allocation for virtual reality distribution with qoe support. IEEE Transactions on Network and

Service Management, 19(1):729–740, 2022.

Cortés, C., Rubio, M., Pérez, P., Sánchez, B., and García, N. Qoe study of natural interaction in

extended reality environment for immersive training. In 2022 IEEE Conference on Virtual Reality

and 3D User Interfaces Abstracts and Workshops (VRW), pages 363–368, 2022.

Gao, N., Xie, T., and Liu, G. A learning engagement model of educational games based on virtual

reality. In 2018 International Joint Conference on Information, Media and Engineering (ICIME),

pages 1–5, 2018.

IEEE. Ieee standard for the deep learning-based assessment of visual experience based on human

factors. IEEE Std 3333.1.3-2022, pages 1–51, 2022.

Zheng, G. and Yuan, L. A review of qoe research progress in metaverse. Displays, 77:102389,

Laghari, A., He, H., Ali, K., Laghari, R., Halepoto, I., and Khan, A. Quality of experience (qoe)

in cloud gaming models: A review. Multiagent and Grid Systems, 15:289–304, 10 2019.

Melo, M., Coelho, H., Gonçalves, G., Losada, N., Jorge, F., Teixeira, M. S., and Bessa, M. Immer-

sive multisensory virtual reality technologies for virtual tourism. Multimedia Systems, 28(3):1027–

, Jun 2022.

Sabet, S. S., Eg, R., Raaen, K., Oasim, M., Riegler, M., and Halvorsen, P. When every

millisecond counts: The impact of delay in vr gaming. In 2022 14th International Conference

on Quality of Multimedia Experience (QoMEX), pages 1–4, 2022