A New Study Says Video Games Can Be Excellent Tools for Physical Rehab

:::info Authors:

(1) Antoine Loriette, IRCAM, CNRS, Sorbonne Universite, Paris, France ([email protected]);

(2) Baptiste Caramiaux, Sorbonne Universite, CNRS, ISIR, Paris, France ([email protected]);

(3) Sebastian Stein, School of Computing Science, University of Glasgow, Glasgow, Scotland, United Kingdom ([email protected]);

(4) John H. Williamson, School of Computing Science, University of Glasgow, Glasgow, Scotland, United Kingdom ([email protected]).

:::

Table of Links

• Abstract and 1 Introduction
• 2 Related Work and 2.1 Modifying Games for Rehabilitation
• 2.2 Input control performance measure and modelling and 2.3 Summary
• 3 Motivation from a rehabilitation context and 3.1 Observations and Brainstorming workshops
• 3.2 System description
• 3.3 Interaction parameterisation
• 3.4 Summary
• 4 Experimental Study
• 5 Modelling User Behaviour and 5.1 Behavioural Features
• 5.2 Gameplay Reference Model
• 5.3 Comparing NLL to NSCORE
• 5.4 Effect of design parameters on NLL
• 5.5 Sampling Period
• 6 Discussion and 6.1 Design workshop and tools for modelling
• 6.2 Interaction parameters adaptation
• 6.3 Modelling Gameplay
• 6.4 Limitations and Future work
• 7 Conclusion
• 8 Acknowledgements and References

7 Conclusion

We have shown that a computational approach to design can be used as a mean to systematically control interaction performance in games where input device characteristics are varied. We argued that performance is an important side of the interaction to take into account when creating new control devices. We proposed a probabilistic model of lowlevel user behaviour that affords a measure of similarity against baseline gameplay, that could be used to online system adaptation. Through a complete methodology from field work to experimental and computational studies, this work brings a pragmatic account for designing interactive systems while maintaining user performance in a rehabilitation context.

8 Acknowledgements

We would like to warmly thank our contacts from the Spinal Unit of the QEU hospital (https://www.spinalunit. scot.nhs.uk/), in particular Michelle Rankin and Mariel Purcell, for the time they spent sharing their valuable expertise, helping with the design and testing of the prototype and their overall support for this research, which was funded through the MOREGRASP project (http://www.moregrasp.eu/).

References

F. Anderson, T. Grossman, J. Matejka, and G. Fitzmaurice. YouMove. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST ’13, pages 311–320, New York, New York, USA, 2013. ACM Press. ISBN 9781450322683. doi: 10.1145/2501988.2502045. URL http://dl.acm.org/citation. cfm?doid=2501988.2502045.

\ K. D. Anderson. Targeting Recovery: Priorities of the Spinal Cord-Injured Population. Journal of Neurotrauma, 21(10):1371–1383, oct 2004. ISSN 0897-7151. doi: 10.1089/neu.2004.21.1371. URL http://www. liebertonline.com/doi/abs/10.1089/neu.2004.21.1371.

\ M. Bachynskyi, G. Palmas, and T. Weinkauf. Informing the Design of Novel Input Methods with Muscle Coactivation Clustering. Transactions on Computer-Human Interaction, 21(6):1–25, jan 2015. ISSN 10730516. doi: 10.1145/ 2687921. URL http://dx.doi.org/10.1145/2687921.

\ X. Bao, Y. R. Mao, Q. Lin, Y. H. Qiu, S. Z. Chen, L. Li, R. S. Cates, S. F. Zhou, and D. F. Huang. Mechanism of Kinect-based virtual reality training for motor functional recovery of upper limbs after subacute stroke. Neural Regeneration Research, 8(31):2904–2913, nov 2013. ISSN 16735374. doi: 10.3969/j.issn.1673-5374.2013.31.003. URL https://www.ncbi.nlm.nih.gov/pubmed/25206611.

\ N. Barrett, I. Swain, C. Gatzidis, and C. Mecheraoui. The use and effect of video game design theory in the creation of game-based systems for upper limb stroke rehabilitation. Journal of Rehabilitation and Assistive Technologies Engineering, 3:205566831664364, jun 2016. ISSN 2055-6683. doi: 10.1177/2055668316643644. URL http: //journals.sagepub.com/doi/10.1177/2055668316643644.

\ J. W. Burke, M. D. J. McNeill, D. K. Charles, P. J. Morrow, J. H. Crosbie, and S. M. McDonough. Optimising engagement for stroke rehabilitation using serious games. Visual Computer, 25(12):1085–1099, dec 2009. ISSN 01782789. doi: 10.1007/s00371-009-0387-4. URL http://link.springer.com/10.1007/s00371-009-0387-4.

\ S. K. Card, J. D. Mackinlay, and G. G. Robertson. A morphological analysis of the design space of input devices. ACM Transactions on Information Systems, 9(2):99–122, apr 1991. ISSN 10468188. doi: 10.1145/123078.128726. URL http://dl.acm.org/citation.cfm?id=123078.128726.

\ A. Chatta, T. Hurst, G. Samaraweera, R. Guo, and J. Quarles. Get off the Couch. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play - CHI PLAY ’15, pages 47–56, New York, New York, USA, 2015. ACM Press. ISBN 9781450334662. doi: 10.1145/2793107.2793115. URL http://dl.acm.org/ citation.cfm?doid=2793107.2793115.

\ M. Csikszentmihalyi. Toward a Psychology of Optimal Experience. In Flow Found. Posit. Psychol., pages 209–226. Springer Netherlands, Dordrecht, 2014. doi: 10.1007/978-94-017-9088-8 14. URL http://link.springer. com/10.1007/978-94-017-9088-8{_}14.

\ S. Deterding, M. Sicart, L. Nacke, K. O’Hara, and D. Dixon. Gamification. using game-design elements in nongaming contexts. In Proc. 2011 Annu. Conf. Ext. Abstr. Hum. factors Comput. Syst. - CHI EA ’11, page 2425, New York, New York, USA, 2011. ACM Press. ISBN 9781450302685. doi: 10.1145/1979742.1979575. URL https://dl.acm.org/citation.cfm?doid=1979742.1979575.

\ V. Dhakal, A. M. Feit, P. O. Kristensson, and A. Oulasvirta. Observations on typing from 136 million keystrokes. In Conference on Human Factors in Computing Systems - Proceedings, volume 2018-April, pages 1–12, New York, New York, USA, apr 2018. Association for Computing Machinery. ISBN 9781450356206. doi: 10.1145/3173574. 3174220. URL http://dl.acm.org/citation.cfm?doid=3173574.3174220.

\ K. M. Gerling, M. Klauser, and J. Niesenhaus. Measuring the impact of game controllers on player experience in FPS games. In Proceedings of the 15th International Academic MindTrek Conference on Envisioning Future Media Environments - MindTrek ’11, page 83, New York, New York, USA, 2011. ACM Press. ISBN 9781450308168. doi: 10.1145/2181037.2181052. URL http://dl.acm.org/citation.cfm?doid=2181037.2181052.

\ H. Halfbrick Studios. Fruit Ninja. Game [iOS], apr 2010.

\ M. Hendrix, T. Bellamy-Wood, S. McKay, V. Bloom, and I. Dunwell. Implementing adaptive game difficulty balancing in serious games. IEEE Transactions on Games, 11(4):320–327, dec 2019. ISSN 24751510. doi: 10.1109/TG.2018. 2791019.

\ M. Hofmann, K. Williams, T. Kaplan, S. Valencia, G. Hann, S. E. Hudson, J. Mankoff, and P. Carrington. ”Occupational Therapy is Making”. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19, pages 1–13, New York, New York, USA, 2019. ACM Press. ISBN 9781450359702. doi: 10.1145/3290605.3300544. URL http://dl.acm.org/citation.cfm?doid=3290605.3300544.

\ P. Isokoski and B. Martin. Performance of input devices in FPS target acquisition. In ACM International Conference Proceeding Series, volume 203, pages 240–241, New York, New York, USA, 2007. ACM Press. ISBN 1595936408. doi: 10.1145/1255047.1255104. URL http://portal.acm.org/citation.cfm?doid=1255047.1255104.

\ F. M. M. Jr, M. B. Bracken, G. Creasey, J. F. D. Jr, W. H. Donovan, T. B. Ducker, S. L. Garber, R. J. Marino, S. L. Stover, C. H. Tator, R. L. Waters, J. E. Wilberger, and W. Young. International Standards for Neurological and Functional Classification of Spinal Cord Injury. Spinal Cord, 35(5):266–274, 1997. ISSN 13624393. doi: 10.1038/sj.sc.3100432. URL http://www.nature.com/doifinder/10.1038/sj.sc.3100432.

\ D. Karavolos, A. Liapis, and G. N. Yannakakis. Using a Surrogate Model of Gameplay for Automated Level Design. In IEEE Conference on Computatonal Intelligence and Games, CIG, volume 2018-Augus. IEEE Computer Society, oct 2018. ISBN 9781538643594. doi: 10.1109/CIG.2018.8490425.

\ M. Ketcheson, L. Walker, and T. N. C. N. Graham. Thighrim and Calf-Life. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI ’16, pages 2681–2692, New York, New York, USA, 2016. ACM Press. ISBN 9781450333627. doi: 10.1145/2858036.2858406. URL http://dl.acm.org/citation. cfm?doid=2858036.2858406.

\ M. Khademi, H. Mousavi Hondori, A. McKenzie, L. Dodakian, C. V. Lopes, and S. C. Cramer. Free-hand interaction with leap motion controller for stroke rehabilitation. In Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems - CHI EA ’14, pages 1663–1668, New York, New York, USA, 2014. ACM Press. ISBN 9781450324748. doi: 10.1145/2559206.2581203. URL http://dl.acm.org/ citation.cfm?doid=2559206.2581203.

\ C. Klochek and I. S. MacKenzie. Performance measures of game controllers in a three-dimensional environment. Proceedings - Graphics Interface, 2006:73–79, 2006. ISSN 07135424.

\ M. Kwak and B. Salem. Designing a game controller for novice HALO3 players. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 5709 LNCS, pages 325–326. Springer, Berlin, Heidelberg, 2009. ISBN 3642040519. doi: 10.1007/978-3-642-04052-8 53. URL https://link.springer.com/chapter/10.1007/978-3-642-04052-8{_}53.

\ A. M. Limperos, M. G. Schmierbach, A. D. Kegerise, and F. E. Dardis. Gaming Across Different Consoles: Exploring the Influence of Control Scheme on Game-Player Enjoyment. Cyberpsychology, Behav. Soc. Netw., 14(6):345–350, jun 2011. ISSN 2152-2715. doi: 10.1089/cyber.2010.0146. URL http://www.liebertpub.com/doi/10.1089/ cyber.2010.0146.

\ R. Lopes and R. Bidarra. Adaptivity challenges in games and simulations: A survey. IEEE Transactions on Computational Intelligence and AI in Games, 3(2):85–99, jun 2011. ISSN 1943068X. doi: 10.1109/TCIAIG.2011.2152841.

\ A. Loriette. A computational approach to gestural interactions of the upper limb on planar surfaces. 2019.

\ R. L. Mandryk, S. Dielschneider, M. R. Kalyn, C. P. Bertram, M. Gaetz, A. Doucette, B. A. Taylor, A. P. Orr, and K. Keiver. Games as neurofeedback training for children with FASD. In Proc. 12th Int. Conf. Interact. Des. Child. - IDC ’13, pages 165–172, New York, New York, USA, 2013. ACM Press. ISBN 9781450319188. doi: 10.1145/2485760.2485762. URL http://dl.acm.org/citation.cfm?doid=2485760.2485762.

\ D. D. R. Michael and S. L. Chen. Serious games : games that educate, train and inform. Thomson Course Technology, 2006. ISBN 1592006221. URL https://dl.acm.org/citation.cfm?id=1051239.

\ J. Monedero, A. C. McDonnell, M. Keoghan, and D. J. O’Gorman. Modified Active Videogame Play Results in Moderate-Intensity Exercise. Games Health J., 3(4):234–240, aug 2014. ISSN 2161-783X. doi: 10.1089/g4h.2013. 0096. URL http://www.liebertpub.com/doi/10.1089/g4h.2013.0096.

\ J. E. Munoz, M. Cameir ˜ ao, S. Berm ˜ udez i Badia, and E. R. Gouveia. Closing the Loop in Exergaming - Health ´ Benefits of Biocybernetic Adaptation in Senior Adults. In The Annual Symposium on Computer-Human Interaction in Play Extended Abstracts - CHI PLAY ’18, pages 329–339, New York, New York, USA, 2018. ACM Press. ISBN 9781450356244. doi: 10.1145/3242671.3242673. URL http://dl.acm.org/citation.cfm?doid=3242671. 3242673.

\ Namco. Pac-Man. Game [Arcade], may 1980. URL https://en.wikipedia.org/wiki/Pac-Man.

\ D. Natapov, S. J. Castellucci, and I. S. MacKenzie. ISO 9241-9 evaluation of video game controllers. In Proceedings - Graphics Interface, pages 223–230, 2009. ISBN 9781568814704. doi: 10.5555/1555880.1555930.

\ A. Oulasvirta, P. O. Kristensson, X. Bi, and A. Howes. Computational interaction. ISBN 9780198799610.

\ A. Oulasvirta, T. Roos, A. Modig, and L. Leppanen. Information capacity of full-body movements. In ¨ Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI ’13, page 1289, New York, New York, USA, apr 2013. ACM Press. ISBN 9781450318990. doi: 10.1145/2470654.2466169. URL http://dl.acm.org/ citation.cfm?id=2470654.2466169.

\ J. Pfau, J. D. Smeddinck, I. Bikas, and R. Malaka. Bot or not? User Perceptions of Player Substitution with Deep Player Behavior Models. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pages 1–10, New York, NY, USA, apr 2020. Association for Computing Machinery (ACM). doi: 10.1145/3313831. 3376223. URL https://dl.acm.org/doi/10.1145/3313831.3376223.

\ M. Pirovano, R. Mainetti, G. Baud-Bovy, P. L. Lanzi, and N. A. Borghese. Intelligent Game Engine for Rehabilitation (IGER). IEEE Trans. Comput. Intell. AI Games, 8(1):43–55, mar 2016. ISSN 1943-068X. doi: 10.1109/TCIAIG. 2014.2368392. URL http://ieeexplore.ieee.org/document/6967825/.

\ C. Plaisant, A. Druin, C. Lathan, K. Dakhane, K. Edwards, J. M. Vice, and J. Montemayor. A Storytelling Robot for Pediatric Rehabilitation. oct 2000. URL https://drum.lib.umd.edu/handle/1903/1102.

\ A. K. Przybylski, C. S. Rigby, and R. M. Ryan. A Motivational Model of Video Game Engagement. Review of General Psychology, 14(2):154–166, 2010. ISSN 10892680. doi: 10.1037/a0019440.

\ F. Raczkowski. Making points the point: Towards a history of ideas of gamification. 2014.

\ J. Rekimoto and H. Tsujita. Inconvenient interactions: An alternative interaction design approach to enrich our daily activities. In Proceedings of the Workshop on Advanced Visual Interfaces AVI, pages 225–228, New York, New York, USA, 2014. Association for Computing Machinery. ISBN 9781450327756. doi: 10.1145/2598153.2598196. URL http://dl.acm.org/citation.cfm?doid=2598153.2598196.

\ J. M. Sietsema, D. L. Nelson, R. M. Mulder, D. Mervau-Scheidel, and B. E. White. The use of a game to promote arm reach in persons with traumatic brain injury. The American journal of occupational therapy. : official publication of the American Occupational Therapy Association, 47(1):19–24, jan 1993. ISSN 02729490. doi: 10.5014/ajot.47. 1.19. URL https://ajot.aota.org/article.aspx?articleid=1872935.

\ J. Sinclair, P. Hingston, and M. Masek. Exergame development using the dual flow model. Proceedings of the 6th Australasian Conference on Interactive Entertainment, IE 2009, 2009. doi: 10.1145/1746050.1746061.

\ B. A. Smith and S. K. Nayar. Mining controller inputs to understand gameplay. In UIST 2016 - Proceedings of the 29th Annual Symposium on User Interface Software and Technology, pages 157–168, New York, NY, USA, oct 2016. Association for Computing Machinery, Inc. ISBN 9781450345316. doi: 10.1145/2984511.2984543. URL https://dl.acm.org/doi/10.1145/2984511.2984543.

\ T. Susi, M. Johannesson, and P. Backlund. Serious Games : An Overview. 2007. URL http://www.diva-portal. org/smash/record.jsf?pid=diva2{%}3A2416{&}dswid=243.

\ R. Tang, X.-D. Yang, S. Bateman, J. Jorge, and A. Tang. Physio@Home. In Proc. 33rd Annu. ACM Conf. Hum. Factors Comput. Syst. - CHI ’15, pages 4123–4132, New York, New York, USA, 2015. ACM Press. ISBN 9781450331456. doi: 10.1145/2702123.2702401. URL http://dl.acm.org/citation.cfm?doid=2702123.2702401.

\ Valve Corporation. Half Life 2, 2004.

\ B. Walther-franks, D. Wenig, J. Smeddinck, and R. Malaka. Sportal : A First-Person Videogame Turned Exergame. In Proceedings Mensch und Computer, pages 539–542, 2013. URL https://dl.gi.de/handle/20.500.12116/ 7665.

\ B. Walther-Franks, D. Wenig, J. Smeddinck, and R. Malaka. Exercise my game: Turning off-the-shelf games into exergames. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 8215 LNCS:126–131, 2013. ISSN 16113349. doi: 10.1007/978-3-642-41106-9 15.

\ G. N. Yannakakis and J. Hallam. Real-time game adaptation for optimizing player satisfaction. IEEE Transactions on Computational Intelligence and AI in Games, 1(2):121–133, jun 2009. ISSN 1943068X. doi: 10.1109/TCIAIG. 2009.2024533. URL http://ieeexplore.ieee.org/document/5067382/.

\

:::info This paper is available on arxiv under CC BY 4.0 DEED license.

:::

\