色花堂

For patients recovering from stroke, the leading cause of adult disability in the developed world, the rehabilitation process is monotonous and solitary.

Researchers at Waipapa Taumata Rau, University of 色花堂 are working to change that with an augmented reality game that strengthens the body, stimulates the brain and encourages social connection.

Associate Professor , a human-computer interaction expert with the School of Computer Science, along with colleagues including neurorehabilitation experts Professor , Professor and Research Fellow , wanted to develop a rehab tool that would motivate patients to keep going.

With collaborators including Amber Taylor (Ng膩ti Wh膩tua, Ng膩puhi, Te Rarawa, Tainui, Ng膩ti Mutunga, Te 膧tiawa), CEO of , an award-winning M膩ori-owned game development company, honours student Maya Gibson (Ng膩ti Apa) and hospital physiotherapist Jon Bagnall, the researchers are prototyping an augmented reality game for stroke rehab patients.

鈥淭here鈥檚 a massive problem in that people cut their rehab too early and never finish their programme,鈥� says Taylor. 鈥淲e鈥檙e really hoping the gameplay we鈥檝e come up with encourages daily use and keeps up engagement levels so patients keep improving their movement and coordination.鈥�

鈥淭he goal is for it to be self-explanatory,鈥� says Lottridge. 鈥淲ith human-computer interaction, though, the simpler the interface, the harder it is to design.鈥�

As part of the process, Lottridge and her colleagues interviewed M膩ori, Pacific, South Asian and P膩keh膩 stroke patients in their homes. They asked about their experiences of healing from stroke, how they use technology and what they find motivating. From these sessions came the message that stroke survivors need the therapy and tech to fit into their everyday lives.

鈥淔or me as a researcher in computer science, I sometimes feel pushed to use the latest gadgets and technologies,鈥� says Lottridge. 鈥淐o-design pushes me to look at what technology works best for people.鈥�

Another clear message from participants was that they experienced health and healing as multidimensional, comprising physical and mental health as well as social connection and, for some, a spiritual dimension. This fit with the te ao M膩ori concept of te whare tapa wh膩 鈥� that there are four cornerstones to health: physical, spiritual, family and mental.

While the game is informed by te whare tapa wh膩, it鈥檚 designed to help anybody recovering from a stroke.

鈥淭he idea is to create a multiplayer environment so people can rehab with wh膩nau,鈥� says Taylor. 鈥淲h膩nau is important to everyone, so it really contributes to rehab if you can interact with your mokopuna even if they鈥檙e not in the same house as you. That connection has significant health and wellbeing benefits.鈥�

鈥淥nce the patient has done the puzzle, they can add virtual stickers or overlays and send the image back to the friend who sent it to them, so it comes full circle and encourages the friend to send the next picture.鈥�

The app does remind users to practice so they can stay on track with their physiotherapy goals, but the researchers hope the game itself is motivating enough to keep patients coming back.

鈥淏eing creative, being social and having moments of respite and enjoyment all rolled into physical therapy will really help people heal,鈥� says Lottridge.

The team is now seeking funding to do a feasibility study in a hospital ward, with patients receiving initial instruction on the game in hospital and given a kit to take home. With participant permission, their gameplay would be tracked and their upper limb function assessed at regular intervals. Through questionnaires and interviews, participants could provide feedback about the game as well as their mood and social support levels.

After that would come randomised control trials, the gold standard for establishing effectiveness.

Eventually, Lottridge says, she鈥檇 like the tool to be available to patients anywhere, as a low-cost intervention, with kits shipped around the world.

鈥淭his is very different from other interventions that are out there, so it can make a real difference.鈥�