ShapeTones

An accessible audiovisual memory game that can be played by anyone, including players with hearing or visual impairments

Abstract

ShapeTones is an audio-visual memory game for iOS (iPhone/iPad). A sequence of 3 shapes and tones (we call them ShapeTones) is played, and the player tries to reproduce it with three taps. Tapping different areas of the screen triggers different ShapeTones. The game starts with 3 ShapeTones. As the game evolves, more ShapeTones become available. When a new ShapeTone is added, a trial screen is shown to demonstrate where each ShapeTone is triggered. Some surprises happen along the way... As a one player game, the sequence is created automatically. As a two player game, one player creates the sequence, passes the device to the other player, who tries to repeat it. They then swap the roles. The game can be downloaded from here. ShapeTones is jointly developed in collaboration with Nuno Correia from Goldsmiths, University of London and Nick Bryan-Kinns, Tony Stockman and Fiore Martin from Queen Mary University of London.

Publications

(2016) Metatla O., Correia N. N., Martin F., Bryan-Kinns N., Stockman T., Tap the ShapeTones: Exploring the effects of crossmodal congruence in an audio-visual interface. To appear in the Proceedings of ACM SIGCHI 2016, San Jose, CA, USA.

Videos