Learnings from an Iterative Design Process for Technology-Mediated Audience Participation (TMAP) using Smartphones

Journal Title: EAI Endorsed Transactions on Creative Technologies - Year 2018, Vol 5, Issue 14

Abstract

We discuss a setup for technology-mediated audience participation (TMAP)in live music using smartphones and high-frequency sound IDs in a playful setting. The audience needs to install a smartphone app. Using high-frequency sound IDs music samples and colors can be triggered on the audience’s smartphones without the need to have an internet connection. The resulting soundscape is determined by the samples and parameters selected by the artist as well as by the location audience members choose in the performance space. We present the technical basis and iterative explorative design process of such a system for TMAP. The learnings from the perspective of musicians were technical requirements such as low latency, reliability, as well as increasing the number of possible sound samples and sound quality and we further present learnings on creating systems for TMAP from technical and creative perspectives.

Authors and Affiliations

Fares Kayali, Oliver Hodl, Christoph Bartmann, Ulrich Kuhn, Thomas Wagensommerer, Ruth Mateus-Berr

Keywords

Related Articles

Multi-GPU based framework for real-time motion analysis and tracking in multi-user scenarios

Video processing algorithms present a necessary tool for various domains related to computer vision such as motion tracking, event detection and localization in multi-user scenarios (crowd videos, mobile camera, scenes w...

Advancing Performability in Playable Media: A Simulation-based Interface as a Dynamic Score

When designing playable media with non-game orientation, alternative play scenarios to gameplay scenarios must be accompanied by alternative mechanics to game mechanics. Problems of designing playable media with non-game...

Exploring Deep Recurrent Q-Learning for Navigation in a 3D Environment

Learning to navigate in 3D environments from raw sensory input is an important step towards bridging the gap between human players and artificial intelligence in digital games. Recent advances in deep reinforcement learn...

Moving Collaborations: A Critical Inquiry Into Designing Creative Interactive Systems for Choreography

The use of technology in choreographic process has been encumbered by the richness of data in live human movement and the constraints of computation. While technology is often considered a tool in choreographic process,...

Establishing Interaction between Machine and Medaka using Deep Q-Network

Social interaction is the basic ability for animals to survive. It is difficult for a machine to interact with human or other animals because it is not clear how the machine should interact. This paper examines whether a...

Download PDF file
  • EP ID EP45888
  • DOI http://dx.doi.org/10.4108/eai.16-1-2018.153643
  • Views 296
  • Downloads 0

How To Cite

Fares Kayali, Oliver Hodl, Christoph Bartmann, Ulrich Kuhn, Thomas Wagensommerer, Ruth Mateus-Berr (2018). Learnings from an Iterative Design Process for Technology-Mediated Audience Participation (TMAP) using Smartphones. EAI Endorsed Transactions on Creative Technologies, 5(14), -. https://www.europub.co.uk/articles/-A-45888