Mapping Sonification for Perception and Action in Motor Skill Learning

Research output: Contribution to journalArticle

3 Citations (Scopus)
153 Downloads (Pure)

Abstract

Real-time sonification of human movement (conversion of motion signals into sound) can be used as augmented feedback for motor skill learning. With sonification, motor skills can, in some instances, be learned more quickly and successfully (Sigrist et al., 2013a). The goal of such sonification systems is a permanent (or at least, lasting) improvement in performance at a physical task or skill, which persists in the absence of augmented feedback. Many experimental investigations of feedback, however, show that when performance is tested without feedback, a decline occurs (Park et al., 2000; Maslovat et al., 2009). This finding has become known as the “guidance effect” (Buchanan and Wang, 2012). It has been suggested that this effect is a consequence of learner overreliance on the “guidance” provided by augmented feedback, at the expense of task-intrinsic sensory feedback. For effective learning, this is clearly not desirable.

In this paper, we advocate a perception-action approach to sonification when used as feedback for skill learning, which may lead researchers and trainers to design more effective prototypes. We highlight three main issues: 1. The learner's task should be conceived as perception-action based and sonification designed accordingly, 2. Sonification should provide Ecological information for perception rather than propositional knowledge-of-performance, and 3. Ecologically meaningful sound morphologies should be harnessed effectively.
Original languageEnglish
Article number463
Pages (from-to)1-4
JournalFrontiers in Neuroscience
Volume11
DOIs
Publication statusPublished - 21 Aug 2017

Fingerprint

Motor Skills
Learning
Sensory Feedback
Research Personnel

Keywords

  • Sonification
  • motor skill learning
  • Augmented Feedback
  • Concurrent Feedback
  • guidance effect
  • Perception and action

Cite this

@article{67d5fc22d1204f43ae5e7f18e2a66435,
title = "Mapping Sonification for Perception and Action in Motor Skill Learning",
abstract = "Real-time sonification of human movement (conversion of motion signals into sound) can be used as augmented feedback for motor skill learning. With sonification, motor skills can, in some instances, be learned more quickly and successfully (Sigrist et al., 2013a). The goal of such sonification systems is a permanent (or at least, lasting) improvement in performance at a physical task or skill, which persists in the absence of augmented feedback. Many experimental investigations of feedback, however, show that when performance is tested without feedback, a decline occurs (Park et al., 2000; Maslovat et al., 2009). This finding has become known as the “guidance effect” (Buchanan and Wang, 2012). It has been suggested that this effect is a consequence of learner overreliance on the “guidance” provided by augmented feedback, at the expense of task-intrinsic sensory feedback. For effective learning, this is clearly not desirable.In this paper, we advocate a perception-action approach to sonification when used as feedback for skill learning, which may lead researchers and trainers to design more effective prototypes. We highlight three main issues: 1. The learner's task should be conceived as perception-action based and sonification designed accordingly, 2. Sonification should provide Ecological information for perception rather than propositional knowledge-of-performance, and 3. Ecologically meaningful sound morphologies should be harnessed effectively.",
keywords = "Sonification, motor skill learning, Augmented Feedback, Concurrent Feedback, guidance effect, Perception and action",
author = "John Dyer and Paul Stapleton and Matthew Rodger",
year = "2017",
month = "8",
day = "21",
doi = "10.3389/fnins.2017.00463",
language = "English",
volume = "11",
pages = "1--4",
journal = "Frontiers in Neuroscience",
issn = "1662-4548",
publisher = "Frontiers Media S.A.",

}

Mapping Sonification for Perception and Action in Motor Skill Learning. / Dyer, John; Stapleton, Paul; Rodger, Matthew.

In: Frontiers in Neuroscience, Vol. 11, 463, 21.08.2017, p. 1-4.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Mapping Sonification for Perception and Action in Motor Skill Learning

AU - Dyer, John

AU - Stapleton, Paul

AU - Rodger, Matthew

PY - 2017/8/21

Y1 - 2017/8/21

N2 - Real-time sonification of human movement (conversion of motion signals into sound) can be used as augmented feedback for motor skill learning. With sonification, motor skills can, in some instances, be learned more quickly and successfully (Sigrist et al., 2013a). The goal of such sonification systems is a permanent (or at least, lasting) improvement in performance at a physical task or skill, which persists in the absence of augmented feedback. Many experimental investigations of feedback, however, show that when performance is tested without feedback, a decline occurs (Park et al., 2000; Maslovat et al., 2009). This finding has become known as the “guidance effect” (Buchanan and Wang, 2012). It has been suggested that this effect is a consequence of learner overreliance on the “guidance” provided by augmented feedback, at the expense of task-intrinsic sensory feedback. For effective learning, this is clearly not desirable.In this paper, we advocate a perception-action approach to sonification when used as feedback for skill learning, which may lead researchers and trainers to design more effective prototypes. We highlight three main issues: 1. The learner's task should be conceived as perception-action based and sonification designed accordingly, 2. Sonification should provide Ecological information for perception rather than propositional knowledge-of-performance, and 3. Ecologically meaningful sound morphologies should be harnessed effectively.

AB - Real-time sonification of human movement (conversion of motion signals into sound) can be used as augmented feedback for motor skill learning. With sonification, motor skills can, in some instances, be learned more quickly and successfully (Sigrist et al., 2013a). The goal of such sonification systems is a permanent (or at least, lasting) improvement in performance at a physical task or skill, which persists in the absence of augmented feedback. Many experimental investigations of feedback, however, show that when performance is tested without feedback, a decline occurs (Park et al., 2000; Maslovat et al., 2009). This finding has become known as the “guidance effect” (Buchanan and Wang, 2012). It has been suggested that this effect is a consequence of learner overreliance on the “guidance” provided by augmented feedback, at the expense of task-intrinsic sensory feedback. For effective learning, this is clearly not desirable.In this paper, we advocate a perception-action approach to sonification when used as feedback for skill learning, which may lead researchers and trainers to design more effective prototypes. We highlight three main issues: 1. The learner's task should be conceived as perception-action based and sonification designed accordingly, 2. Sonification should provide Ecological information for perception rather than propositional knowledge-of-performance, and 3. Ecologically meaningful sound morphologies should be harnessed effectively.

KW - Sonification

KW - motor skill learning

KW - Augmented Feedback

KW - Concurrent Feedback

KW - guidance effect

KW - Perception and action

U2 - 10.3389/fnins.2017.00463

DO - 10.3389/fnins.2017.00463

M3 - Article

VL - 11

SP - 1

EP - 4

JO - Frontiers in Neuroscience

JF - Frontiers in Neuroscience

SN - 1662-4548

M1 - 463

ER -