Abstract:
In this research, a design of augmented reality system is proposed to assist in learning
on sound synthesis. Learners can use their finger tips to touch on a multi-touch surface
of a table. A simple touch is used for item selection and dragging over surface is used
for changing the parameters. The image processing is used for tracking the fingers from
the image which is captured by a camera attached under the table. The LCD projector,
which is installed under the table, is used to display an augmented image on the surface.
That image is generated by computer graphics engine. In this system, learners can
directly manipulate ADSR waveform envelope to produce synthesized sound. The
system provides computer graphics based instructions and additional information to
assist in learning. Learners can study and do the experiment on sound synthesis by
themselves. The understanding of learners about sound synthesis is increased from 4.84
percents to 66.3 percents after using this tool. The goal of the research is to develop an
augmented educational tool for learning. The results demonstrate that learners can
improve their understandings in sound synthesis intuitively and effectively.