Publications / 2012 Proceedings of the 29th ISARC, Eindhoven, Netherlands
Purpose Aging has become a significant problem in the recent years, due to the aging baby boomers. Most of the supervision systems use vision to perform care functions. However people usually cannot watch video all the time, therefore the proposed sonification for aging Taiwanese is used to express a particular situation at the children or nursing home, including both acoustic instrumental sound for the eventtriggered actions, and algorithmic composition to represent various environment situations. The nursing system can easily retrieve their seniors situation anytime according to the transmitted audio signal and music via a network. Method The proposed Chinese music sonification system (CMSS) for older people can be implemented into two sections. Section 1: Eventtriggered sound is designed using Chinese instrumental audio samples performed by pipa, erhu, etc. Event-triggered sound is based on the input of various actions of aging people, such as watering, exercising, toileting, dining, sleeping, etc. Section 2: Computer-composed music, is designed using automated stochastic process of MIDI-data with various moods and situations mapped into music features, including musical scale, harmony, tonality, and rhythm. There are five Chinese music modes used for the musical scale. Among them Gong, Jiao, and Jiao are closer to the major mode in western music, while Shang and Yu are similar to the minor mode, therefore positive emotions will be mapped into a major-mode music, and the negative emotions will be correlated to a minor-mode music. Results & Discussion CMSS is based on the hybrid event-triggered sound and computer composed music. Event-triggered sound is the pre-recorded discrete audio samples, while computer composed music is the calculated continuous MIDIrendered audio in real-time. A questionnaire is designed for the seniors to listen to the result of the CMSS, and most of them are satisfied with this innovated design. Action data is used for computer composed music calculation via CCD, RF ID, or any other wireless technology, and environment data is determined by sensors such as bio-feedback, temperature, etc., providing data for event-triggered sound. CMSS are implemented with computer music software Max/MSP, to perform CMSS for the seniors living in Taiwan.