Updated: January 5, 2006

Investigators:

Matthew H. Bakke, Ph.D.
Claire Marcus Bernstein, Ph.D.
Annette Mazevski, AuD.
Julie Martinez Verhoff, AuD.
Harry Levitt, Ph.D.

Purpose of this study:

This project will develop computer-based methods of tracking for training that maintain the inherent interactive nature of the communication process while, at the same time, bringing the major sources of variability under control. The result will be a more efficient method of training that retains the many advantages of the tracking technique and can be used to address a wide range of problems in the area of hearing enhancement.

Project Description:

The tracking technique is widely used for both training and evaluation of communication skills of people with hearing loss. The technique involves interactive communication between the participant and the tester/trainer, a key characteristic of real-life communication that is absent from the vast majority of tests in audiology. A major problem with the tracking technique, however, is the high variability of the technique due, in large measure, to inter-speaker differences and how the participant responds to this source of variability. Historically, this problem was encountered in the early days of intelligibility testing when live-voice testing was used. The use of standardized recordings reduced the variability introduced by live-voice testing. Similarly, the use of pre-recorded test materials under computer control is expected to substantially reduce the variability of the tracking procedure.

Progress to-date:

Software has been written for implementing the semi-automatic tracking procedure developed in Sweden, referred to as the KTH speech tracking procedure. This computer-based tracking system prompts the speaker using a prescribed set of rules, thus reducing one source of variability. The tracking system has been evaluated through beta testing with clinical subjects, providing information on software usability from both the tester's and sender's perspective. Testing revealed the need for extensive software modifications that were not apparent during the earlier stage of software development. These recommended changes have been incorporated into a revised version of the speech tracking software and we expect to finalize the software within the next few months.

We recently completed a pilot investigation looking at the efficacy of the KTH speech tracking procedure as a training method. Adult cochlear implant users served as subjects for this study, and training was conducted using the auditory modality alone for one subject and auditory-visual modalities combined for the other subject. A review of their tracking functions indicated significant improvement in speech tracking capability over a training period of four weeks, which continued to improve with additional weekly sessions over the following month. This improvement was corroborated with improved performance on CUNY topic related sentence material. While preliminary results with speech tracking are promising, it should be considered one part of a total rehabilitation program. The pilot results along with other factors are being reviewed to determine the appropriate direction for training and for development of material (e.g. audio recordings, video recordings, and associated software).

A multiple clinical site study looking at the effectiveness of speech tracking as a rehabilitation training measure is just beginning. Audio recordings of material are also being developed for a separate study looking at self-directed training with speech tracking as a supplement to rehabilitation in a clinical setting. Insights from these studies will be reviewed to determine implications for clinical practice and directions for further research.

Recent publications or presentations:

Levitt, H., Bakke, M., & Bernstein, C. (2006). Computer Assisted Tracking Presented at the State of the Science Conference on Hearing Enhancement. Gallaudet University, Washington, DC, September 19.

Bernstein, C., Plant, G., Dempsey, J., Levitt, H., and Bakke. M. (2006). Rehabilitation with Adult Cochlear Implant Recipients: The Role of Speech Tracking. Presented at the District of Columbia Speech-Language-Hearing Association, Washington, D.C. February 24.

Bakke, M., Bernstein, C., Plant, G., Dempsey, J., and Levitt, H. (2005). Computer Assisted Methods of Speech Tracking. Presented at the Third International Adult Aural Rehabilitation Conference, Portland, Maine. May 9-12.

Levitt, H., Youdelman, K., & Dempsey, J.J. (1993). Computer Interactive Techniques in Training and Evaluation of Communication Skills. In: Interactive Learning Technology for the Deaf, B.A.G. Elsendoom and F. Coninx (Eds.). NATO ASI Series, Series F: Computer and Systems Sciences, Vol. 113, 95-104. Springer-Verlag.

Dempsey, J.J., Levitt, H., Josephson, J., & Porrazzo, J. (1992). Computer-Assisted Tracking Simulation (CATS). Journal of the Acoustical Society of America, 92 (2), 701-710.

For more information, contact: Matt Bakke or Claire Bernstein