Using auditory augmented reality to understand visual scenes

dc.contributor.authorStone, Scott
dc.contributor.authorUniversity of Lethbridge. Faculty of Arts and Science
dc.contributor.supervisorTata, Matthew S.
dc.contributor.supervisorGonzalez, Claudia L. R.
dc.date.accessioned2017-12-21T16:35:28Z
dc.date.available2017-12-21T16:35:28Z
dc.date.issued2017
dc.degree.levelMastersen_US
dc.description.abstractLocating objects in space is typically thought of as a visual task. However, not everyone has access to visual information, such as the blind. The purpose of this thesis was to investigate whether it was possible to convert visual events into spatial auditory cues. A neuromorphic retina was used to collect visual events and custom software was written to augment auditory localization cues into the scene. The neuromorphic retina is engineered to encode data similar to how the dorsal visual pathway does. The dorsal visual pathway is associated with fast nonredundant information encoding and is thought to drive attentional shifting, especially in the presence of visual transients. The intent was to create a device capable of using these visual onsets and transients to generate spatial auditory cues. To achieve this, the device uses the core principles driving auditory localization, with a focus on the interaural time and level difference cues. These cues are thought to be responsible for encoding azimuthal location in space. Results demonstrate the usefulness of such a device, but personalization will probably improve the effectiveness of the cues generated. In summary, I have created a device that converts purely visual events into useful auditory cues for localization, thereby granting perception of stimuli that may have been inaccessible to the user.en_US
dc.embargoNoen_US
dc.identifier.urihttps://hdl.handle.net/10133/4994
dc.language.isoen_USen_US
dc.proquest.subject0384en_US
dc.proquest.subject0633en_US
dc.proquest.subject0984en_US
dc.proquestyesYesen_US
dc.publisherLethbridge, Alta. : Universtiy of Lethbridge, Department of Neuroscienceen_US
dc.publisher.departmentDepartment of Neuroscienceen_US
dc.publisher.facultyArts and Scienceen_US
dc.relation.ispartofseriesThesis (University of Lethbridge. Faculty of Arts and Science)en_US
dc.subjectauditory augmented realityen_US
dc.subjectauditory localizationen_US
dc.subjectdorsal visual streamen_US
dc.subjectneuromorphic retinaen_US
dc.subjectspatial auditory cuesen_US
dc.subjectvisual impairmenten_US
dc.titleUsing auditory augmented reality to understand visual scenesen_US
dc.typeThesisen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
STONE_SCOTT_MSC_2017.pdf
Size:
1.76 MB
Format:
Adobe Portable Document Format
Description:
Thesis
License bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
3.25 KB
Format:
Item-specific license agreed upon to submission
Description: