The intelligent screen reader system observes a user¡¯s keystrokes when he or she is performing tasks, and infers an underlying plan structure. The system then generates an optimized script that allows the user to perform the same task more efficiently in the future. The intelligent screen reader system is particularly beneficial for visually impaired computer users.
The JAWS for Windows screen reader was chosen for this prototype, since the JAWS scripting language provides flexibility to users for customizing their tasks within a specific application. The JAWS macro recorder, developed by Freedom Scientific Inc., records all the user¡¯s actions. Automated Synthesis of Plan Recognition Networks (ASPRN), developed by Intelligent Reasoning Systems Inc., takes a plan or a script representation as input and outputs a specially-constructed belief network that supports plan recognition. The Script Generation Interface, developed by the University of Pittsburgh, allows users to modify the actions recorded by the JAWS macro recorder and generate an optimized script. Development of the SGI involved integrating the SGI with the JAWS macro recorder, integrating the SGI with ASPRN, and implementing the SGI user interface.
Preliminary usability testing involving the intelligent screen reader system was conducted with visually impaired users. Within limited actions and tasks, the results are satisfactory. Users felt the SGI was easy to learn and operate, and that it was efficient to create useful scripts with the intelligent screen reader system. Future work includes adding more plans to the plan library and creating a tutorial system.
| Identifer | oai:union.ndltd.org:PITT/oai:PITTETD:etd-12132003-221824 |
| Date | 19 December 2003 |
| Creators | Ma, Lin |
| Contributors | Mary Ellen Buning, Richard Simpson, Diane Litman, Michael McCue |
| Publisher | University of Pittsburgh |
| Source Sets | University of Pittsburgh |
| Language | English |
| Detected Language | English |
| Type | text |
| Format | application/pdf |
| Source | http://etd.library.pitt.edu/ETD/available/etd-12132003-221824/ |
| Rights | unrestricted, I hereby certify that, if appropriate, I have obtained and attached hereto a written permission statement from the owner(s) of each third party copyrighted matter to be included in my thesis, dissertation, or project report, allowing distribution as specified below. I certify that the version I submitted is the same as that approved by my advisory committee. I hereby grant to University of Pittsburgh or its agents the non-exclusive license to archive and make accessible, under the conditions specified below, my thesis, dissertation, or project report in whole or in part in all forms of media, now or hereafter known. I retain all other ownership rights to the copyright of the thesis, dissertation or project report. I also retain the right to use in future works (such as articles or books) all or part of this thesis, dissertation, or project report. |
Page generated in 0.0065 seconds