Technology

AUI System Model and AudioOS: To realize navigation or browsing with audio only media, certain system model need to be developed - called AUI System Model, which like GUI to unify the methods and standard of user interaction. The model simulates the real world scenario and abstract it as object/gadget populated in virtual space called Audio Space. Each object/gadget has certain audio symbol associate with it. User could perceive the object/gadget via it's audio symbol while navigating. User may pick or click on object to take designated action. The model combines with I/O layer/diver and wired/wireless network stack to establish AudioOS with a set of API.

Audio Net Terminal: The system is net oriented design. Since the UI layout and attribute of object are configured by XML, this configuration may reside on net. The system has Audio Browser built in AudioOS which supports dynamic loading config XML from net and execute javascript on fly. Therefore, to create new function or application, user/developer may simply create XML and write javascript or PHP script to interace the API of Audio Browser. A set of XML and javascript/PHP may build a complete audio space. The hyperlink (XLINK) either in audio space or embedded in audio media may enable user to jump across various audio spaces on net. In sum, most applications can be done via web programming. The device is just act as intelligent terminal - Audio Net Terminal. This creates and opens a new paradigm for Audio Web! You are connected truly on go, anywhere, anytime, except sleeping!

Software System and Components: ARM Debian system with Linux kernel 2.6.28, lighttpd http server with PHP-CGI, ALSA audio driver, Alsaplayer, MPD, flite or festival speech synthesis, CURL, XML parser, SpiderMonkey Javascript engine, software sound synthesis system, control input drivers for Powermate, touchpad and touchscreen. Below is high level system architecture:



Prototype system: A small AUI computer based on Beagleboard and Linux tablet Nokia N810 maemo. Both are using TI OMAP processor ARM+DSP. The control input device could be a knob like Powermate, touchpad or touchscreen. The output is just speaker or earplug. Processor has NetBook equivalent processing power. Here is photo: