Realtime HDR (High Dynamic Range) video for eyetap wearable computers, FPGA-based seeing aids, and glasseyes (EyeTaps)

• Main Authors: Mann, Steve, Lo, R. C. H., Ovtcharov, K., Shixiang Gu, Dai, David, Ngan, Calvin, Tao Ai
• Format: Conference Proceeding
• Language: English
• Subjects: Cameras; Dynamage Range; Dynamic range; EyeTap; Field programmable gate arrays; FPGAs; High Dynamic Range Video; Image coding; Realtime HDR; Streaming media; Table lookup; Wearable Computing; Welding
• ISSN: 0840-7789; 2576-7046
• DOI: 10.1109/CCECE.2012.6335012

Realtime video HDR (High Dynamic Range) is presented in the context of a seeing aid designed originally for task-specific use (e.g. electric arc welding). It can also be built into regular eyeglasses to help people see better in everyday life. Our prototype consists of an EyeTap (electric glasses) welding helmet, with a wearable computer upon which are implemented a set of image processing algorithms that implement realtime HDR (High Dynamic Range) image processing together with applications such as mediated reality, augmediatedTM, and augmented reality. The HDR video system runs in realtime and processes 120 frames per second, in groups of three frames or four frames (e.g. a set of four differently exposed images captured every thirtieth of a second). The processing method, for implementation on FPGAs (Field Programmable Gate Arrays), achieves a realtime performance for creating HDR video using our novel compositing methods, and runs on a miniature self-contained battery-operated head-worn circuit board, without the need for a host computer. The result is an essentially self-contained miniaturizable hardware HDR camera system that could be built into smaller eyeglass frames, for use in various wearable computing and mediated/ aug-mediated reality applications, as well as to help people see better in their everyday lives.