A REVIEW OF VISION-BASED PERCEPTIVE INTERFACES: MOUSE ALTERNATIVE APPROACHES
Abstract
Graphical User Interfaces based on WIMP (Window, Icon, Menu, Pointer) paradigm has been a popular choice of interfaces for many systems and has made Human-Computer interaction simpler and easier. In the past few decades great research efforts have been made to make user friendly Human-Computer Interfaces. The Perceptual User Interfaces aims to focus this new form of HCI (Human Computer Interaction). In this study we describe different Vision Based Perceptive Interfaces that make use of different computer vision techniques for tracking and gesture recognition that may serve as an alternative for outdated mouse. The major focus of the work presented here is on the critical evaluation of different vision-Based interfaces that will give the perceptual ability of vision to computers and will make human-Computer interaction more human friendly interaction. The comparative study and critical evaluation using Human Computer Interaction approaches highlights the strength and weakness of the existing vision-Based interfaces. The emphasis of our research is focused on summarizing the literature by highlighting its limitations and strengths.References
A.V. Dam POST-WIMP User Interfaces.
Communications of the ACM 40, No. 2
(1997) 63.
D. Gorodnichy, Perceptual cursor - a solution
to the broken loop problem in vision-based
hands-free computer control devices. In
NRC-CNRC Technical Report. NRC/ERB1133. February 2006. 23 pages. NRC48472,
(2006)
M. Turk, Perceptual User Interfaces. In the
Proceedings of the 1998 Workshop on
Perceptual User Interfaces (1998).
M. Turk and G. Robertson. Perceptual User
Interfaces. Communications of the ACM,
, No. 3 (2000) 33.
A. Dix, J.E. Finlay, G.D. Abowd and
R. Beale. Human-Computer Interaction,
Prentice Hall (2003) pp. 365-384.
D. Gorodnichy, On Importance of Nose for
Face Tracking, Proceedings of the
International Conference on Automatic Face
and Gesture Recognition (FG2002).
Washington, DC, USA, (2002).
D. Gorodnichy, W. Armstrong and X. Li.
Adaptive Logic Networks for Facial Feature
Detection, The Proceedings of International
Conference on Image Analysis and
Processing (1997) pp. 332-339.
M. Betke, J. Gips and P. Fleming, IEEE
Transactions on Neural Systems and
Rehabilitation Engineering 10, No. 1(2002) 1.
P. DiMattia, F. X. Curran and J. Gips. An Eye
Control Teaching Device for Students
Without Language Expressive Capacity
EagleEyes. Lampeter, U.K. Edwin Mellen
(2001).
CameraMouse, “cameramouse†Internet:
http://cameramouse.org/index.html, (Sept. 9,
.
LogiTech. “HD Pro Webcam C910†Internet:
http://www.logitech.com/en-us/support/ web
cams/hd-pro-webcam-c910 (September 9,
.
Microsoft Hardware, “LifeCam Studioâ€
Internet:http://www.microsoft.com/hardware/e
n-us/p/lifecam-studio#overview, (September
, 2012).
S. Sumathi, S.K. Srivastsa and M.U.
Maheswari, Int. J. of Computer Science and
Information Security 7, No. 1 (2010) 147.
P. Viola and M. Jones, Rapid Object
Detection Using a Boosted Cascade of
Simple Features, Proceedings of the IEEE
Conference on Computer Vision and Pattern
Recognition 2001 CVRP, 1 (2001) pp. 511-
J. Varona, C. Manresa-Yee and F.J. Perales,
Journal of Network and Computer
Applications 31 (2008) 357.
V. Chauhan and T. Morris, Face and Feature
Tracking for Cursor Control, Proceedings of
th Scandinavian Conference on Image
Analysis Bergen (2001).
L. Afifi, M. Karaki and J. Korban, Handsfree'- Interface A Fast and Accurate Tracking
Procedure for Real Time Human Computer
Interaction, Proceedings of Fourth IEEE
International Symposium on Signal
Processing and Information Technology
(2004) pp. 517-520.
H.T. Nguyen, M. Worring and R.V.D.
Boomgaard, Occlusion Robust Adaptive
Ttemplate Tracking, Proceedings of IEEE
Conference on Computer Vision (2001)
pp. 7-14.
W.W. Gaver, G. Smets and K. Overbeeke, A
Virtual Window on Media Space.
Proceedings of CHI‟95 (1995) pp. 257-264.
K. Toyama, Look, Ma–No Hands, HandsFree
Cursor Control with Real-Time 3D Face
Tracking, Proceedings of the 1998
Workshop on Perceptual User Interfaces,
(1998).
K. Toyama and G. Hager, International
Journal of Computer Vision 35, No. 1 (1999)
-63.
F. Berard, The Perceptual Widow: Head
Motion as a new Input Stream, Proceedings
of the Seventh IFIP Conference on HumanComputer Interaction (1999) pp. 238-244.
P.A. Anandan, International Journal of
Computer Vision 2, No. 3 (1989) 283.
A. Ismail, A.S. Hajjar and M. Hajjar, The
International Journal of Multimedia and its
Applications 3, No. 3 (2011) 15.
T. Pallejà , E. Rubión, M. Teixidó,
M. Tresanchez, A.F del Viso and J. PalacÃn,
Simple and Robust Implementation of a
Relative Virtual Mouse Controlled by Head
Movements, Proceedings of Human System
Interactions, Conference on Digital Object
Identifier (2008) pp. 221-224.
C. Sun, Image and Vision Computing 20, No.
–14 (2002) 981.
Y. Fu and T.S. Huang, hMouse: Head
Tracking Driven Virtual Computer Mouse,
Proceedings of IEEE Workshop on
Applications of Computer Vision (2007)
pp. 30-36.
L. Wensheng, D. Chunjian and L. Yi,
Implementation of Virtual Mouse Based on
Machine Vision, Proceedings of International
Conference on Apperceiving Computing and
Intelligence Analysis (2010) pp. 367-371.
R. Gonzalez and R.E. Woods, Digital Image
Processing 2nd Ed. Prentice Hall (2002)
pp. 519-556.
X. Wang and K. Qin, A Six-degree-offreedom Virtual Mouse based on Hand
Gestures, Proceedings of International
Conference on Electrical and Control
Engineering (2010) pp. 257-260.
W. Wah, M. Tsang and K. Pun, A FingerTracking Virtual Mouse Realized in an
Embedded System, Proceedings of
International Symposium on Intelligent Signal Processing and Communication Systems
(2005) pp. 781-784.
J. Han, Low-Cost Multi-Touch Sensing
Through Frustrated Total Internal Reflection.
In the Proceedings of 18th Annual ACM
Symposium on User Interface Software and
Technology (2005) pp. 115-118.
Orion Instruments. “HeadMouse†Internet:
http://orin.com/access/headmouse (August 9,
.
N. Matsushita and J. Rekimoto, HoloWall:
Designing a Finger, Hand, Body and Object
Sensitive Wall, Proceedings of the 10th
Annual ACM symposium on User interface
software and technology (1997) pp. 209-210.
H. Benko, A. Wilson and R. Balakrishnan,
Sphere: Multi-Touch Interactions on a
Spherical Dis-play. In the Proceedings of
st Annual ACM Symposium on User
Interface Software and Technology (2008)
pp. 77-86.
B. Ventures. Ion Wireless Air Mouse Glove,
http://www.ionwirelessair mouse. com
(August 9, 2012)
A. Butler, S. Izadi and S. Hodges, SideSight:
Multi-„Touch‟ Interactions Around Small
Devices. In the Proceedings of 21st annual
ACM Symposium on User Interface Software
and Technology (2008) pp. 201–204.
BT. Newton Peripherals, LLC. MoGo Mouse,
http://tinyurl.com/yw4lbv. (12.May, 2009).
Celluon, evoMouse, http://celluon.com/
shop_evo_mouse.php (August 10, 2012).
Brando, Finger Mouse, http://usb.brando.com
/usb-finger mouse_p00187c037d015.html
(August. 10, 2012).
Apple, Mighty Mouse, http://www.apple.com/
mightymouse (August 10, 2012).
Logitech, Air Mouse, http://tinyurl.com/3qtor8.
(August 10, 2012).
R. Balakrishnan and P. Patel, The
PadMouse: Facilitating Selection and Spatial
Positioning for the Non-Dominant Hand,
Proceedings of ACM conference on Human
Factors in computing systems (1998)
pp. 9-16.
Air Mouse, AirMouse Internet, http://www.
theairmouse.com/tech.php, (August 10,
.
T. Pallejà , E. Rubión, M. Teixidó,
M. Tresanchez, A. Fernández del Viso, J.
PalacÃn, C. Rebate and J. PalacÃn. Head
Mouse 4.2, http://robotica.udl.cat/(Sept 5,
.
