U. Tariq, M. D. A. Asif, M. H. Yousaf, F. Hussain


Graphical User Interfaces based on WIMP (Window, Icon, Menu, Pointer) paradigm has been a popular choice of interfaces for many systems and has made Human-Computer interaction simpler and easier. In the past few decades great research efforts have been made to make user friendly Human-Computer Interfaces. The Perceptual User Interfaces aims to focus this new form of HCI (Human Computer Interaction). In this study we describe different Vision Based Perceptive Interfaces that make use of different computer vision techniques for tracking and gesture recognition that may serve as an alternative for outdated mouse. The major focus of the work presented here is on the critical evaluation of different vision-Based interfaces that will give the perceptual ability of vision to computers and will make human-Computer interaction more human friendly interaction. The comparative study and critical evaluation using Human Computer Interaction approaches highlights the strength and weakness of the existing vision-Based interfaces. The emphasis of our research is focused on summarizing the literature by highlighting its limitations and strengths.

Full Text:



A.V. Dam POST-WIMP User Interfaces.

Communications of the ACM 40, No. 2

(1997) 63.

D. Gorodnichy, Perceptual cursor - a solution

to the broken loop problem in vision-based

hands-free computer control devices. In

NRC-CNRC Technical Report. NRC/ERB1133. February 2006. 23 pages. NRC48472,


M. Turk, Perceptual User Interfaces. In the

Proceedings of the 1998 Workshop on

Perceptual User Interfaces (1998).

M. Turk and G. Robertson. Perceptual User

Interfaces. Communications of the ACM,

, No. 3 (2000) 33.

A. Dix, J.E. Finlay, G.D. Abowd and

R. Beale. Human-Computer Interaction,

Prentice Hall (2003) pp. 365-384.

D. Gorodnichy, On Importance of Nose for

Face Tracking, Proceedings of the

International Conference on Automatic Face

and Gesture Recognition (FG2002).

Washington, DC, USA, (2002).

D. Gorodnichy, W. Armstrong and X. Li.

Adaptive Logic Networks for Facial Feature

Detection, The Proceedings of International

Conference on Image Analysis and

Processing (1997) pp. 332-339.

M. Betke, J. Gips and P. Fleming, IEEE

Transactions on Neural Systems and

Rehabilitation Engineering 10, No. 1(2002) 1.

P. DiMattia, F. X. Curran and J. Gips. An Eye

Control Teaching Device for Students

Without Language Expressive Capacity

EagleEyes. Lampeter, U.K. Edwin Mellen


CameraMouse, “cameramouse” Internet:

http://cameramouse.org/index.html, (Sept. 9,


LogiTech. “HD Pro Webcam C910” Internet:

http://www.logitech.com/en-us/support/ web

cams/hd-pro-webcam-c910 (September 9,


Microsoft Hardware, “LifeCam Studio”


n-us/p/lifecam-studio#overview, (September

, 2012).

S. Sumathi, S.K. Srivastsa and M.U.

Maheswari, Int. J. of Computer Science and

Information Security 7, No. 1 (2010) 147.

P. Viola and M. Jones, Rapid Object

Detection Using a Boosted Cascade of

Simple Features, Proceedings of the IEEE

Conference on Computer Vision and Pattern

Recognition 2001 CVRP, 1 (2001) pp. 511-

J. Varona, C. Manresa-Yee and F.J. Perales,

Journal of Network and Computer

Applications 31 (2008) 357.

V. Chauhan and T. Morris, Face and Feature

Tracking for Cursor Control, Proceedings of

th Scandinavian Conference on Image

Analysis Bergen (2001).

L. Afifi, M. Karaki and J. Korban, Handsfree'- Interface A Fast and Accurate Tracking

Procedure for Real Time Human Computer

Interaction, Proceedings of Fourth IEEE

International Symposium on Signal

Processing and Information Technology

(2004) pp. 517-520.

H.T. Nguyen, M. Worring and R.V.D.

Boomgaard, Occlusion Robust Adaptive

Ttemplate Tracking, Proceedings of IEEE

Conference on Computer Vision (2001)

pp. 7-14.

W.W. Gaver, G. Smets and K. Overbeeke, A

Virtual Window on Media Space.

Proceedings of CHI‟95 (1995) pp. 257-264.

K. Toyama, Look, Ma–No Hands, HandsFree

Cursor Control with Real-Time 3D Face

Tracking, Proceedings of the 1998

Workshop on Perceptual User Interfaces,


K. Toyama and G. Hager, International

Journal of Computer Vision 35, No. 1 (1999)


F. Berard, The Perceptual Widow: Head

Motion as a new Input Stream, Proceedings

of the Seventh IFIP Conference on HumanComputer Interaction (1999) pp. 238-244.

P.A. Anandan, International Journal of

Computer Vision 2, No. 3 (1989) 283.

A. Ismail, A.S. Hajjar and M. Hajjar, The

International Journal of Multimedia and its

Applications 3, No. 3 (2011) 15.

T. Pallejà, E. Rubión, M. Teixidó,

M. Tresanchez, A.F del Viso and J. Palacín,

Simple and Robust Implementation of a

Relative Virtual Mouse Controlled by Head

Movements, Proceedings of Human System

Interactions, Conference on Digital Object

Identifier (2008) pp. 221-224.

C. Sun, Image and Vision Computing 20, No.

–14 (2002) 981.

Y. Fu and T.S. Huang, hMouse: Head

Tracking Driven Virtual Computer Mouse,

Proceedings of IEEE Workshop on

Applications of Computer Vision (2007)

pp. 30-36.

L. Wensheng, D. Chunjian and L. Yi,

Implementation of Virtual Mouse Based on

Machine Vision, Proceedings of International

Conference on Apperceiving Computing and

Intelligence Analysis (2010) pp. 367-371.

R. Gonzalez and R.E. Woods, Digital Image

Processing 2nd Ed. Prentice Hall (2002)

pp. 519-556.

X. Wang and K. Qin, A Six-degree-offreedom Virtual Mouse based on Hand

Gestures, Proceedings of International

Conference on Electrical and Control

Engineering (2010) pp. 257-260.

W. Wah, M. Tsang and K. Pun, A FingerTracking Virtual Mouse Realized in an

Embedded System, Proceedings of

International Symposium on Intelligent Signal Processing and Communication Systems

(2005) pp. 781-784.

J. Han, Low-Cost Multi-Touch Sensing

Through Frustrated Total Internal Reflection.

In the Proceedings of 18th Annual ACM

Symposium on User Interface Software and

Technology (2005) pp. 115-118.

Orion Instruments. “HeadMouse” Internet:

http://orin.com/access/headmouse (August 9,


N. Matsushita and J. Rekimoto, HoloWall:

Designing a Finger, Hand, Body and Object

Sensitive Wall, Proceedings of the 10th

Annual ACM symposium on User interface

software and technology (1997) pp. 209-210.

H. Benko, A. Wilson and R. Balakrishnan,

Sphere: Multi-Touch Interactions on a

Spherical Dis-play. In the Proceedings of

st Annual ACM Symposium on User

Interface Software and Technology (2008)

pp. 77-86.

B. Ventures. Ion Wireless Air Mouse Glove,

http://www.ionwirelessair mouse. com

(August 9, 2012)

A. Butler, S. Izadi and S. Hodges, SideSight:

Multi-„Touch‟ Interactions Around Small

Devices. In the Proceedings of 21st annual

ACM Symposium on User Interface Software

and Technology (2008) pp. 201–204.

BT. Newton Peripherals, LLC. MoGo Mouse,

http://tinyurl.com/yw4lbv. (12.May, 2009).

Celluon, evoMouse, http://celluon.com/

shop_evo_mouse.php (August 10, 2012).

Brando, Finger Mouse, http://usb.brando.com

/usb-finger mouse_p00187c037d015.html

(August. 10, 2012).

Apple, Mighty Mouse, http://www.apple.com/

mightymouse (August 10, 2012).

Logitech, Air Mouse, http://tinyurl.com/3qtor8.

(August 10, 2012).

R. Balakrishnan and P. Patel, The

PadMouse: Facilitating Selection and Spatial

Positioning for the Non-Dominant Hand,

Proceedings of ACM conference on Human

Factors in computing systems (1998)

pp. 9-16.

Air Mouse, AirMouse Internet, http://www.

theairmouse.com/tech.php, (August 10,


T. Pallejà, E. Rubión, M. Teixidó,

M. Tresanchez, A. Fernández del Viso, J.

Palacín, C. Rebate and J. Palacín. Head

Mouse 4.2, http://robotica.udl.cat/(Sept 5,



  • There are currently no refbacks.