VISUAL GESTURE BASED AUGMENTED VIRTUAL KEYBOARD SYSTEM

M. H. Yousaf, Hafiz A. Habib, F. Hussain, M. Rizwan

Abstract


This paper presents a novel enhancement in design of virtual keyboards for consumers of tablets and standard computing devices. Hand video is captured for virtual keyboard functionality. Hand video is augmented with a background keyboard and displayed on lower part of screen to provide feedback to user for seamless interaction with virtual keyboard. Hands are detected in video sequence. Finger joints trajectory based keystroke detection and recognition fused with augmented keys spatial information reveals the key pressed. Real time system is developed by integrating USB camera with tablet computer. Reliable results are experienced while a low cost system is achieved in comparison to existing virtual keyboard systems.

Full Text:

PDF

References


M. Goldstein and D. Chincholle, Finger-Joint

Gesture Wearable Keypad; in Second

Workshop on Human Computer Interaction

with Mobile Devices (1999).

R. Rosenberg, Computing without Mice and

Keyboards: Text and Graphic Input Devices

for Mobile Computing; Ph.D Thesis, Dept. of

Computer Science, University College,

London (1998).

M. Fukumoto and Y. Tonomura, Body

Coupled FingeRing, Wireless Wearable

Keyboard, ACM CHI (1997).

F. Evans, S. Skiena and A. Varshney,

VType: Entering Text in a Virtual World,

Submitted to International Journal of HumanComputer Studies

Samsung Scurry; PCWorld article at

http://www.pcworld.com/article/70568/virtual_

keyboards_let_you_type_in_air.html.

Senseboard, http://www.senseboard.com.

Z. Zhang, Y. Wu, Y. Shan and S. Shafer,

Visual Panel: Virtual Mouse, Keyboard and

D Controller with an Ordinary Piece of

Paper. ACM Workshop on Perceptive User

Interfaces (Nov. 2001).

Virtual Devices, Inc., VKPC; http://www.

virtualdevices.net.

i-Tech’s Virtual Keyboard at http://www.vkbsupport.com.

NadeekaSamanthiWijewantha, Chanaka

Amarasekara, VISTAKEY: A Keyboard

Without A Keyboard – A Type of Virtual

Keyboard, IEEE Eleventh Annual Conference

Sri Lanka (2004).

H. Du, T.Oggier and F.Lustenberger, A

Virtual Keyboard Based on True-3D Optical

Ranging, British Machine Vision Conference

(2005).

H. Du and E.Charbon, A Virtual Keyboard

System based on Multi-Level Feature

Matching, International Conference on

Human Systems Interaction (2008).

M. Lee and W. Woo, ARKB: 3D Vision-based

Augmented Reality Keyboard, International

Conference on Artificial Reality and

Telexistence (2003) pp. 54-57.

Hafiz A. Habib and M. Mufti, IEEE

Transactions on Consumer Electronics 52,

No. 4 (2006) 1261.

R. Bowden, A. Zisserman, T. Kadir and

M. Brady, Vision Based Interpretation of

Natural Sign Languages, Proc. 3rd Int.

Conference on Comput. Vis. Syst., Graz,

Austria (April 2003) pp. 391- 401.

Y. Liu and Y.Lia, A Robust Hand Tracking

and Gesture Recognition Method for

Wearable Virtual Interfaces and its

Applications, 3rd International Conference on

Image and Graphics (2004).

L. Lumbardi and M.Porta, Adding Gestures to

Ordinary Mouse Use: A New Input Modality

for Improved Human- Computer Interaction”

th International Conference on Image

Analysis and Processing (2007).

M. Alpern and K. Minardo, Developing a Car

Gesture Interface For Use as a Secondary

Task, CHI (2003) pp. 32-33

X. Yin and M.Xie, Finger Identification and

Hand Posture Recognition for Human–Robot

Interaction, Image and Vision Computing 25

(2007) 1291.

J. Brand and J. Mason, A Comparative

Assessment of Three Approachesto

Pixellevel Human Skin-Detection, Proc.

thIEEE/IAPR International Conference on

Pattern Recognition,Vol. 1, Barcelona, Spain

(2000) pp. 1056–1059.

M. H. Yousaf and H. A. Habib, Springer

Arabian Journal for Science and Engineering

DOI: 10.1007/s13369-013-0909-2.

A. Yilmaz, O.Javed and M. Shah, ACM

Computing Surveys 38, No. 4 (2006)

Article. 13.


Refbacks

  • There are currently no refbacks.