-
Eye movement information is the key clue for recognizing the vision-dominated tasks, such as browsing the web, or watching a video. However, traditional wearable sensors are invasive and the vision-based eye trackers are very expensive and need time consuming calibration. Therefore, an activity recognition method based on eye movement analysis under one web camera is first proposed and the feasibility is assessed. First, an iris tracking method for the low quality image is proposed to acquire eye movement information. Then, five ten novel features are extracted from the horizontal and the vertical eye movement signals for activity recognition, and the optimal feature subset is selected. Finally, the support vector machine is used to assess the feasibility of the proposed method. Three experiments are designed for different applications: leave-one-out cross-validation, k-fold cross-validation, and validation after respective calibration. Experimental results show that their accuracies are 68.4%, 79.3% and 84.1%, respectively, which demonstrate the promise of eye based activity recognition using one web camera.
-
Keywords:
- internet of things /
- activity recognition /
- eye tracking /
- sensing
[1] Shen H T, Li J W, Zhang B L, Chang S J, Wang K, Zhang Y X, Zhai H S 2006 Acta Phys. Sin. 55 6399 (in Chinese) [申会庭, 李江卫, 张便利, 常胜江, 王凯, 张延炘, 翟宏琛 2006 55 6399]
[2] Turaga P, Chellappa R, Subrahmanian V S, Udrea O 2008 IEEE Trans. Circ. Syst. Vid. 18 1473
[3] [4] Najafi B, Aminian K, Paraschiv-Ionescu A, Loew F, Bula C J, Robert P 2003 IEEE Trans. Biomedical Eng. 50 711
[5] [6] [7] Ward J A, Lukowicz P, Troster G, Starner T E 2006 IEEE Trans. Pattern. Anal. 28 1553
[8] [9] Gordon D, Schmidtke H R, Beigl M, Zengen G V 2010 Proceedings of the 14th International Symposium on Wearable Computers Seoul, Oct.10-13, 2010 p1
[10] Bulling A, Ward J A, Gellersen H, Troster G 2011 IEEE Trans. Pattern. Anal. 33 741
[11] [12] [13] Zhang Z T, Zhang J S 2010 Chin. Phys. B 19 104601
[14] Zhang W, Cheng B, Zhang B 2012 Acta Phys. Sin. 61 060701 (in Chinese) [张伟, 成波, 张波 2012 61 060701]
[15] [16] [17] Kim S M, Sked M, Ji Q 2004 Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society San Francisco, Sept.1-5, 2004 p2271
[18] Hansen D W, Pece A E C 2005 Comput. Vis. Image. Und. 98 182
[19] [20] Yoo D H, Chung M J 2005 Comput. Vision. Image. Und. 98 25
[21] [22] [23] Shih S W, Liu J 2004 IEEE Trans. Syst. Man. Cy. B 34 234
[24] Tsukada A, Kanade T 2012 Proceedings of the Symposium on Eye Tracking Research and Applications, Santa Barbara March 28-30, 2012 p213
[25] [26] Meng C N, Zhang T N, Zhang P, Chang S J 2012 Opt. Eng. 51 077008
[27] [28] Elhelw M, Nicolaou M, Chung A, Yang G Z, Atkins M S 2008 ACM Trans. Appl. Percept. 5 1
[29] [30] [31] Dempere-Marco L, Hu X P, MacDonald S L S, Ellis S M, Hansell D M, Yang G Z 2002 IEEE Trans. Med. Imaging. 21 741
[32] Manor B R, Gordon E 2003 J. Neurosci. Meth. 128 85
[33] [34] [35] Hansen D W, Ji Q 2010 IEEE Trans. Pattern. Anal. 32 478
-
[1] Shen H T, Li J W, Zhang B L, Chang S J, Wang K, Zhang Y X, Zhai H S 2006 Acta Phys. Sin. 55 6399 (in Chinese) [申会庭, 李江卫, 张便利, 常胜江, 王凯, 张延炘, 翟宏琛 2006 55 6399]
[2] Turaga P, Chellappa R, Subrahmanian V S, Udrea O 2008 IEEE Trans. Circ. Syst. Vid. 18 1473
[3] [4] Najafi B, Aminian K, Paraschiv-Ionescu A, Loew F, Bula C J, Robert P 2003 IEEE Trans. Biomedical Eng. 50 711
[5] [6] [7] Ward J A, Lukowicz P, Troster G, Starner T E 2006 IEEE Trans. Pattern. Anal. 28 1553
[8] [9] Gordon D, Schmidtke H R, Beigl M, Zengen G V 2010 Proceedings of the 14th International Symposium on Wearable Computers Seoul, Oct.10-13, 2010 p1
[10] Bulling A, Ward J A, Gellersen H, Troster G 2011 IEEE Trans. Pattern. Anal. 33 741
[11] [12] [13] Zhang Z T, Zhang J S 2010 Chin. Phys. B 19 104601
[14] Zhang W, Cheng B, Zhang B 2012 Acta Phys. Sin. 61 060701 (in Chinese) [张伟, 成波, 张波 2012 61 060701]
[15] [16] [17] Kim S M, Sked M, Ji Q 2004 Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society San Francisco, Sept.1-5, 2004 p2271
[18] Hansen D W, Pece A E C 2005 Comput. Vis. Image. Und. 98 182
[19] [20] Yoo D H, Chung M J 2005 Comput. Vision. Image. Und. 98 25
[21] [22] [23] Shih S W, Liu J 2004 IEEE Trans. Syst. Man. Cy. B 34 234
[24] Tsukada A, Kanade T 2012 Proceedings of the Symposium on Eye Tracking Research and Applications, Santa Barbara March 28-30, 2012 p213
[25] [26] Meng C N, Zhang T N, Zhang P, Chang S J 2012 Opt. Eng. 51 077008
[27] [28] Elhelw M, Nicolaou M, Chung A, Yang G Z, Atkins M S 2008 ACM Trans. Appl. Percept. 5 1
[29] [30] [31] Dempere-Marco L, Hu X P, MacDonald S L S, Ellis S M, Hansell D M, Yang G Z 2002 IEEE Trans. Med. Imaging. 21 741
[32] Manor B R, Gordon E 2003 J. Neurosci. Meth. 128 85
[33] [34] [35] Hansen D W, Ji Q 2010 IEEE Trans. Pattern. Anal. 32 478
Catalog
Metrics
- Abstract views: 6543
- PDF Downloads: 579
- Cited By: 0
下载:
