-
眼动信息是识别观看视频、浏览网页等以视觉任务为主的行为的关键信息. 针对传统的可穿戴传感器普遍具有侵入性, 而现有基于视觉的眼动仪存在价格昂贵、校准过程复杂等问题, 本文尝试使用单一的标准网络摄像头获取眼动信息用于行为识别, 并评估了该方法的可行性. 提出一种针对低质量视频图像的虹膜跟踪算法以获取眼动信号, 然后分别从水平和垂直方向的眼动信号中提取出五种新的眼动特征, 并从中选择出最优特征子集, 最后采用支持向量机分类器评价了本文方法的可行性. 针对不同应用背景设计了三组验证实验: 留一交叉验证、k折交叉验证及单独校准测试, 三组实验中, 对不同参与者三种行为的平均识别正确率分别为68.4%, 79.3%及84.1%, 证明了基于视频图像的眼动分析用于行为识别是一种很有希望的传感形式, 并有望用于更为复杂的传感任务.Eye movement information is the key clue for recognizing the vision-dominated tasks, such as browsing the web, or watching a video. However, traditional wearable sensors are invasive and the vision-based eye trackers are very expensive and need time consuming calibration. Therefore, an activity recognition method based on eye movement analysis under one web camera is first proposed and the feasibility is assessed. First, an iris tracking method for the low quality image is proposed to acquire eye movement information. Then, five ten novel features are extracted from the horizontal and the vertical eye movement signals for activity recognition, and the optimal feature subset is selected. Finally, the support vector machine is used to assess the feasibility of the proposed method. Three experiments are designed for different applications: leave-one-out cross-validation, k-fold cross-validation, and validation after respective calibration. Experimental results show that their accuracies are 68.4%, 79.3% and 84.1%, respectively, which demonstrate the promise of eye based activity recognition using one web camera.
-
Keywords:
- internet of things /
- activity recognition /
- eye tracking /
- sensing
[1] Shen H T, Li J W, Zhang B L, Chang S J, Wang K, Zhang Y X, Zhai H S 2006 Acta Phys. Sin. 55 6399 (in Chinese) [申会庭, 李江卫, 张便利, 常胜江, 王凯, 张延炘, 翟宏琛 2006 55 6399]
[2] Turaga P, Chellappa R, Subrahmanian V S, Udrea O 2008 IEEE Trans. Circ. Syst. Vid. 18 1473
[3] [4] Najafi B, Aminian K, Paraschiv-Ionescu A, Loew F, Bula C J, Robert P 2003 IEEE Trans. Biomedical Eng. 50 711
[5] [6] [7] Ward J A, Lukowicz P, Troster G, Starner T E 2006 IEEE Trans. Pattern. Anal. 28 1553
[8] [9] Gordon D, Schmidtke H R, Beigl M, Zengen G V 2010 Proceedings of the 14th International Symposium on Wearable Computers Seoul, Oct.10-13, 2010 p1
[10] Bulling A, Ward J A, Gellersen H, Troster G 2011 IEEE Trans. Pattern. Anal. 33 741
[11] [12] [13] Zhang Z T, Zhang J S 2010 Chin. Phys. B 19 104601
[14] Zhang W, Cheng B, Zhang B 2012 Acta Phys. Sin. 61 060701 (in Chinese) [张伟, 成波, 张波 2012 61 060701]
[15] [16] [17] Kim S M, Sked M, Ji Q 2004 Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society San Francisco, Sept.1-5, 2004 p2271
[18] Hansen D W, Pece A E C 2005 Comput. Vis. Image. Und. 98 182
[19] [20] Yoo D H, Chung M J 2005 Comput. Vision. Image. Und. 98 25
[21] [22] [23] Shih S W, Liu J 2004 IEEE Trans. Syst. Man. Cy. B 34 234
[24] Tsukada A, Kanade T 2012 Proceedings of the Symposium on Eye Tracking Research and Applications, Santa Barbara March 28-30, 2012 p213
[25] [26] Meng C N, Zhang T N, Zhang P, Chang S J 2012 Opt. Eng. 51 077008
[27] [28] Elhelw M, Nicolaou M, Chung A, Yang G Z, Atkins M S 2008 ACM Trans. Appl. Percept. 5 1
[29] [30] [31] Dempere-Marco L, Hu X P, MacDonald S L S, Ellis S M, Hansell D M, Yang G Z 2002 IEEE Trans. Med. Imaging. 21 741
[32] Manor B R, Gordon E 2003 J. Neurosci. Meth. 128 85
[33] [34] [35] Hansen D W, Ji Q 2010 IEEE Trans. Pattern. Anal. 32 478
-
[1] Shen H T, Li J W, Zhang B L, Chang S J, Wang K, Zhang Y X, Zhai H S 2006 Acta Phys. Sin. 55 6399 (in Chinese) [申会庭, 李江卫, 张便利, 常胜江, 王凯, 张延炘, 翟宏琛 2006 55 6399]
[2] Turaga P, Chellappa R, Subrahmanian V S, Udrea O 2008 IEEE Trans. Circ. Syst. Vid. 18 1473
[3] [4] Najafi B, Aminian K, Paraschiv-Ionescu A, Loew F, Bula C J, Robert P 2003 IEEE Trans. Biomedical Eng. 50 711
[5] [6] [7] Ward J A, Lukowicz P, Troster G, Starner T E 2006 IEEE Trans. Pattern. Anal. 28 1553
[8] [9] Gordon D, Schmidtke H R, Beigl M, Zengen G V 2010 Proceedings of the 14th International Symposium on Wearable Computers Seoul, Oct.10-13, 2010 p1
[10] Bulling A, Ward J A, Gellersen H, Troster G 2011 IEEE Trans. Pattern. Anal. 33 741
[11] [12] [13] Zhang Z T, Zhang J S 2010 Chin. Phys. B 19 104601
[14] Zhang W, Cheng B, Zhang B 2012 Acta Phys. Sin. 61 060701 (in Chinese) [张伟, 成波, 张波 2012 61 060701]
[15] [16] [17] Kim S M, Sked M, Ji Q 2004 Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society San Francisco, Sept.1-5, 2004 p2271
[18] Hansen D W, Pece A E C 2005 Comput. Vis. Image. Und. 98 182
[19] [20] Yoo D H, Chung M J 2005 Comput. Vision. Image. Und. 98 25
[21] [22] [23] Shih S W, Liu J 2004 IEEE Trans. Syst. Man. Cy. B 34 234
[24] Tsukada A, Kanade T 2012 Proceedings of the Symposium on Eye Tracking Research and Applications, Santa Barbara March 28-30, 2012 p213
[25] [26] Meng C N, Zhang T N, Zhang P, Chang S J 2012 Opt. Eng. 51 077008
[27] [28] Elhelw M, Nicolaou M, Chung A, Yang G Z, Atkins M S 2008 ACM Trans. Appl. Percept. 5 1
[29] [30] [31] Dempere-Marco L, Hu X P, MacDonald S L S, Ellis S M, Hansell D M, Yang G Z 2002 IEEE Trans. Med. Imaging. 21 741
[32] Manor B R, Gordon E 2003 J. Neurosci. Meth. 128 85
[33] [34] [35] Hansen D W, Ji Q 2010 IEEE Trans. Pattern. Anal. 32 478
计量
- 文章访问数: 6566
- PDF下载量: 579
- 被引次数: 0
下载:
