Menu utilisateur

Accès à distance ? S'identifier sur le proxy UCLouvain

!FTL, an Articulation-Invariant Stroke Gesture Recognizer with Controllable Position, Scale, and Rotation Invariances

Onglets principaux

Télécharger
  • Open access
  • PDF
  • 1.60 M
Vanderdonckt, Jean Roselli, Paolo [UCL] Pérez-Medina, Jorge Luis

Nearest neighbor classifiers recognize stroke gestures by computing a (dis)similarity between a candidate gesture and a training set based on points, which may require normalization, resampling, and rotation to a reference before processing. To eliminate this expensive preprocessing, this paper introduces a vector-between-vectors recognition where a gesture is defined by a vector based on geometric algebra and performs recognition by computing a novel Local Shape Distance (LSD) between vectors. We mathematically prove the LSD position, scale, and rotation invariance, thus eliminating the preprocessing. To demonstrate the viability of this approach, we instantiate LSD for n=2 to compare !FTL, a 2D stroke-gesture recognizer with respect to $1 and $P, two state-of-the-art gesture recognizers, on a gesture set typically used for benchmarking. !FTL benefits from a recognition rate similar to $P, but a significant smaller execution time and a lower algorithmic complexity.

Type de document Communication à un colloque (Conference Paper)
Type d'accès Accès libre
Année de publication 2018
Langue Anglais
Conférence "20th ACM International Conference on Multimodal Interaction", Boulder, CO, USA (du 16/10/2018 au 20/10/2018)
Peer reviewed oui
Document hôte Sidney K. D'Mello, Panayiotis Georgiou, Stefan Scherer, Emily Mower Provost, Mohammad Soleymani, Marcelo Worsley ; "Proceedings of the 2018 on International Conference on Multimodal Interaction - ICMI '18"- p. 125-134 (ISBN : 978-1-4503-5692-3)
Editeur ACM Press (New York)
Statut de la publication Publié
Affiliations UCL - SSH/LouRIM - Louvain Research Institute in Management and Organizations
UCL - SST/ICTM - Institute of Information and Communication Technologies, Electronics and Applied Mathematics
Mots-clés Stroke gesture recognition ; Articulation invariance ; Isometricity ; Isochronicity ; Isoparameterization ; Local Shape Distance
Liens
  1. Ye Yina, Nurmi Petteri, Gestimator : Shape and Stroke Similarity Based Gesture Recognition, 10.1145/2818346.2820734
  2. Daiki Yamaji. 2016. A Fast and Lightweight Unistroke Recognizer for Large User- defined vocabulary (in Japanese). Ph.D. Dissertation. University of Tsukuba, Ibaraki, Japan. Retrieved September 2, 2017 from http://www.iplab.cs.tsukuba.ac. jp/master-e/.
  3. Jiahui Wu, Gang Pan, Daqing Zhang, Guande Qi, and Shijian Li. 2009. Gesture Recognition with a 3-D Accelerometer. In Proceedings of the 6th International Conference on Ubiquitous Intelligence and Computing (UIC '09). Springer-Verlag, Berlin, Heidelberg, 25--38. https://doi.org/10.1007/978-3-642-02830-4_4
  4. Jacob O. Wobbrock, Andrew D. Wilson, and Yang Li. 2007. Gestures Without Libraries, Toolkits or Training: A $1 Recognizer for User Interface Prototypes. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 159--168. https://doi.org/10. 1145/1294211.1294238
  5. Willems Don, Niels Ralph, van Gerven Marcel, Vuurpijl Louis, Iconic and multi-stroke gesture recognition, 10.1016/j.patcog.2009.01.030
  6. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13, 10.1145/2470654
  7. Radu-Daniel Vatavu, Laurent Grisoni, and Stefan-Gheorghe Pentiuc. 2009. Gesture-Based Human-Computer Interaction and Simulation. Springer-Verlag, Berlin, Heidelberg, Chapter Gesture Recognition Based on Elastic Deformation Energies, 1--12. https://doi.org/10.1007/978-3-540-92865-2_1
  8. Vatavu Radu-Daniel, Casiez Géry, Grisoni Laurent, Small, medium, or large? : estimating the user-perceived scale of stroke gestures, 10.1145/2470654.2470692
  9. Vatavu Radu-Daniel, Anthony Lisa, Wobbrock Jacob O., $Q : a super-quick, articulation-invariant stroke-gesture recognizer for low-resource devices, 10.1145/3229434.3229465
  10. Radu-Daniel Vatavu. 2012. 1F: One Accessory Feature Design for Gesture Recognizers. In Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces (IUI '12). ACM, New York, NY, USA, 297--300. https: //doi.org/10.1145/2166966.2167022
  11. Vatavu Radu-Daniel, The effect of sampling rate on the performance of template-based gesture recognizers, 10.1145/2070481.2070531
  12. Radu-Daniel Vatavu. 2017. Improving Gesture Recognition Accuracy on Touch Screens for Users with Low Vision. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, May 06-11, 2017., Gloria Mark, Susan R. Fussell, Cliff Lampe, m. c. schraefel, Juan Pablo Hourcade, Caroline Appert, and Daniel Wigdor (Eds.). ACM, 4667--4679. https://doi.org/10. 1145/3025453.3025941
  13. Jean Vanderdonckt, Bruno Dumas, and Mauro Cherubini. 2018. Comparing Some Distances in Template-based 2D Gesture Recognition. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, Article LBW121, 6 pages. https://doi.org/10.1145/ 3170427.3188452
  14. Tu Huawei, Ren Xiangshi, Zhai Shumin, Differences and Similarities between Finger and Pen Stroke Gestures on Stationary and Mobile devices, 10.1145/2797138
  15. Taranta II Eugene M., Samiei Amirreza, Maghoumi Mehran, Khaloo Pooya, Pittman Corey R., LaViola Jr. Joseph J., Jackknife : A Reliable Recognizer with Few Samples and Many Modalities, 10.1145/3025453.3026002
  16. Eugene M. Taranta, II and Joseph J. LaViola, Jr. 2015. Penny Pincher: A Blazing Fast, Highly Accurate $-family Recognizer. In Proceedings of the 41st Graphics Interface Conference (GI '15). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 195--202. http://dl.acm.org/citation.cfm?id= 2788890.2788925
  17. Scott Swigart. 2005. Easily Write Custom Gesture Recognizers for Your Tablet PC Applications. Retrieved September 9, 2017 from https://msdn.microsoft.com/ en-us/library/aa480673.aspx.
  18. Sutton Charles, An Introduction to Conditional Random Fields, 10.1561/2200000013
  19. David Bingham Skalak. 1997. Prototype Selection for Composite Nearest Neighbor Classifiers. Ph.D. Dissertation. Amherst, MA, USA. UMI Order No. GAX97--37585.
  20. B. Signer, U. Kurmann, and M. Norrie. 2007. iGesture: A General Gesture Recogni- tion Framework. In Proceedings of the Ninth International Conference on Document Analysis and Recognition - Volume 02 (ICDAR '07). IEEE Computer Society, Washington, DC, USA, 954--958. http://dl.acm.org/citation.cfm?id=1304596.1304930
  21. Rucklidge W.J., Locating objects using the Hausdorff distance, 10.1109/iccv.1995.466904
  22. Rubine Dean, Specifying gestures by example, 10.1145/122718.122753
  23. Pittman Corey, Taranta II Eugene M., LaViola Joseph J., A $-Family Friendly Approach to Prototype Selection, 10.1145/2856767.2856808
  24. Ni Tao, Baudisch Patrick, Disappearing mobile devices, 10.1145/1622176.1622197
  25. Deza Michel Marie, Deza Elena, Encyclopedia of Distances, ISBN:9783662528433, 10.1007/978-3-662-52844-0
  26. Kent Lyons, Helene Brashear, Tracy Westeyn, Jung Soo Kim, and Thad Starner. 2007. GART: The Gesture and Activity Recognition Toolkit. In Proceedings of the 12th International Conference on Human-computer Interaction: Intelligent Multimodal Interaction Environments (HCI'07). Springer-Verlag, Berlin, Heidelberg, 718--727. http://dl.acm.org/citation.cfm?id=1769590.1769671
  27. Hao Lü, James A. Fogarty, and Yang Li. 2014. Gesture Script: Recognizing Gestures and Their Structure Using Rendering Scripts and Interactively Trained Parts. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1685--1694. https://doi.org/10.1145/ 2556288.2557263
  28. Allan Christian Long, Jr., James A. Landay, and Lawrence A. Rowe. 1999. Impli- cations for a Gesture Design Tool. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 40--47. https://doi.org/10.1145/302979.302985
  29. Yang Li. 2010. Protractor: A Fast and Accurate Gesture Recognizer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 2169--2172. https://doi.org/10.1145/1753326.1753654
  30. Lester J. A., Triangles I: Shapes, 10.1007/bf01818325
  31. Leiva Luis A., Martín-Albo Daniel, Plamondon Réjean, Gestures à Go Go : Authoring Synthetic Human-Like Stroke Gestures Using the Kinematic Theory of Rapid Movements, 10.1145/2799648
  32. Kristensson Per-Ola, Zhai Shumin, SHARK 2 : a large vocabulary shorthand writing system for pen-based computers, 10.1145/1029632.1029640
  33. Kratz Sven, Rohs Michael, Protractor3D : a closed-form solution to rotation-invariant 3D gestures, 10.1145/1943403.1943468
  34. Kratz Sven, Rohs Michael, A $3 gesture recognizer : simple gesture recognition for devices equipped with 3D acceleration sensors, 10.1145/1719970.1720026
  35. Kim Kisang, Choi Hyung Il, Online hand gesture recognition using enhanced $N recogniser based on a depth camera, 10.1504/ijcvr.2016.077352
  36. Kara Levent Burak, Stahovich Thomas F., Hierarchical parsing and recognition of hand-sketched diagrams, 10.1145/1029632.1029636
  37. Kanatani Kenichi, Understanding Geometric Algebra : Hamilton, Grassmann, and Clifford for Computer Vision and Graphics, ISBN:9781482259506, 10.1201/b18273
  38. M. Murray J. Gilbert. 1991. Clifford algebras and Dirac operators in harmonic analysis. Cambridge University Press.
  39. Heloise Hse, Michael Shilman, and A. Richard Newton. 2004. Robust Sketched Symbol Fragmentation Using Templates. In Proceedings of the 9th International Conference on Intelligent User Interfaces (IUI '04). ACM, New York, NY, USA, 156--160. https://doi.org/10.1145/964442.964472 Retrieved September 9, 2017 from https://embedded.eecs.berkeley.edu/research/hhreco/.
  40. Hoffman Michael, Varcholik Paul, LaViola Joseph J., Breaking the status quo: Improving 3D gesture recognition with spatially convenient input devices, 10.1109/vr.2010.5444813
  41. J. Herold and T. F. Stahovich. 2012. The 1&Cent; Recognizer: A Fast, Accurate, and Easy-to-implement Handwritten Gesture Recognition Technique. In Proceedings of the International Symposium on Sketch-Based Interfaces and Modeling (SBIM '12). Eurographics Association, Goslar Germany, Germany, 39--46. http://dl.acm. org/citation.cfm?id=2331067.2331074
  42. Hastie Trevor, Tibshirani Robert, Friedman Jerome, The Elements of Statistical Learning, ISBN:9780387848570, 10.1007/978-0-387-84858-7
  43. G.V. Glass, B. McGaw, and M.L. Smith. 1981. Meta-Analysis in Social Research. Sage, Beverly Hills.
  44. Nicholas Gillian and Joseph A. Paradiso. 2014. The Gesture Recognition Toolkit. J. Mach. Learn. Res. 15, 1 (Jan. 2014), 3483--3487. http://dl.acm.org/citation.cfm? id=2627435.2697076
  45. Galveia Bruno, Cardoso Tiago, Santor Vitor, Rybarczyk Yves, Towards the creation of a Gesture Library, 10.4108/ct.2.3.e3
  46. Fonseca Manuel J., Jorge Joaquim A., Experimental evaluation of an on-line scribble recognizer, 10.1016/s0167-8655(01)00076-9
  47. Richard O. Duda, Peter E. Hart, and David G. Stork. 2000. Pattern Classification. Wiley & Sons, New York.
  48. Dubuisson M.-P., Jain A.K., A modified Hausdorff distance for object matching, 10.1109/icpr.1994.576361
  49. Leo Dorst, Daniel Fontijne, and Stephen Mann. 2007. Geometric Algebra for Computer Science: An Object-Oriented Approach to Geometry (1st ed.). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
  50. Adrien Coyette, Sascha Schimke, Jean Vanderdonckt, and Claus Vielhauer. 2007. Trainable Sketch Recognizer for Graphical User Interface Design. Springer Berlin Heidelberg, Berlin, Heidelberg, 124--135. https://doi.org/10.1007/ 978-3-540-74796-3_14
  51. Paul Corey and Tracy Hammond. 2008. GLADDER: Combining Gesture and Geometric Sketch Recognition. In Proceedings of the 23rd National Conference on Artificial Intelligence - Volume 3 (AAAI'08). AAAI Press, 1788--1789. http://dl.acm.org/citation.cfm?id=1620270.1620354
  52. J. Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences, 2nd Edition. Lawrence Erlbaum, Hillsdale.
  53. Mauricio Cirelli and Ricardo Nakamura. 2014. A Survey on Multi-touch Gesture Recognition and Multi-touch Frameworks. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS '14). ACM, New York, NY, USA, 35--44. https://doi.org/10.1145/2669485.2669509
  54. Samuel hsiao-heng Chang, Rachel Blagojevic, and Beryl Plimmer. 2012. Rata.Gesture: A Gesture Recognizer Developed Using Data Mining. Artif. In-tell. Eng. Des. Anal. Manuf. 26, 3 (Aug. 2012), 351--366. https://doi.org/10.1017/ S0890060412000194
  55. Carcangiu Alessandro, Spano Lucio Davide, G-Gene : A Gene Alignment Method for Online Partial Stroke Gestures Recognition, 10.1145/3229095
  56. Xiang Cao and Shumin Zhai. 2007. Modeling Human Performance of Pen Stroke Gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1495--1504. https://doi.org/10.1145/ 1240624.1240850
  57. Andrew Bragdon, Robert Zeleznik, Brian Williamson, Timothy Miller, and Joseph J. LaViola, Jr. 2009. GestureBar: Improving the Approachability of Gesture-based Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 2269--2278. https://doi.org/10.1145/1518701.1519050
  58. Braga Sangiorgi Ugo, Motti Vivian Genaro, Beuvens François, Vanderdonckt Jean, Assessing lag perception in electronic sketching, 10.1145/2399016.2399040
  59. Beuvens Francois, Vanderdonckt Jean, UsiGesture: An environment for integrating pen-based interaction in user interface development, 10.1109/rcis.2012.6240449
  60. François Beuvens and Jean Vanderdonckt. 2012. Designing Graphical User Inter- faces Integrating Gestures. In Proceedings of the 30th ACM International Conference on Design of Communication (SIGDOC '12). ACM, New York, NY, USA, 313--322. https://doi.org/10.1145/2379057.2379116
  61. Gilles Bailly, Eric Lecolinet, and Laurence Nigay. 2008. Flower Menus: A New Type of Marking Menu with Large Menu Breadth, Within Groups and Efficient Expert Mode Memorization. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '08). ACM, New York, NY, USA, 15--22. https://doi.org/10. 1145/1385569.1385575
  62. Daniel Ashbrook and Thad Starner. 2010. MAGIC: A Motion Gesture Design Tool. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 2159--2168. https://doi.org/10.1145/ 1753326.1753653
  63. Caroline Appert and Shumin Zhai. 2009. Using Strokes As Command Shortcuts: Cognitive Benefits and Toolkit Support. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 2289--2298. https://doi.org/10.1145/1518701.1519052
  64. Caroline Appert and Olivier Bau. 2010. Scale Detection for a Priori Ges- ture Recognition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 879--882. https: //doi.org/10.1145/1753326.1753456
  65. Lisa Anthony and Jacob O. Wobbrock. 2012. $N-protractor: A Fast and Accurate Multistroke Recognizer. In Proceedings of Graphics Interface 2012 (GI '12). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 117--120. http://dl.acm.org/citation.cfm?id=2305276.2305296
  66. Lisa Anthony and Jacob O. Wobbrock. 2010. A Lightweight Multistroke Recognizer for User Interface Prototypes. In Proceedings of Graphics Interface 2010 (GI '10). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 245--252. http://dl.acm.org/citation.cfm?id=1839214.1839258
Référence bibliographique Vanderdonckt, Jean ; Roselli, Paolo ; Pérez-Medina, Jorge Luis. !FTL, an Articulation-Invariant Stroke Gesture Recognizer with Controllable Position, Scale, and Rotation Invariances.20th ACM International Conference on Multimodal Interaction (Boulder, CO, USA, du 16/10/2018 au 20/10/2018). In: Sidney K. D'Mello, Panayiotis Georgiou, Stefan Scherer, Emily Mower Provost, Mohammad Soleymani, Marcelo Worsley, Proceedings of the 2018 on International Conference on Multimodal Interaction - ICMI '18, ACM Press : New York2018, p. 125-134
Permalien http://hdl.handle.net/2078.1/204023