-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o--o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o- GESTURE DATA COLLECTION LEXICONS Examples collected by Isabelle Guyon for the ChaLearn Gesture Challenge January 2013 -o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o--o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o- DISCLAIMER: ALL INFORMATION, SOFTWARE, DOCUMENTATION, AND DATA ARE PROVIDED "AS-IS" ISABELLE GUYON AND/OR OTHER ORGANIZERS DISCLAIM ANY EXPRESSED OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR ANY PARTICULAR PURPOSE, AND THE WARRANTY OF NON-INFRIGEMENT OF ANY THIRD PARTY'S INTELLECTUAL PROPERTY RIGHTS. IN NO EVENT SHALL ISABELLE GUYON AND/OR OTHER ORGANIZERS BE LIABLE FOR ANY SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES WHATSOEVER ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF SOFTWARE, DOCUMENTS, MATERIALS, PUBLICATIONS, OR INFORMATION MADE AVAILABLE FOR THE CHALLENGE. This directory contains examples of gesture recognition lexicons. The images were downloaded from the Internet and may be copyrighted by their authors. For any commercial use, please contact the owners. Always make sure to cite the original source. Each gesture token is associated with an image in a standard format such as jpeg and a text file describing its attributes and source. Typical attributes include (the order may change from file to file; only the attributes 'type', 'name', and 'bodypart' are always present and compulsory): ** type One of: gesticulation / gesture / emblem / sign / signal / action / pantomime (see definitions) ** name Alphanumeric upper/lowercase gesture name (does not necessarily need to be related to its meaning) ** bodypart Principal body part(s) used: one hand / two hands / head / hands and head / shoulders * description A string describing the performance of the gesture * comment Any comment, e.g. ambiguity with another gesture or existence of multiple gesture variants * meaning Meaning conveyed (should be in the original language of the country or origin of the gesture) * english English translation of the meaning (if needed) * source Origin of the information * url URL, if downloaded from the Internet We define gestures as a sequence of body motions or a body posture. We consider 9 types of gestures providing a classification according to gesture function rather than to gesture form. Definitions of types of gestures: ==> Activity: Gestures performed to physically interact with the environment and attain a desired outcome. Gestures associated with activities (also called "actions") can be performed with all parts of the body. Examples: putting on glasses, answering the phone, drinking from a cup, kicking a ball. Actions can be ergotic (associated with the notion of work and the capacity of humans to manipulate the physical world, create artefacts) or epistemic (associated with learning from the environment through tactile experience or haptic exploration). Actions may be performed consciously or subconsciously. ==> Body Language: Gestures performed subconsciously, which betray thoughts, moods, or feelings. Such gestures are performed will all parts of the body. Examples: rubbing hands, scratching head, crossing fingers, arms or legs, touching ear. Body Language may be consciously or sub consciously understood. ==> Dance: Gestures associated with performing arts, executed deliberately with an esthetic purpose. Dances can consist of dynamic gestures or postures and include gestures borrowed from gesture vocabularies of other groups such as Pantomimes, Body Language, and Emblems. ==> Emblems: Gestures having a symbolic, political or religious meaning. They are usually performed with one or both hands. Examples: The V of victory, military salutes, Indian Mudras, insults and praises. Emblems are consciously used and consciously understood. ==> Gesticulations: Gesture accompanying a spoken conversation or silent thoughts, performed conciously or subconciously, which punctuates, emphasizes speech, or betrays thoughts not expressed through speech. Gesticulations may be performed with all part of the body. Examples: hand beat to punctuate speech, crossing arms to express defense, shrugging shoulders. Sometimes called co-verbal gestures. Gesticulations can be illustrative, expressive, or paraverbal. They may include "regulators" to control turn taking in conversation, like raising or dropping arms, and beat gestures to punctuate speech. They may also include affect displays like tightening the fist or smiling. ==> Illustrators: Gestures generally accompanying speech and visually representing the same conveyed meaning, but which may be performed silently to substitute for speech and is generally specific of an ethnic group. Usually performed with one or both hands and sometimes the head. Example: Italian gestures. Illustrators are sometimes called quasi-linguistic gestures or propositional gestures. Illustrators include "iconic gestures" illustrating with the hand physical concrete objects or situations and "metaphoric gestures" representing abstract concepts. Illustrators are consciously used and consciously understood. ==> Pantomime: Gestures performed to mimic an action, usually emphasizing or modifying some aspects in a codified way to make it more easily recognizable and executable in the absence of accessories. Examples: mimic climbing a ladder, mimic pulling a rope, mimic drinking from a cup. Pantomimes are consciously used and consciously understood. ==> Sign Language: Gestures usually performed with one or both hands, sometimes with concurrent facial expressions, pertaining to a sign language, used to communicate silently between two or more people, usually from a relatively small distance. Examples: deaf sign language signs, signs for music notes or for numbers. Signs are consciously used and consciously understood. ==> Signals: A gesture usually performed with one or both arms and/or hands, used to signal, often from a distance, an event, danger, or actions to be performed. Examples: Marshaling signals, man-machine communication signals. Includes deictic gestures (finger pointing). Signals are consciously used and consciously understood.