-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o- ChaLearn Gesture Data (CGD 2011) --- a 3D-video dataset of 50,000 gestures --- Copyright (C) ChaLearn December 2011 http://gesture.chalearn.org -- events@chalearn.org -o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o- DISCLAIMER: ALL INFORMATION, SOFTWARE, DOCUMENTATION, AND DATA ARE PROVIDED "AS-IS" BY CHALEARN, A CALIFORNIA NON-FOR-PROFIT. THE CONTRIBUTORS DISCLAIM ANY EXPRESSED OR IMPLIED WARRANTIES INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR ANY PARTICULAR PURPOSE, AND THE WARRANTY OF NON-INFRIGEMENT OF ANY THIRD PARTY'S INTELLECTUAL PROPERTY RIGHTS. IN NO EVENT SHALL ISABELLE GUYON AND/OR OTHER CONTRIBUTORS BE LIABLE FOR ANY SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES WHATSOEVER ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF DATA, SOFTWARE, DOCUMENTS,MATERIALS, PUBLICATIONS, OR INFORMATION MADE AVAILABLE FOR THE CHALLENGE. -o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o- This dataset was created for the ChaLearn Gesture Challenge http://gesture.chalearn.org. It usage is not restricted to the challenge participants. The data may be used for other non-commercial research purposes. Permission to use the data for commercial purposes must be requested at events@chalearn.org. Redistribution of the data in its original or modified form must be accompanied by this notice. If you want to cite the data, please use: "ChaLearn Gesture Dataset (CGD2011), ChaLearn, California, 2011" -o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o- DATA: We are portraying a single user facing a fixed Kinect (TM) camera, interacting with a computer by performing gestures, e.g. playing a game, remotely controlling an appliance or a robot, or learning to perform gestures from an educational software. We recorded simultaneously videos with RGB and depth images (representing the distance of the objects to the camera). This release of the data includes 500 batches of 100 gestures, hence includes 50,000 gestures. The data are organized in subdirectories "typeXX", corresponding to "baches", where type is either "devel" of "valid" and XX is a number from 1 to 480. The prefix "devel" means that the data may be used for development purpose in the gesture challenge: we provide all truth labels for such data. The prefix "valid" means that the data may be used for validation: we provide only the training labels. The prediction results may be submitted to the website of the challenge to get feed-back on performance. Each data "batch" includes the recordings of 100 gestures as RGB videos (M_x.avi) and depth videos (K_x.avi) recorded with a Kinect (TM) camera.There are 47 pairs of {M_x.avi, K_x.avi} movies, including sequences of 1 to 5 gestures. The gestures in one batch are performed by a single user. They are instances of N unique gestures from a vocabulary of 8 to 15 gestures. The training labels are in a comma separated file called typeXX_train.csv and the test labels in typeXX_test.csv. There is a single labeled training example of each gestures of the vocabulary in a given batch. The goal of the challenge is, for each batch, to train a system on the training examples, and to make predictions of the labels for the test examples. The test labels in the validation batches are withheld. Additional batches finalXX will be provided for final testing. VIDEO FORMAT: The videos are formatted in lossy-compressed AVI format. The compression was performed with FFMPEG http://ffmpeg.org/, using: ffmpeg -i ' original.avi -qscale C compressed.avi We used C=10 for M files and C=15 for K files. To obtain files compressed in a quasi-lossless compressed AVI format using: ffmpeg -i -sameq compressed.avi please contact the organizers at events@chalearn.org. Compressed file can be read with one of many readers available for free, including SMplayer http://smplayer.org/. From Matlab, you may use mmreader or mmread. We provide sample Matlab code on the website of the challenge. Note that earlier versions of the sample code limited the file numbers to 20. Change line 88 of read_file.m from if nn2<1 || nn2>20 to if nn2<1 to lift this limitation. The Kinect depth images were produced after a normalization f(x)=(x-mini)/(maxi-mini), where mini is the minimum distance to the camera and maxi the maximum distance to the camera for an entire batch. To restore the data from the AVI files use: 1) Average the R,G, and B values to get a value v. 2) Perform v/255*(maxi-mini)+mini The table of normalization constants is given at the end of this document. -o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o-|-o- TABLE OF NORMALIZATION CONSTANTS mini: Minimum distance to the camera. maxi: Maximum distance to the camera. acc: Accuracy with which the depth is known: (0) Mediocre. (1) Good. (2) Very good. Depending on the version of our recording software. miss: Number of missing files. Note: All validation files and all final evaluation file (to be distributed later) have acc=2. set num mini maxi acc miss devel 1 801 1964 2 0 devel 2 801 1968 1 0 devel 3 801 1506 1 0 devel 4 801 1869 1 0 devel 5 824 1964 2 0 devel 6 832 1931 2 0 devel 7 928 3115 2 0 devel 8 801 1483 2 0 devel 9 801 3115 2 0 devel 10 895 1458 2 0 devel 11 914 1975 2 0 devel 12 801 1848 2 0 devel 13 801 1607 2 0 devel 14 801 1438 1 0 devel 15 921 1645 2 0 devel 16 834 1728 2 0 devel 17 801 1556 2 0 devel 18 801 2061 1 0 devel 19 801 1771 1 0 devel 20 809 2505 2 0 valid 1 801 2174 2 0 valid 2 801 3059 2 0 valid 3 801 1998 2 0 valid 4 879 2259 2 0 valid 5 888 2580 2 0 valid 6 1809 3975 2 0 valid 7 801 1998 2 0 valid 8 801 2147 2 0 valid 9 805 1711 2 0 valid 10 870 1745 2 0 valid 11 855 2033 2 0 valid 12 801 1563 2 0 valid 13 801 2174 2 0 valid 14 803 1868 2 0 valid 15 822 1719 2 0 valid 16 836 2082 2 0 valid 17 959 1931 2 0 valid 18 916 1711 2 0 valid 19 801 1502 2 0 valid 20 813 1909 2 0 devel 21 801 1987 1 0 devel 22 872 1920 2 0 devel 23 801 2287 1 0 devel 24 801 1899 2 0 devel 25 801 1782 1 0 devel 26 801 1842 1 0 devel 27 801 2160 2 0 devel 28 1048 1792 0 0 devel 29 836 1774 0 0 devel 30 801 1615 1 0 devel 31 801 2153 1 0 devel 32 801 2045 2 0 devel 33 801 2680 2 0 devel 34 801 3016 1 0 devel 35 801 1828 2 0 devel 36 808 1756 0 0 devel 37 840 2857 2 0 devel 38 952 1909 2 0 devel 39 801 1496 2 0 devel 40 816 1770 0 0 devel 41 801 1702 2 0 devel 42 801 1645 2 0 devel 43 857 2082 2 0 devel 44 801 1602 1 0 devel 45 801 3471 1 0 devel 46 866 1677 2 0 devel 47 801 1763 2 0 devel 48 1001 2069 2 0 devel 49 881 1711 2 0 devel 50 801 2535 1 0 devel 51 818 1941 2 0 devel 52 801 1979 1 0 devel 53 801 2033 2 0 devel 54 801 1765 1 0 devel 55 801 1776 1 0 devel 56 824 1844 0 0 devel 57 801 2201 2 0 devel 58 801 2142 1 0 devel 59 801 1418 1 0 devel 60 801 2045 2 0 devel 61 844 1888 2 0 devel 62 801 1449 1 0 devel 63 801 2599 2 0 devel 64 801 2069 2 0 devel 65 842 1677 2 0 devel 66 941 2021 2 0 devel 67 803 1819 2 0 devel 68 838 2045 2 0 devel 69 801 1762 1 0 devel 70 815 2560 2 0 devel 71 838 2834 2 0 devel 72 801 2089 1 0 devel 73 801 1998 2 0 devel 74 801 1899 2 0 devel 75 801 2133 2 0 devel 76 838 2659 2 0 devel 77 801 1757 1 0 devel 78 801 1622 2 0 devel 79 801 2580 2 0 devel 80 807 1920 2 0 devel 81 801 2091 1 0 devel 82 801 1483 2 0 devel 83 801 1952 2 0 devel 84 801 1711 2 0 devel 85 801 1815 1 0 devel 86 939 2082 2 0 devel 87 864 1776 0 0 devel 88 801 1848 1 0 devel 89 832 1752 0 0 devel 90 801 1496 2 0 devel 91 801 2781 1 0 devel 92 801 1899 2 0 devel 93 801 1348 1 0 devel 94 801 2230 2 0 devel 95 801 2040 1 0 devel 96 801 2525 1 0 devel 97 801 2045 2 0 devel 98 801 3714 1 0 devel 99 801 2765 1 0 devel 100 801 1815 1 0 devel 101 801 1615 2 0 devel 102 801 1600 2 0 devel 103 801 2289 2 0 devel 104 801 1571 1 0 devel 105 816 1998 2 0 devel 106 801 1998 1 0 devel 107 801 2203 1 0 devel 108 801 2442 1 0 devel 109 801 1899 1 0 devel 110 897 1607 2 0 devel 111 801 2046 1 0 devel 112 803 1964 2 0 devel 113 801 1622 2 0 devel 114 879 2045 2 0 devel 115 812 1774 0 0 devel 116 826 2033 2 0 devel 117 807 2033 2 0 devel 118 801 1684 1 0 devel 119 801 2230 2 0 devel 120 801 2174 2 0 devel 121 801 2003 1 0 devel 122 801 2670 1 0 devel 123 801 2094 1 0 devel 124 801 3033 2 0 devel 125 801 1910 1 0 devel 126 801 1927 1 0 devel 127 801 1552 1 0 devel 128 801 1912 1 0 devel 129 830 1909 2 0 devel 130 801 1549 2 0 devel 131 801 2003 1 0 devel 132 801 2196 1 0 devel 133 801 3738 1 0 devel 134 801 2015 1 0 devel 135 801 3256 1 0 devel 136 890 1986 2 0 devel 137 801 4005 1 0 devel 138 801 3004 1 0 devel 139 801 1483 2 0 devel 140 801 1656 1 0 devel 141 824 1890 0 0 devel 142 801 3362 1 0 devel 143 801 2553 1 0 devel 144 811 2580 2 0 devel 145 809 1868 2 0 devel 146 801 3242 1 0 devel 147 801 1686 2 0 devel 148 801 1891 1 0 devel 149 877 2619 2 0 devel 150 863 1964 2 0 devel 151 801 1998 2 0 devel 152 801 1547 1 0 devel 153 818 1772 2 0 devel 154 855 1719 2 0 devel 155 801 2009 2 0 devel 156 853 2009 2 0 devel 157 801 3640 2 0 devel 158 828 2639 2 0 devel 159 801 3928 1 0 devel 160 962 1754 2 0 devel 161 962 1888 2 0 devel 162 812 1755 0 0 devel 163 801 1458 1 0 devel 164 801 1809 1 0 devel 165 801 1608 1 0 devel 166 866 2542 2 0 devel 167 801 1502 2 0 devel 168 801 1904 1 0 devel 169 830 2082 2 0 devel 170 801 1630 2 0 devel 171 801 1634 1 0 devel 172 801 1621 1 0 devel 173 801 1607 2 0 devel 174 801 1615 2 0 devel 175 801 2027 1 0 devel 176 801 1825 1 0 devel 177 801 1909 2 0 devel 178 874 1607 2 0 devel 179 853 1964 2 0 devel 180 895 2680 2 0 devel 181 859 2045 2 0 devel 182 801 2003 1 0 devel 183 801 1628 1 0 devel 184 801 1920 2 0 devel 185 902 1868 2 0 devel 186 842 1763 2 0 devel 187 801 2230 2 0 devel 188 801 2446 1 0 devel 189 801 2151 1 0 devel 190 801 2045 2 0 devel 191 959 2107 2 0 devel 192 801 1922 1 0 devel 193 801 2052 1 0 devel 194 801 2122 1 0 devel 195 801 1615 1 0 devel 196 801 1702 2 0 devel 197 801 1998 2 0 devel 198 801 1622 2 0 devel 199 801 2815 1 0 devel 200 995 2082 2 0 devel 201 892 1975 2 0 devel 202 998 1878 2 0 devel 203 801 2201 2 0 devel 204 801 1608 1 0 devel 205 801 2321 1 0 devel 206 855 2335 2 0 devel 207 959 2009 2 0 devel 208 1086 2045 2 0 devel 209 855 1711 2 0 devel 210 801 1899 2 0 devel 211 801 1524 1 0 devel 212 842 1638 2 0 devel 213 801 2980 2 0 devel 214 801 1844 1 0 devel 215 801 1610 1 0 devel 216 801 1983 1 0 devel 217 801 1900 1 0 devel 218 805 1645 2 0 devel 219 801 1615 1 0 devel 220 904 1728 2 0 devel 221 801 2644 1 0 devel 222 838 1745 2 0 devel 223 801 1630 2 0 devel 224 851 1790 2 0 devel 225 801 1630 2 0 devel 226 801 1952 2 0 devel 227 801 1459 1 0 devel 228 973 2082 2 0 devel 229 801 1615 2 0 devel 230 852 1749 0 0 devel 231 801 2108 1 0 devel 232 801 1507 1 0 devel 233 921 1909 2 0 devel 234 801 2209 1 0 devel 235 801 1800 2 0 devel 236 801 1645 2 0 devel 237 801 1630 2 0 devel 238 801 1615 1 0 devel 239 815 1549 2 0 devel 240 801 1986 2 0 devel 241 801 1622 2 0 devel 242 801 1585 2 0 devel 243 801 3439 1 0 devel 244 801 1802 1 0 devel 245 809 1986 2 0 devel 246 801 2150 1 0 devel 247 801 1828 2 0 devel 248 990 1838 2 0 devel 249 801 1828 2 0 devel 250 801 3056 1 0 devel 251 826 1952 2 0 devel 252 801 2185 1 0 devel 253 801 1697 1 0 devel 254 886 2069 2 0 devel 255 801 1986 2 0 devel 256 801 2230 2 0 devel 257 801 3143 2 0 devel 258 801 2403 1 0 devel 259 803 1669 2 0 devel 260 801 1553 1 0 devel 261 836 2351 2 0 devel 262 801 1542 2 0 devel 263 897 1728 2 0 devel 264 801 4005 1 0 devel 265 801 2598 1 0 devel 266 801 1622 1 0 devel 267 840 2722 2 0 devel 268 904 1986 2 0 devel 269 801 1622 1 0 devel 270 879 2639 2 0 devel 271 847 1758 0 0 devel 272 801 2569 1 0 devel 273 803 1920 2 0 devel 274 801 1949 1 0 devel 275 824 2120 2 0 devel 276 843 1752 0 0 devel 277 801 1986 2 0 devel 278 801 1787 1 0 devel 279 801 3854 1 0 devel 280 984 1858 2 0 devel 281 801 2082 2 0 devel 282 801 2792 1 0 devel 283 801 1728 2 0 devel 284 801 2102 1 0 devel 285 801 1795 1 0 devel 286 801 1608 1 0 devel 287 801 1894 1 0 devel 288 801 2027 1 0 devel 289 807 1998 2 0 devel 290 801 1828 2 0 devel 291 801 3049 1 0 devel 292 801 1653 2 0 devel 293 921 2082 2 0 devel 294 801 2346 1 0 devel 295 801 2045 2 0 devel 296 801 1811 1 0 devel 297 801 1879 1 0 devel 298 820 1998 2 0 devel 299 801 1541 1 0 devel 300 801 2374 1 0 devel 301 801 1458 2 0 devel 302 801 2083 1 0 devel 303 811 2120 2 0 devel 304 818 1711 2 0 devel 305 813 2095 2 0 devel 306 801 2033 2 0 devel 307 853 1790 2 0 devel 308 801 1728 2 0 devel 309 842 1770 0 0 devel 310 801 1602 1 0 devel 311 801 2033 2 0 devel 312 1016 2033 2 0 devel 313 836 2069 2 0 devel 314 895 1838 2 0 devel 315 801 2424 1 0 devel 316 801 1808 1 0 devel 317 801 2095 2 0 devel 318 801 1838 2 0 devel 319 828 1878 2 0 devel 320 801 1645 2 0 devel 321 803 2619 2 0 devel 322 801 1802 1 0 devel 323 801 1571 1 0 devel 324 801 2905 2 0 devel 325 801 2722 2 0 devel 326 1040 2120 2 0 devel 327 822 1774 0 0 devel 328 859 1719 2 0 devel 329 801 1888 2 0 devel 330 801 2304 2 0 devel 331 801 1904 1 0 devel 332 801 1838 2 0 devel 333 801 1975 2 0 devel 334 801 1814 1 0 devel 335 801 1764 1 0 devel 336 801 1795 1 0 devel 337 801 2580 2 0 devel 338 801 3191 1 0 devel 339 801 1848 2 0 devel 340 801 1809 1 0 devel 341 801 1848 2 0 devel 342 801 2107 2 0 devel 343 801 2788 2 0 devel 344 801 1968 1 0 devel 345 810 2126 0 0 devel 346 801 1711 1 0 devel 347 801 1809 1 0 devel 348 801 1529 1 0 devel 349 801 1645 2 0 devel 350 801 1809 1 0 devel 351 808 1928 0 0 devel 352 801 2276 1 0 devel 353 801 2021 2 0 devel 354 801 1547 1 0 devel 355 801 2174 2 0 devel 356 801 2453 1 0 devel 357 801 1818 1 0 devel 358 801 2147 1 0 devel 359 801 2003 1 0 devel 360 801 2680 2 0 devel 361 801 2580 2 0 devel 362 1069 1848 2 0 devel 363 801 1888 2 0 devel 364 916 1868 2 0 devel 365 801 1772 2 0 devel 366 801 1899 2 0 devel 367 801 1615 1 0 devel 368 801 1645 2 0 devel 369 1084 1751 0 0 devel 370 897 2351 2 0 devel 371 801 2734 1 0 devel 372 801 1755 1 0 devel 373 874 1964 2 0 devel 374 801 1571 2 0 devel 375 801 2317 1 0 devel 376 801 1986 2 0 devel 377 902 2069 2 0 devel 378 801 1986 2 0 devel 379 801 1524 1 0 devel 380 801 4005 1 0 devel 381 801 2107 2 0 devel 382 801 2033 2 0 devel 383 801 1904 1 0 devel 384 909 1986 2 0 devel 385 801 1553 1 0 devel 386 801 1986 2 0 devel 387 962 2082 2 0 devel 388 840 1874 0 0 devel 389 801 1615 1 0 devel 390 801 1458 2 0 devel 391 801 1960 1 0 devel 392 801 2422 1 0 devel 393 801 1978 1 0 devel 394 801 2957 1 0 devel 395 801 3058 1 0 devel 396 801 2057 2 0 devel 397 830 2881 2 0 devel 398 801 1674 1 0 devel 399 801 2097 1 0 devel 400 801 2133 2 0 devel 401 904 1719 2 0 devel 402 805 1858 2 0 devel 403 801 1809 1 0 devel 404 801 2384 2 0 devel 405 801 2722 2 0 devel 406 965 2009 2 0 devel 407 801 2120 2 0 devel 408 801 1828 2 0 devel 409 801 1621 1 0 devel 410 801 1930 1 0 devel 411 801 1998 2 0 devel 412 801 1899 2 0 devel 413 801 1556 2 0 devel 414 826 1748 0 0 devel 415 801 2461 1 0 devel 416 801 2234 1 0 devel 417 801 1952 2 0 devel 418 801 1828 2 0 devel 419 859 1719 2 0 devel 420 828 2639 2 0 devel 421 801 3522 1 0 devel 422 801 1825 1 0 devel 423 895 1868 2 0 devel 424 801 1800 2 0 devel 425 801 2516 1 0 devel 426 801 1702 2 0 devel 427 801 1541 1 0 devel 428 801 1625 1 0 devel 429 826 1956 0 0 devel 430 801 1808 1 0 devel 431 801 1983 1 0 devel 432 801 1736 2 0 devel 433 952 1800 2 0 devel 434 815 1645 2 0 devel 435 801 2033 2 0 devel 436 801 2259 2 0 devel 437 801 1711 2 0 devel 438 801 1998 2 0 devel 439 801 2357 1 0 devel 440 861 2857 2 0 devel 441 801 1924 1 0 devel 442 801 2009 2 0 devel 443 801 1583 1 0 devel 444 801 3471 1 0 devel 445 801 2297 1 0 devel 446 801 2168 1 0 devel 447 801 1916 1 0 devel 448 801 3783 1 0 devel 449 866 2069 2 0 devel 450 801 1828 2 0 devel 451 801 1983 1 0 devel 452 801 1802 1 0 devel 453 801 2045 2 0 devel 454 801 1694 2 0 devel 455 803 2009 2 0 devel 456 849 2045 2 0 devel 457 801 1809 1 0 devel 458 874 2335 2 0 devel 459 844 1888 2 0 devel 460 902 2021 2 0 devel 461 801 2580 2 0 devel 462 801 1795 1 0 devel 463 801 2098 1 0 devel 464 801 1528 1 0 devel 465 801 3115 2 0 devel 466 816 1776 0 0 devel 467 801 1727 1 0 devel 468 801 3928 1 0 devel 469 801 1509 2 0 devel 470 801 2234 1 0 devel 471 801 2111 1 0 devel 472 801 1547 1 0 devel 473 801 1809 1 0 devel 474 801 1795 1 0 devel 475 801 2560 2 0 devel 476 801 1489 1 1 devel 477 801 2819 1 1 devel 478 801 1944 1 1 devel 479 801 1745 1 1 devel 480 801 1885 1 3