Observing and Understanding Hands in Action

Program

Venue: Theresianum 606 (TUM). Directions here.

Sponsor: Facebook Reality Labs

13:30 – 13:45 Welcome and introduction

13:45 – 14:15 Real-time Capture of Hands in Motion with a Single Camera. Christian Theobalt (MPII, Saarland University)

14:15 – 14:45 Generation of Whole-Body Grasps for Humanoid Robots based on Human Motion Data and Natural Language Models. Tamim Asfour (KIT) [Slides]

14:45 – 15:25 Hands on HoloLens. Andrew Fitzgibbon (Microsoft)

15:25 – 16:15 Poster session and coffee break (Room 2605)

16:15 – 16:45 Hands and Interaction Tracking at Facebook. Robert Wang (Facebook Reality Labs)

16:45 – 17:15 Dense generative hand tracking with sphere-meshes. Andrea Tagliasacchi (University of Victoria and Google) [Slides]

17:15 – 17:30 Conclusion and prizes (best paper and best poster award).

Accepted papers:

• Hand-tremor frequency estimation in videos. Silvia L Pintea; Jian Zheng; Xilin Li; Paulina J.M. Bank; Jacobus J. van Hilten; Jan van Gemert.
• DrawInAir: A Lightweight Gestural Interface Based on Fingertip Regression. Gaurav Garg; Shrinidhi Hegde; Ramakrishna Perla; Varun Jain; Lovekesh Vig; Ramya Hebbalaguppe​.
• Adapting Egocentric Visual Hand Pose Estimation Towards a Robot-Controlled Exoskeleton. Gerald Baulig; Thomas Gulde; Cristobal Curio.
• Estimating 2D Multi-Hand Poses From Single Depth Images. Le Duan; Minmin Shen; Song Cui; Zhexiao Guo; Oliver Deussen.
• Spatial-Temporal Attention Res-TCN for Skeleton-based Dynamic Hand Gesture Recognition. Jingxuan Hou; Guijin Wang; Xinghao Chen; Jing-Hao Xue; Rui Zhu; Huazhong Yang.
• Task-Oriented Hand Motion Retargeting for Dexterous Manipulation Imitation. Dafni Antotsiou; Guillermo Garcia-Hernando; Tae-Kyun Kim.

Extended abstracts:

• Model-based Hand Pose Estimation for Generalized Hand Shape with Spatial Transformer Network. Shile Li; Jan Wöhlke; Dongheui Lee.
• A new dataset and human benchmark for partially-occluded hand-pose recognition during hand-object interactions from monocular RGB images. Andrei Barbu; Battushig Myanganbayar; Cristina Mata; Gil Dekel; Guy Ben-Yosef; Boris Katz.
• 3D Hand Pose Estimation from Monocular RGB Images using Advanced Conditional GAN. Linh Hoang Nguyen, Le Manh Quan; Yong-Guk Kim.

Invited posters:

• HandMap: Robust Hand Pose Estimation via Intermediate Dense Guidance Map Supervision. Xiaokun Wu; Daniel Finnegan; Eamonn O’Neill; Yong-Liang Yang.
• Point-to-Point Regression PointNet for 3D Hand Pose Estimation. Liuhao Ge; Zhou Ren; Junsong Yuan.
• Joint 3D tracking of a deformable object in interaction with a hand. Aggeliki Tsoli; Antonis Argyros.
• Occlusion-aware Hand Pose Estimation Using Hierarchical Mixture Density Network. Qi Ye; Tae-Kyun Kim.
• Hand Pose Estimation via Latent 2.5D Heatmap Regression. Umar Iqbal; Pavlo Molchanov; Thomas Breuel; Juergen Gall; Jan Kautz.
• Weakly-supervised 3D Hand Pose Estimation from Monocular RGB Images. Yujun Cai; Liuhao Ge; Jianfei Cai; Junsong Yuan.