| Authors | Baradel*, Fabien; Armando, Matthieu; Galaaoui, Salma; Brégier, Romain; Weinzaepfel, Philippe; Rogez, Grégory; Lucas*, Thomas |
| Paper title | Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shot |
| Publication venue | arXiv |
| URL | https://github.com/naver/multi-hmr |
| Additional Information | Single shot method (detection & regression) taking as input a RGB image at resolution 1288x1288. A ViT-L/14 is used to encode the image, then we use our HPH module for regressing human properties. |
| Full set | Kid | ||
|---|---|---|---|
| F1 Score | 0.900 | F1 Score | 0.660 |
| Precision | 0.970 | Precision | 0.570 |
| Recall | 0.840 | Recall | 0.780 |
| Body | |||
|---|---|---|---|
| Full set | Kid | ||
| MPJPE | 61.900 | MPJPE | 77.100 |
| MVE | 61.300 | MVE | 77.100 |
| NMJE | 68.800 | NMJE | 116.800 |
| NMVE | 68.100 | NMVE | 116.800 |
| Face | |||
|---|---|---|---|
| Full set | Kid | ||
| MPJPE | 26.000 | MPJPE | 25.700 |
| MVE | 25.100 | MVE | 24.600 |
| Full body | |||
|---|---|---|---|
| Full set | Kid | ||
| MPJPE | 93.200 | MPJPE | 106.800 |
| MVE | 93.600 | MVE | 108.200 |
| NMJE | 103.600 | NMJE | 118.700 |
| NMVE | 104.000 | NMVE | 120.200 |
| Hands | |||
|---|---|---|---|
| Full set | Kid | ||
| left hand MPJPE | 33.700 | left hand MPJPE | 30.200 |
| left hand MVE | 35.700 | left hand MVE | 32.800 |
| right hand MPJPE | 34.200 | right hand MPJPE | 33.300 |
| right hand MVE | 36.100 | right hand MVE | 36.000 |