| Authors | Baradel*, Fabien; Armando, Matthieu; Galaaoui, Salma; Brégier, Romain; Weinzaepfel, Philippe; Rogez, Grégory; Lucas*, Thomas |
| Paper title | Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shot |
| Publication venue | arXiv |
| URL | https://github.com/naver/multi-hmr |
| Additional Information | Single shot method (detection & regression) taking as input a RGB image at resolution 1288x1288. A ViT-L/14 is used to encode the image, then we use our HPH module for regressing human properties. |
| Full set | Kid | ||
|---|---|---|---|
| F1 Score | 0.940 | F1 Score | 0.620 |
| Precision | 0.960 | Precision | 0.470 |
| Recall | 0.920 | Recall | 0.900 |
| Body | |||
|---|---|---|---|
| Full set | Kid | ||
| MPJPE | 60.300 | MPJPE | 71.300 |
| MVE | 59.600 | MVE | 72.000 |
| NMJE | 64.100 | NMJE | 115.000 |
| NMVE | 63.400 | NMVE | 116.100 |
| Face | |||
|---|---|---|---|
| Full set | Kid | ||
| MPJPE | 29.200 | MPJPE | 29.200 |
| MVE | 27.700 | MVE | 27.500 |
| Full body | |||
|---|---|---|---|
| Full set | Kid | ||
| MPJPE | 95.700 | MPJPE | 105.300 |
| MVE | 95.900 | MVE | 106.300 |
| NMJE | 101.800 | NMJE | 112.000 |
| NMVE | 102.000 | NMVE | 113.100 |
| Hands | |||
|---|---|---|---|
| Full set | Kid | ||
| left hand MPJPE | 38.100 | left hand MPJPE | 36.000 |
| left hand MVE | 40.200 | left hand MVE | 37.400 |
| right hand MPJPE | 39.000 | right hand MPJPE | 36.700 |
| right hand MVE | 40.900 | right hand MVE | 38.100 |