Authors | Istvan Sarandi, Gerard Pons-Moll |
Paper title | Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimation |
Publication venue | NeurIPS |
URL | https://arxiv.org/abs/2407.07532 |
Additional Information | The model was trained on a large collection of datasets including SMPL(-X/+H) parametric body, 2D and 3D skeleton and DensePose annotations. After that, it was fine-tuned on AGORA. YOLOv8x is used as the detector, also fine-tuned on AGORA. |
Full set | Kid | ||
---|---|---|---|
F1 Score | 0.940 | F1 Score | 0.710 |
Precision | 0.970 | Precision | 0.600 |
Recall | 0.910 | Recall | 0.880 |
Body | |||
---|---|---|---|
Full set | Kid | ||
MPJPE | 58.200 | MPJPE | 56.500 |
MVE | 58.400 | MVE | 56.100 |
NMJE | 61.900 | NMJE | 79.600 |
NMVE | 62.100 | NMVE | 79.000 |
Face | |||
---|---|---|---|
Full set | Kid | ||
MPJPE | 28.500 | MPJPE | 21.500 |
MVE | 27.000 | MVE | 21.400 |
Full body | |||
---|---|---|---|
Full set | Kid | ||
MPJPE | 90.800 | MPJPE | 81.400 |
MVE | 92.700 | MVE | 81.900 |
NMJE | 96.600 | NMJE | 86.600 |
NMVE | 98.600 | NMVE | 87.100 |
Hands | |||
---|---|---|---|
Full set | Kid | ||
left hand MPJPE | 34.400 | left hand MPJPE | 25.900 |
left hand MVE | 37.900 | left hand MVE | 27.200 |
right hand MPJPE | 34.900 | right hand MPJPE | 27.400 |
right hand MVE | 38.100 | right hand MVE | 28.700 |