MANO shape parameter of the left hand

[mks0601]

Hi Alex, how are you doing?
Thanks for your great dataset.
It seems there is a problem in the MANO shape parameter of the left hand.

The above is from left hand of s01 / box_grab_01 / 0 / 70.
I set all inputs to zero except the shape parameter, where MANO layer is initialized with flat_hand_mean=True for the visualization.
As you can see, although flat_hand_mean=True, finger is bent, which is caused by some weird MANO shape parameter.
This makes artifacts when posed like the below image.

This is from the same frame, but I passed all inputs to MANO layer including hand_pose.
As you can see, bent index finger becomes weird when posed.

I found that there is no problem for the right hand. Could you let me know why this happens?
BTW, do you know there is a bug in the shapedirs of the MANO left hand?
You can see the bug in here: vchoutas/smplx#48
Simply saying, when we pass the same shape parameter to the left/right MANO layer, output geometry looks very different.
We need to do mano_layer['left'].shapedirs[:,0,:] *= -1 fo fix this bug.
FYI, although I do mano_layer['left'].shapedirs[:,0,:] *= -1, I can't remove the bug. All the above figures are from MANO layer as it is without doing mano_layer['left'].shapedirs[:,0,:] *= -1.

[zc-alexfan]

Hi Gyeongsik,

Thanks for reaching out! Yes, recently, I also realized there was a bug in MANO left hand shape space (therefore, ARCTIC was fitted with this buggy left hand shape space). Given CVPR deadline, I cannot rerun mosh to correct this. However, maybe you can fit MANO to the SMPLX mesh? Hope this will address the issue.

[mks0601]

Awesome. Thanks for checking. See you at ECCV :)

[github-actions]

Stale issue message