Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

projected SMPL-X meshes don't overlay well in allocentric views #52

Closed
nehc0 opened this issue Sep 19, 2024 · 4 comments
Closed

projected SMPL-X meshes don't overlay well in allocentric views #52

nehc0 opened this issue Sep 19, 2024 · 4 comments

Comments

@nehc0
Copy link

nehc0 commented Sep 19, 2024

Hello. I use my custom visualization pipeline for allocentric views, transforming the SMPL-X mesh vertices from world coordinates to pixel assuming a pinhole camera model using the extrinsic and intrinsic matrices you provide in meta/misc.json. However, I observe that in some cases the projected meshes don't overlay well with the humans in images. Is it my problem?

Some examples:

[s01/box_use_02/6]
s01/box_use_02/6

[s01/espressomachine_grab_01/7]
s01/espressomachine_grab_01/7

[s08/capsulemachine_use_01/5]
s08/capsulemachine_use_01/5

@zc-alexfan
Copy link
Owner

Thanks for your question. Maybe you can test with my visualization because I also cannot see the issue here.

@nehc0
Copy link
Author

nehc0 commented Sep 23, 2024

Thanks for your question. Maybe you can test with my visualization because I also cannot see the issue here.

Did you crop image or apply distortion before visualization for allocentric views?

@zc-alexfan
Copy link
Owner

Distortion is not a main factor in allocentric view. My visualization script first loads the data and then apply the visualization. Maybe you can just try that data loader.

@nehc0
Copy link
Author

nehc0 commented Sep 25, 2024

Distortion is not a main factor in allocentric view. My visualization script first loads the data and then apply the visualization. Maybe you can just try that data loader.

Solved. I made a stupid mistake of using 'neutral' rather than gendered smplx for all meshes. After I fixed it, the rendered results seemed much more acceptable:

[s01/box_use_02/6-fix]
s01-box_use_02-6_fix

[s01/espressomachine_grab_01/7-fix]
s01-espressomachine_grab_01-7_fix

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants