Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The visual result is Upside Down via "plot_3d_global.py" and "plot_feature.py" #91

Open
Run542968 opened this issue Jul 4, 2024 · 6 comments

Comments

@Run542968
Copy link

Hi.
When I followed the instructions (i.e., ./tomato_represenation/README) to convert and visualize, I found that the visualized human body was upside down, and I'm not sure if it's a problem with plot.py or motion-representation.py.

Can you give me some advice? Thank you very much!

example_vis

@Run542968
Copy link
Author

I used other plot.py methods, but the visualization results are still upside down, indicating that there may be an issue with motion_representation.py.

@www-Ye
Copy link

www-Ye commented Jul 29, 2024

I used other plot.py methods, but the visualization results are still upside down, indicating that there may be an issue with motion_representation.py.

Hello, have you solved the problem of inverted drawing? I noticed that the same inversion problem occurs when visualizing the preprocessed joints using plot_3d_global.py. Also, when visualizing some of the GRAB and EgoBody data, there is a state where people are suspended in the air.
EgoBody: image
GRAB: grab
Fitness: image

@Run542968
Copy link
Author

I used other plot.py methods, but the visualization results are still upside down, indicating that there may be an issue with motion_representation.py.

Hello, have you solved the problem of inverted drawing? I noticed that the same inversion problem occurs when visualizing the preprocessed joints using plot_3d_global.py. Also, when visualizing some of the GRAB and EgoBody data, there is a state where people are suspended in the air. EgoBody: image GRAB: grab grab Fitness: image

No, I choose to give up. Too many issues, including axis angle direction, incorrect labeling, and mismatched numbering.

@mkstmyk
Copy link

mkstmyk commented Oct 2, 2024

In my case (IDEA400), I solved the visualization as follows. Hope it helps.
#98 (comment)

@artpli
Copy link

artpli commented Nov 28, 2024

I used other plot.py methods, but the visualization results are still upside down, indicating that there may be an issue with motion_representation.py.

Hello, have you solved the problem of inverted drawing? I noticed that the same inversion problem occurs when visualizing the preprocessed joints using plot_3d_global.py. Also, when visualizing some of the GRAB and EgoBody data, there is a state where people are suspended in the air. EgoBody: image GRAB: grab

    [
      
        ![grab](https://private-user-images.githubusercontent.com/51852529/352991066-b7375799-2212-4954-8525-58538bea414e.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjIzMDc0ODQsIm5iZiI6MTcyMjMwNzE4NCwicGF0aCI6Ii81MTg1MjUyOS8zNTI5OTEwNjYtYjczNzU3OTktMjIxMi00OTU0LTg1MjUtNTg1MzhiZWE0MTRlLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MzAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzMwVDAyMzk0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBkNDZhNzE3NmMxYjI4NWVlOGIzODg5ODc5NmUwNDU1YzhlMDIxNWJkZjgxNjIyNmE5MTdmMWRhNDNiODViNTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.eOLjW_EivoP9JuM0o09E0ibfCx3siw9_uWdyO-EdJfo)
      
    ](https://private-user-images.githubusercontent.com/51852529/352991066-b7375799-2212-4954-8525-58538bea414e.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjIzMDc0ODQsIm5iZiI6MTcyMjMwNzE4NCwicGF0aCI6Ii81MTg1MjUyOS8zNTI5OTEwNjYtYjczNzU3OTktMjIxMi00OTU0LTg1MjUtNTg1MzhiZWE0MTRlLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MzAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzMwVDAyMzk0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBkNDZhNzE3NmMxYjI4NWVlOGIzODg5ODc5NmUwNDU1YzhlMDIxNWJkZjgxNjIyNmE5MTdmMWRhNDNiODViNTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.eOLjW_EivoP9JuM0o09E0ibfCx3siw9_uWdyO-EdJfo)
    
    
      
        
          
        
        
          
          
        
      
      [
        
          
        
      ](https://private-user-images.githubusercontent.com/51852529/352991066-b7375799-2212-4954-8525-58538bea414e.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjIzMDc0ODQsIm5iZiI6MTcyMjMwNzE4NCwicGF0aCI6Ii81MTg1MjUyOS8zNTI5OTEwNjYtYjczNzU3OTktMjIxMi00OTU0LTg1MjUtNTg1MzhiZWE0MTRlLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MzAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzMwVDAyMzk0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBkNDZhNzE3NmMxYjI4NWVlOGIzODg5ODc5NmUwNDU1YzhlMDIxNWJkZjgxNjIyNmE5MTdmMWRhNDNiODViNTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.eOLjW_EivoP9JuM0o09E0ibfCx3siw9_uWdyO-EdJfo)
    
   [ ![grab](https://private-user-images.githubusercontent.com/51852529/352991066-b7375799-2212-4954-8525-58538bea414e.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjIzMDc0ODQsIm5iZiI6MTcyMjMwNzE4NCwicGF0aCI6Ii81MTg1MjUyOS8zNTI5OTEwNjYtYjczNzU3OTktMjIxMi00OTU0LTg1MjUtNTg1MzhiZWE0MTRlLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MzAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzMwVDAyMzk0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBkNDZhNzE3NmMxYjI4NWVlOGIzODg5ODc5NmUwNDU1YzhlMDIxNWJkZjgxNjIyNmE5MTdmMWRhNDNiODViNTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.eOLjW_EivoP9JuM0o09E0ibfCx3siw9_uWdyO-EdJfo) ](https://private-user-images.githubusercontent.com/51852529/352991066-b7375799-2212-4954-8525-58538bea414e.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjIzMDc0ODQsIm5iZiI6MTcyMjMwNzE4NCwicGF0aCI6Ii81MTg1MjUyOS8zNTI5OTEwNjYtYjczNzU3OTktMjIxMi00OTU0LTg1MjUtNTg1MzhiZWE0MTRlLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MzAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzMwVDAyMzk0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBkNDZhNzE3NmMxYjI4NWVlOGIzODg5ODc5NmUwNDU1YzhlMDIxNWJkZjgxNjIyNmE5MTdmMWRhNDNiODViNTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.eOLjW_EivoP9JuM0o09E0ibfCx3siw9_uWdyO-EdJfo)
  
    [
      
        ![grab](https://private-user-images.githubusercontent.com/51852529/352991066-b7375799-2212-4954-8525-58538bea414e.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjIzMDc0ODQsIm5iZiI6MTcyMjMwNzE4NCwicGF0aCI6Ii81MTg1MjUyOS8zNTI5OTEwNjYtYjczNzU3OTktMjIxMi00OTU0LTg1MjUtNTg1MzhiZWE0MTRlLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MzAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzMwVDAyMzk0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBkNDZhNzE3NmMxYjI4NWVlOGIzODg5ODc5NmUwNDU1YzhlMDIxNWJkZjgxNjIyNmE5MTdmMWRhNDNiODViNTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.eOLjW_EivoP9JuM0o09E0ibfCx3siw9_uWdyO-EdJfo)
      
    ](https://private-user-images.githubusercontent.com/51852529/352991066-b7375799-2212-4954-8525-58538bea414e.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjIzMDc0ODQsIm5iZiI6MTcyMjMwNzE4NCwicGF0aCI6Ii81MTg1MjUyOS8zNTI5OTEwNjYtYjczNzU3OTktMjIxMi00OTU0LTg1MjUtNTg1MzhiZWE0MTRlLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MzAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzMwVDAyMzk0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBkNDZhNzE3NmMxYjI4NWVlOGIzODg5ODc5NmUwNDU1YzhlMDIxNWJkZjgxNjIyNmE5MTdmMWRhNDNiODViNTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.eOLjW_EivoP9JuM0o09E0ibfCx3siw9_uWdyO-EdJfo)
    
    
      
        
          
        
        
          
          
        
      
      [
        
          
        
      ](https://private-user-images.githubusercontent.com/51852529/352991066-b7375799-2212-4954-8525-58538bea414e.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjIzMDc0ODQsIm5iZiI6MTcyMjMwNzE4NCwicGF0aCI6Ii81MTg1MjUyOS8zNTI5OTEwNjYtYjczNzU3OTktMjIxMi00OTU0LTg1MjUtNTg1MzhiZWE0MTRlLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MzAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzMwVDAyMzk0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBkNDZhNzE3NmMxYjI4NWVlOGIzODg5ODc5NmUwNDU1YzhlMDIxNWJkZjgxNjIyNmE5MTdmMWRhNDNiODViNTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.eOLjW_EivoP9JuM0o09E0ibfCx3siw9_uWdyO-EdJfo)
    
   [ ](https://private-user-images.githubusercontent.com/51852529/352991066-b7375799-2212-4954-8525-58538bea414e.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjIzMDc0ODQsIm5iZiI6MTcyMjMwNzE4NCwicGF0aCI6Ii81MTg1MjUyOS8zNTI5OTEwNjYtYjczNzU3OTktMjIxMi00OTU0LTg1MjUtNTg1MzhiZWE0MTRlLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MzAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzMwVDAyMzk0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBkNDZhNzE3NmMxYjI4NWVlOGIzODg5ODc5NmUwNDU1YzhlMDIxNWJkZjgxNjIyNmE5MTdmMWRhNDNiODViNTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.eOLjW_EivoP9JuM0o09E0ibfCx3siw9_uWdyO-EdJfo) Fitness: ![image](https://private-user-images.githubusercontent.com/51852529/352991137-8f9d2bfd-c4a7-4441-819f-298ee779b7d3.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjIzMDc0ODQsIm5iZiI6MTcyMjMwNzE4NCwicGF0aCI6Ii81MTg1MjUyOS8zNTI5OTExMzctOGY5ZDJiZmQtYzRhNy00NDQxLTgxOWYtMjk4ZWU3NzliN2QzLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MzAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzMwVDAyMzk0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWJlYzY4NTg2NjQwNWJmZjc1Mzk2OTYzN2FkMzExNGRkN2NhMjAwOGJhZWNlMTA3ZGRhODI2M2Q0ZTgwMGJiYjgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.S1QMcPvphG1GTSMs83B8Fg2UHCMUwKk4YAyd1FaBGjE)

No, I choose to give up. Too many issues, including axis angle direction, incorrect labeling, and mismatched numbering.

SHAME ON THEM : )

@zhangyuhong01
Copy link
Collaborator

zhangyuhong01 commented Dec 6, 2024

Apologies for the delayed response. I have been focused on another task recently. Which folder's motion data did you use for visualization? The 'plot_3d_global.py' and 'plot_feature.py' are only compatible with the smplx322 from the 'motion_generation' folder. We have uploaded the new version of the tomato-aligned motion data with normal visualization from Motion-X++ here.
Just to confirm, I have visualized all the sequences for check, and here are some examples.
from animation subset:
animation
from kungfu subset:
kungfu npy
from IDEA400 subset:
Heels_touch_each_other_during_walking_clip1 npy

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants