Skip to content

Latest commit

 

History

History
41 lines (35 loc) · 1.2 KB

README.md

File metadata and controls

41 lines (35 loc) · 1.2 KB

Unofficial PSB : Parallelized Spatiotemporal Binding

💪 Goal

This repo aims to reproduce and open the results obtained from "Parallelized Spatiotemporal Binding".

✅ TODO list :

  • Create README
  • Prepare issues labels

Model

  • Prepare the layers
  • Implement SAVi

Training

  • Prepare the training loop
  • Create a simple dataset (CLEVRER)
  • Launch a PSB training
  • Launch an original SAVi training
  • Compare the accuracies & the training times

Further experiments

  • Train the model on other datasets
  • Launch training on MOVi datasets

Improving the model ?

  • Combine with DINOSAUR/VIDEOSAUR

👍 Acknowledgment

This project builds upon the following work :

@misc{singh2024parallelizedspatiotemporalbinding,
      title={Parallelized Spatiotemporal Binding}, 
      author={Gautam Singh and Yue Wang and Jiawei Yang and Boris Ivanovic and Sungjin Ahn and Marco Pavone and Tong Che},
      year={2024},
      eprint={2402.17077},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2402.17077}, 
}

🔒License

This project is licensed under the MIT license.