RNNs/LSTMs and FINN #532
-
|
Hi everyone, I really appreciate the work you do with the FINN framework. I'm curious, does FINN support recurrent neural networks or LSTMs? If not, would the current FINN infrastructure theoretically allow it to be extended with recurrent layers? Many thanks, |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
Hi @fannymonori , unfortunately FINN does currently not support RNNs or LSTMs. However, in theory FINN can indeed be extended to support recurrent structures. And one would probably need to implement a few new HLS operators (see: https://github.com/Xilinx/finn/blob/main/notebooks/advanced/2_custom_op.ipynb ) and transformation passes (see: https://github.com/Xilinx/finn/blob/main/notebooks/advanced/1_custom_transformation_pass.ipynb ). Along with the required development for the actual HLS functions this undertaking would be quite involved, but possible. Cheers, |
Beta Was this translation helpful? Give feedback.
-
|
Thank you Hendrik! Your answer was helpful nonetheless. |
Beta Was this translation helpful? Give feedback.
Hi @fannymonori ,
unfortunately FINN does currently not support RNNs or LSTMs.
However, in theory FINN can indeed be extended to support recurrent structures. And one would probably need to implement a few new HLS operators (see: https://github.com/Xilinx/finn/blob/main/notebooks/advanced/2_custom_op.ipynb ) and transformation passes (see: https://github.com/Xilinx/finn/blob/main/notebooks/advanced/1_custom_transformation_pass.ipynb ). Along with the required development for the actual HLS functions this undertaking would be quite involved, but possible.
Cheers,
Hendrik