Visual Transformer

[gabrieltorresgamez]

Eine Idee wäre auch Visual Transformer anzuwenden.

In vision, attention is either applied in conjunction with convolutional networks, or used to replace certain components of convolutional networks while keeping their overall structure in place. We show that this reliance on CNNs is not necessary and a pure transformer applied directly to sequences of image patches can perform very well on image classification tasks.

https://arxiv.org/abs/2010.11929v2
https://paperswithcode.com/method/vision-transformer