The Speed of VITs and CNNs (eyer.be)
It is often stated that because of the quadratic self-attention, ViTs aren't practical at higher resolution.
Computer Vision, Artificial Intelligence, Deep Learning, CNNs, Vision Transformers
74 points by jxmorris12 22 days ago | 23 comments