The Attention is all you need’s paper revolutionized the world of Natural Language Processing and Transformer-based architecture became the de-facto standard for natural language processing tasks.

It was only a matter of time before someone would actually try to reach the state of the art in Computer Vision, with attention mechanism and transformer architectures.

A home for Data Science and Machine Learning. Share ideas and concepts with us.

Machine Learning Engineer | R&D and Intelligence | Sign up: https://alessandroai.medium.com/membership