Another Google Gamechanger Explained

Google Reformer

Google Reformer

Yesterday I wrote about Google’s Reformer in

AI news after a while

Today I'm sharing some technical information how it is implemented in order to allow input size of 1M of tokes within 16GB of memory.

There is a Jupyter notebook that enlights some information, available at

The Reformer - Pushing the limits of language modeling


No comment

Leave a Reply

Your email address will not be published. Required fields are marked *