Another Google Gamechanger Explained

Google Reformer

Google Reformer


Yesterday I wrote about Google’s Reformer in

AI news after a while

Today I’m sharing some technical information how it is implemented in order to allow input size of 1M of tokes within 16GB of memory.

There is a Jupyter notebook that enlights some information, available at https://colab.research.google.com/drive/1MYxvC4RbKeDzY2lFfesN-CvPLKLk00CQ?usp=sharing.

The Reformer – Pushing the limits of language modeling

Enjoy.

No comment

Leave a Reply

Your email address will not be published. Required fields are marked *

two × one =