Reformer

Google Reformer

Another Google Gamechanger Explained

Yesterday I wrote about Google’s Reformer in Today I’m sharing some technical information how it is implemented in order to allow input size of 1M of tokes within 16GB of memory. There is a Jupyter notebook that enlights some information, available at https://colab.research.google.com/drive/1MYxvC4RbKeDzY2lFfesN-CvPLKLk00CQ?usp=sharing. Enjoy. ... Read More
Recent AI news

AI news after a while

There were no news on the site for a while since I didn’t find anything with wow effect. However, here are some recent news that occupied my attention. PEGASUS First is PEGASUS. It is Google’s abstractive summarization model, as described in short at More accademic and detailed description is available ... Read More