Deep Learning

Google Reformer

Another Google Gamechanger Explained

Yesterday I wrote about Google’s Reformer in Today I’m sharing some technical information how it is implemented in order to allow input size of 1M of tokes within 16GB of memory. There is a Jupyter notebook that enlights some information, available at https://colab.research.google.com/drive/1MYxvC4RbKeDzY2lFfesN-CvPLKLk00CQ?usp=sharing. Enjoy. ... Read More
Recent AI news

AI news after a while

There were no news on the site for a while since I didn’t find anything with wow effect. However, here are some recent news that occupied my attention. PEGASUS First is PEGASUS. It is Google’s abstractive summarization model, as described in short at More accademic and detailed description is available ... Read More
Facebook Chatbot

Tonight Talk with Facebook Chatbot

Facebook recently opensourced its Blender chatbot: I downloaded it, started it and had a short talk with it, as follows: Enter Your Message: hi there. how are you?[TransformerGenerator]: i ‘ m doing well . how about you ? what do you like to do in your spare time ?Enter Your ... Read More

Is PyTorch More Attractive Than TensorFlow?

PyThorch 1.5 is good. Also TensorFlow 2.x. But, did Google made several bad decisions with the initial design of Tensorflow, starting with beta and 1.x versions? Check the number of the downloads of each of the Deep NLP models available on ... Read More
AI news

What Happened Last Several Days in AI?

Hi I missed posting something about AI because I was swamped. In this post, I’ll share with you some of the new and exciting things that I noticed in the last several days. ACME First reinforcement learning framework I’ve ever heard, probably just arrived: And another thing from DeepMind open-sourced: ... Read More
GPT-3

GPT-3 … OMG

OpenIA released GPT-3. For the NLP enthusiasts it is not necessary to explain why does this matter 🙂 Anyway, few links on the toppic: Top editor’s note: Now it doesn’t need fine-tuning per specific task. They created a new milestone in NLP and AI in general. ... Read More
Pose Animator with TensorFlow for JS

Body Movements with TensorFlow

Want to see TensorFlow performing in realtime in the browser?See how it mimics your body movements with your image captured with webcam, in the browser. TensorFlow model up and running, with JS … ... Read More