2020

Google Reformer

Another Google Gamechanger Explained

Yesterday I wrote about Google’s Reformer in Today I’m sharing some technical information how it is implemented in order to allow input size of 1M of tokes within 16GB of memory. There is a Jupyter notebook that enlights some information, available at https://colab.research.google.com/drive/1MYxvC4RbKeDzY2lFfesN-CvPLKLk00CQ?usp=sharing. Enjoy. ... Read More
AI and consciousness

Can AI be conscious?

A little bit of a philosophical debate, but from the guys with a strong mathematical background, so probably they know what are they talking about, although I like philosophy as well 🙂 ... Read More
Recent AI news

AI news after a while

There were no news on the site for a while since I didn’t find anything with wow effect. However, here are some recent news that occupied my attention. PEGASUS First is PEGASUS. It is Google’s abstractive summarization model, as described in short at More accademic and detailed description is available ... Read More
Strimlit Library

Streamlit

If you are a data scientist who doesn’t want to spend time on creating a website, and you still wish to show the results of your work, this is perfect for you: Check it out. I’m alrady using it 🙂 ... Read More
Facebook Chatbot

Tonight Talk with Facebook Chatbot

Facebook recently opensourced its Blender chatbot: I downloaded it, started it and had a short talk with it, as follows: Enter Your Message: hi there. how are you?[TransformerGenerator]: i ‘ m doing well . how about you ? what do you like to do in your spare time ?Enter Your ... Read More
Minority Report

Remember Minority Report?

Do you remember Minority Report movie? Well, it is not that far away from now. But anyway, in USA they don’t make it on the right way … ... Read More

Is PyTorch More Attractive Than TensorFlow?

PyThorch 1.5 is good. Also TensorFlow 2.x. But, did Google made several bad decisions with the initial design of Tensorflow, starting with beta and 1.x versions? Check the number of the downloads of each of the Deep NLP models available on ... Read More
AI news

What Happened Last Several Days in AI?

Hi I missed posting something about AI because I was swamped. In this post, I’ll share with you some of the new and exciting things that I noticed in the last several days. ACME First reinforcement learning framework I’ve ever heard, probably just arrived: And another thing from DeepMind open-sourced: ... Read More
GPT-3

GPT-3 … OMG

OpenIA released GPT-3. For the NLP enthusiasts it is not necessary to explain why does this matter 🙂 Anyway, few links on the toppic: Top editor’s note: Now it doesn’t need fine-tuning per specific task. They created a new milestone in NLP and AI in general. ... Read More