NLP

Natural Language Processing. Chatbots, text generators, etc.

zero shot learning

Zero-Shot Text Classification

Introduction: The stone-age AI Era In the beginning, in the AI stone-age era, you take several thousands of observations and train an old-style fully-connected neural network, And, if you were happy, you would have something useful. That time of training our own neural networks is done a long time ago, ... Read More
nlp, transformers and adapter

AdapterHub: New Kid on the Block for Transfer Learning

Introduction First, there was a BERT, at least all of this started with it. It is a general-purpose language model, once pre-trained for different languages and in different size variations. If you wanted to use it for some specific task, you should fine-tune it in a way that you take ... Read More
about gpt-3 again

About GPT-3. Again.

There is a lot of hype about GPT-3 since it appeared. Everybody was so excited about its results. It doesn’t need fine-tuning for some specific task, which is quite an impressive result. Also, it is very good at writing poems, writing code, and SQL queries at the same time. Isn’t ... Read More
Chatbot

Facebook Blender

I’m playing a lot these days with chatbots. I fount this link interesting: About my own experience with Blender: ... Read More
Size does Matter

Size Does Matter

Introduction In a word of NLP and language models, size does matter. Literally, the bigger is better. Since the appearance of transformers on the NLP horizon, they became a de facto synonym for successful language model implementation, shadowing usage of recurrent neural networks, and LSTM. NLP got their equivalent of ... Read More
GPT-2 Automatic Code Generation

GPT-2 Writing Python Code

GPT-2 pretrained wih code on GitHub can write code by itself as autocomplete functionality. Watch the video: Just think about GPT-3 scale code generator 🙂 Sounds scarry to me … ... Read More
Facebook Chatbot

Tonight Talk with Facebook Chatbot

Facebook recently opensourced its Blender chatbot: I downloaded it, started it and had a short talk with it, as follows: Enter Your Message: hi there. how are you?[TransformerGenerator]: i ‘ m doing well . how about you ? what do you like to do in your spare time ?Enter Your ... Read More
GPT-3

GPT-3 … OMG

OpenIA released GPT-3. For the NLP enthusiasts it is not necessary to explain why does this matter 🙂 Anyway, few links on the toppic: Top editor’s note: Now it doesn’t need fine-tuning per specific task. They created a new milestone in NLP and AI in general. ... Read More