Posts Deep Learning NLP

NLP

Natural Language Processing. Chatbots, text generators, etc.

about gpt-3 again

About GPT-3. Again.

Admin
There is a lot of hype about GPT-3 since it appeared. Everybody was so excited about its results. It doesn’t need fine-tuning for some specific task, which is quite an impressive result. Also, it is very good at writing poems, writing code, and SQL queries at the same time. Isn’t ... Read More
Chatbot

Facebook Blender

Admin
I’m playing a lot these days with chatbots. I fount this link interesting: About my own experience with Blender: ... Read More
Size does Matter

Size Does Matter

Admin
Introduction In a word of NLP and language models, size does matter. Literally, the bigger is better. Since the appearance of transformers on the NLP horizon, they became a de facto synonym for successful language model implementation, shadowing usage of recurrent neural networks, and LSTM. NLP got their equivalent of ... Read More
GPT-2 Automatic Code Generation

GPT-2 Writing Python Code

Admin
GPT-2 pretrained wih code on GitHub can write code by itself as autocomplete functionality. Watch the video: Just think about GPT-3 scale code generator 🙂 Sounds scarry to me … ... Read More
Facebook Chatbot

Tonight Talk with Facebook Chatbot

Admin
Facebook recently opensourced its Blender chatbot: I downloaded it, started it and had a short talk with it, as follows: Enter Your Message: hi there. how are you?[TransformerGenerator]: i ‘ m doing well . how about you ? what do you like to do in your spare time ?Enter Your ... Read More
GPT-3

GPT-3 … OMG

Admin
OpenIA released GPT-3. For the NLP enthusiasts it is not necessary to explain why does this matter 🙂 Anyway, few links on the toppic: Top editor’s note: Now it doesn’t need fine-tuning per specific task. They created a new milestone in NLP and AI in general. ... Read More