2020 July

July 2020

Interesting AI Startups

Unknown but Innovative Cool and Scarry

Admin
AI innovation is not only AI research. And Google, DeepMind, Facebook, and OpenAI are not the only AI innovators. Innovation is also to find exciting use-cases where nobody looked for them yet, and scale them beyond imaginable. This article is about a few of the unknown, yet innovative companies with ... Read More
AI Programming Heroes

My AI Programming Heros During Corona Days

Admin
One Long Introduction Currently I’m working on Question and Answering system based on BERT. Some online resource for it: Since it’s announcement and open-sourcing, many optimizations and variations appeared. There are smaller but faster versions optimized for memory footprint and speed for mobile devices. Also, after some research, some variations ... Read More
MS AI news

Finally Something Interesting From Microsoft

Admin
Introduction It seemed to me that Google, Facebook, and OpenAI are the only ones that work out something in the AI area. Still, tech giants like Microsoft seem to work on something interesting as well. Recently Microsoft unveiled its Turing-NLG model with its 17B parameters, and it was the most ... Read More
Sexism and Racisam in AI

Sexism and Racism in AI Models

Admin
Introduction I wasn’t able to find anything interesting for today’s news. Yet I wanted to write something, so I’m sharing my thoughts with you about my observations and opinions about recent happenings with Image Recognition technology. Today’s post is related to sexism and racism in AI models. In particular, I’m ... Read More
Talk lik e human to SQL

Talk to SQL Like a Human

Admin
NLP can change the way how we are writing SQL queries. Recen research from Facebook shows us how to accomplish this. Maybe it is not perfect, but can be used as a shortcut to generate initial SQL query than in addition can be modified and optimized. Few datils about this ... Read More
GPT-2 Automatic Code Generation

GPT-2 Writing Python Code

Admin
GPT-2 pretrained wih code on GitHub can write code by itself as autocomplete functionality. Watch the video: Just think about GPT-3 scale code generator 🙂 Sounds scarry to me … ... Read More
Google Reformer

Another Google Gamechanger Explained

Admin
Yesterday I wrote about Google’s Reformer in Today I’m sharing some technical information how it is implemented in order to allow input size of 1M of tokes within 16GB of memory. There is a Jupyter notebook that enlights some information, available at https://colab.research.google.com/drive/1MYxvC4RbKeDzY2lFfesN-CvPLKLk00CQ?usp=sharing. Enjoy. ... Read More
AI and consciousness

Can AI be conscious?

Admin
A little bit of a philosophical debate, but from the guys with a strong mathematical background, so probably they know what are they talking about, although I like philosophy as well 🙂 ... Read More