2020

Eigenvectors and eigenvalues

This is So Cool :-)

This is so cool so I couldn’t resist to sharing it with you: In short: Quantum Mechanics physicists found clues for properties for Eigenvectors and values still unknown for the Math. Clear clue how much of processing power is put into quantum mechanics and analyzing its experiment results. ... Read More
Size does Matter

Size Does Matter

Introduction In a word of NLP and language models, size does matter. Literally, the bigger is better. Since the appearance of transformers on the NLP horizon, they became a de facto synonym for successful language model implementation, shadowing usage of recurrent neural networks, and LSTM. NLP got their equivalent of ... Read More
Interesting AI Startups

Unknown but Innovative Cool and Scarry

AI innovation is not only AI research. And Google, DeepMind, Facebook, and OpenAI are not the only AI innovators. Innovation is also to find exciting use-cases where nobody looked for them yet, and scale them beyond imaginable. This article is about a few of the unknown, yet innovative companies with ... Read More
AI Programming Heroes

My AI Programming Heros During Corona Days

One Long Introduction Currently I’m working on Question and Answering system based on BERT. Some online resource for it: Since it’s announcement and open-sourcing, many optimizations and variations appeared. There are smaller but faster versions optimized for memory footprint and speed for mobile devices. Also, after some research, some variations ... Read More
MS AI news

Finally Something Interesting From Microsoft

Introduction It seemed to me that Google, Facebook, and OpenAI are the only ones that work out something in the AI area. Still, tech giants like Microsoft seem to work on something interesting as well. Recently Microsoft unveiled its Turing-NLG model with its 17B parameters, and it was the most ... Read More
Sexism and Racisam in AI

Sexism and Racism in AI Models

Introduction I wasn’t able to find anything interesting for today’s news. Yet I wanted to write something, so I’m sharing my thoughts with you about my observations and opinions about recent happenings with Image Recognition technology. Today’s post is related to sexism and racism in AI models. In particular, I’m ... Read More
Talk lik e human to SQL

Talk to SQL Like a Human

NLP can change the way how we are writing SQL queries. Recen research from Facebook shows us how to accomplish this. Maybe it is not perfect, but can be used as a shortcut to generate initial SQL query than in addition can be modified and optimized. Few datils about this ... Read More
GPT-2 Automatic Code Generation

GPT-2 Writing Python Code

GPT-2 pretrained wih code on GitHub can write code by itself as autocomplete functionality. Watch the video: Just think about GPT-3 scale code generator 🙂 Sounds scarry to me … ... Read More