I've Recently Learned About GPT3 - This is my Journey

My future project on text transformers applied to code.

Subscribe to my newsletter and never miss my upcoming articles

Listen to this article

I've been very excited since GPT-3 release almost a year ago.

I applied early for closed beta, but had no news so far.

The product is nowadays controlled by Microsoft, and they are gatekeeping it to avoid unethical uses (and avoid past mistakes).

I've read some very interesting articles related to GPT-3:

... and made some theoretical courses on it

By now, GPT-3 is closer to narrow artificial intelligence than Artificial General intelligence. But it is a very successful narrow transformer deceiving humans for long time periods.

State of the art

There are not many GPT-3 Implementations due to being on closed beta.

There's an incipient app marketplace

Hopefully it will grow soon.

Moving forward

I've been thinking a lot about transformers and generators applied to programming.

Most code generators I've tested are too dumb. They can program very basic routines and are not yet able to create great software designs.

In my Code Smell Series, I suggest detection techniques and correction measures.

Some of them involve just syntactic manipulations most actual linters can do.

But, many of them require pattern recognition and some added intelligence.

I am anxious to build a GPT3 solution to assist programmers and made code reviews.

I've not seen many solutions so far

Code Smell Detection with Machine Learning

What do you think? Will we be using them in the near future?


I will be updating this article as long as my research goes on

Last Article Update: 2021/04/10

No Comments Yet