March 2023

Is ChatGPT just using next word prediction?

In the previous article we have explained how GPT itself (like GPT3 and GPT3.5) works, not ChatGPT (or GPT4). So, what’s the difference? Base models for generative text AI are always trained on tasks like “next word prediction” (or “masked language modelling”). This is because the data to learn this task is abundant: namely all …

Is ChatGPT just using next word prediction? Read More »

How are words represented in generative text AI?

In the article about artificial neural networks we gave some high level representation of what such a neural network is. The deeper you dig into these neural networks, the more details you encounter, like why it often makes sense to prune nodes, or that there are several kinds of neurons some of which keep different …

How are words represented in generative text AI? Read More »

What is artificial intelligence, what is machine learning and what is deep learning?

Artificial intelligence is the broader concept of machines being able to perform tasks that would require human intelligence. It’s just a computer program doing something intelligent. A system that uses if-then-else rules in order to make a decision, is also artificial intelligence. If you build a loan expert system consisting of thousands of rules like …

What is artificial intelligence, what is machine learning and what is deep learning? Read More »

Scroll to Top