In the previous article we have explained how GPT itself (like GPT3 and GPT3.5) works, not ChatGPT (or GPT4). So, what’s the difference? Base models for generative text AI are always trained on tasks like “next word prediction” (or “masked language modelling”). This is because the data to learn this task is abundant: namely all […]
Is ChatGPT just using next word prediction? Read More »
Generative text AI is AI – an ANN, either a recurrent neural network or a transformer – that produces continuous text. Usually, the base general task on which these systems are trained is “next word prediction”, but it can be anything. Translating a text, paraphrasing a text, correcting a text, making a text easier to
What is generative text AI? Read More »
In the article about artificial neural networks we gave some high level representation of what such a neural network is. The deeper you dig into these neural networks, the more details you encounter, like why it often makes sense to prune nodes, or that there are several kinds of neurons some of which keep different
How are words represented in generative text AI? Read More »
In this blog we will often talk about generative text AI. Since each performant generative text AI belongs to the deep learning domain, this means we need to talk about artificial neural networks. Artificial neural networks (ANNs) are a type of machine learning model that are inspired by the human brain. They consist of layers
What are artificial neural networks? Read More »
Artificial intelligence is the broader concept of machines being able to perform tasks that would require human intelligence. It’s just a computer program doing something intelligent. A system that uses if-then-else rules in order to make a decision, is also artificial intelligence. If you build a loan expert system consisting of thousands of rules like
What is artificial intelligence, what is machine learning and what is deep learning? Read More »
When I first planned to start this blog I had in mind to talk about my personal views on generative language technology. However, after sending my first draft to friends, family and colleagues, it soon became clear that some background information about generative text AI itself was needed first. So my first challenge is to offer
Demystifying generative text AI Read More »