Is ChatGPT just using next word prediction?

In the previous article we have explained how GPT itself (like GPT3 and GPT3.5) works, not ChatGPT (or GPT4). So, what’s the difference? Base models for generative text AI are always trained on tasks like “next word prediction” (or “masked language modelling”). This is because the data to learn this task is abundant: namely all …

Is ChatGPT just using next word prediction? Read More »