Nature Podcast April 4, 2021
Trained on billions of words from books, articles and websites, GPT-3 was the latest in a series of ‘large language model’ AIs that are used by companies around the world to improve search results, answer questions, or propose computer code. However, these large language models are not without their issues. Their training is based on the statistical relationships between the words and phrases, which can lead them to generate toxic or dangerous outputs. Preventing responses like these is a huge challenge for researchers, who are attempting to do so by addressing biases in training data, or by instilling these AIs with common-sense and moral judgement…read more.