Stefan Mileschin

Trying to improve big, fat, sexist, racist language databases

Google’s AI DeepMind programme is trying to fix a problem with large language models (LLMs) which are being used for everything from improving Google's search engine to creating text-based fantasy games.

The models suffer serious problems, including regurgitating sexist and racist language and failing tests of logical reasoning, mostly caused by the humans that populate the data base.

Alphabet's AI lab DeepMind released three of research papers which talk about how to scale up systems to deliver plenty of improvements.

DeepMind research scientist Jack Rae said: "One key finding of the paper is that the progress and capabilities of large language models is still increasing. This is not an area that has plateaued."

DeepMind, which regularly feeds its work into Google products, has probed the capabilities of this LLMs by building a language model with 280 billion parameters named Gopher.

https://fudzilla.com/news/54019-goog...ism-and-racism