Chatbots Are Developing an Understanding of the World, Scientists Claim

Key Points:

  • Evidence shows that large language models (LLMs) are producing outputs that were not part of their training data, indicating potential understanding and creativity.
  • Researchers used random graphs to exemplify the unexpected behavior of LLMs, showing that these models are developing skills absent from their training data and using more than one skill at a time as they grow.
  • The team’s results suggest that LLMs are capable of compositional generalization, putting building blocks together in a way that has never been seen in the training data, which implies an essence of creativity in AI.

Summary:

Artificial intelligence is making surprising strides, suggesting a deeper understanding of the world. Researchers from Princeton and Google DeepMind found evidence that large language models (LLMs) are producing outputs that go beyond their training data, indicating an ability to understand and output accordingly. These models seem to be developing skills absent from their training data and utilizing multiple skills as they grow.

DAILY LINKS TO YOUR INBOX

PROMPT ENGINEERING

Prompt Engineering Guides

ShareGPT

 

©2024 The Horizon