My place for publicly tracking certain philosophy, school of thoughts, ideology, etc. Probably will upset certain people, but my spirit is inspired by Yoav Goldberg. Lots of notes here are informal.

Also use to track certain predictions.

Tracking

David Amodei’s Predictions (Oct 11, 2024): Machines of Loving Grace: How AI Could Transform the World for the Better

Winners

Next token prediction at large scale is all you need to learn a language and do useful tasks. LLMs are not stochastic parrot.

• △ Ilya’s scaling bet wins.
• △ Hinton wins Nobel Prize coz of Deep Learning.
• 🔻 On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
• 🔻 Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data

📝 Judgement made on Oct 11th, 2024. This matters a lot to me because I was almost misguided into doing linguistic-driven stuff three years ago (see my post here). Some other based notes for reference:

• LLMs by Yoav (written in Jan'23)