GPT-6 Astra. AGI?

[Joshe]

Anyone tried this yet? I'm very skeptical but some pretty popular devs known for not bullshitting about AI are saying it. 

 

Edited 8 hours ago by Joshe

[AerisVahnEphelia]

Anyone is sleeping when AGI is starting to really happen.

if you see what it does in 3D, it's basically game over.
Like the fucking fuck.
 

3D designer must be crying, I saw someone close his X account ( not a bate ) because he was getting depressed by ASTRA.

for a good reason.

https://x.com/tomkrcha/status/2095756085890310311

https://x.com/emmanuel_2m/status/2096015049529647574

https://x.com/MatthewBerman/status/2095620888695902366

https://x.com/Dimillian/status/2095596700815516004

Edited 6 hours ago by AerisVahnEphelia

[PsychedelicEagle]

Stating LLMs are AGI misses the fundamental gaps LLMs have.

Not being AGI does not mean they aren't extremely useful, however.

[OBEler]

@PsychedelicEagle what fundamental gaps you are talking about. 

[PsychedelicEagle]

@OBEler Yann LeCun's arguments make sense to me.

The one that stands out most: LLMs have no world model grounded in interaction with reality; they learn a probability distribution over sequences of tokens — fragments of written language. Since their only training signal is text, they have no ultimate grounding in physical or sensory experience.

From from section 8.2.2 of this paper:

Quote

For example, Large language models (LLMs) seem to possess a surprisingly large amount of background knowledge extracted from written text. But much of human common-sense knowledge is not represented in any text and results from our interaction with the physical world. Because LLMs have no direct experience with an underlying reality, the type of common-sense knowledge they exhibit is very shallow and can be disconnected from reality.

One can argue against this, but I intuit it's a crucial limitation, and reaching AGI will require different architectures. I do believe AGI is attainable, but it will take longer and a different paradigm than the one the industry is obsessed with right now.

PS: I'm not making the case that we're necessarily in an "AI bubble". I believe the value of AI is not tied to attaining AGI.

Edited 42 minutes ago by PsychedelicEagle

[PsychedelicEagle]

I'm watching this more recent interview now; he brings up the "world model" point again right in the beginning.

Edit: Interesting quote:

Quote

At (20:37), Yann LeCun explains that companies are driven by the fear of falling behind, which results in a lack of diversity in research directions. He notes: "There's no incentive for the other companies to do anything different either because they can't afford to kind of fall behind the others, right? So, they all work on the same thing... And there's a bit of this sort of, you know, kind of herd behavior, uh, and, you know, in, in mostly in Silicon Valley where everybody is digging the same trench."

 

Edited 9 minutes ago by PsychedelicEagle