An insight about LLMs.

[waheed]

I usually get insights when i'm not completely awake in morning or when I'm not completely sleeping at night.

Most recent one is about LLMs, basically it became clear like a day to me that while relying on human generated data LLMs can never surpass smartest human in intelligence. Even if they gather a planet size of compute. Basically intelligence is ingrained in abstractions and all the data humanity created, including all knowledge. A higher intelligence will have very different "content", for the lack of better word.

There is another corollary to this which shows that LLMs are way inferior then we think.

By the way i'm using LLMs every day in my work and they helped me alot 

Edited 22 hours ago by waheed

[Hojo]

Yes they are basically lying about them. How can you find a cure for something if you dont feed it to the LLM. The LLM dosent think.

[cistanche_enjoyer]

20 hours ago, Hojo said:

How can you find a cure for something if you dont feed it to the LLM.

It could be that all the steps for a cure are already inputted in the training data of an LLM, it just needs enough compute power to make the necessary connections.

[waheed]

1 hour ago, cistanche_enjoyer said:

It could be that all the steps for a cure are already inputted in the training data of an LLM, it just needs enough compute power to make the necessary connections.

This is an extended version of low hanging fruit logic, and it's possible that there are some low hanging fruits.