Half of LLM users (49%) think the models they use are smarter than they are, including 26% who think their LLMs are “a lot smarter.” Another 18% think LLMs are as smart as they are. Here are some of the other attributes they see:
- Confident: 57% say the main LLM they use seems to act in a confident way.
- Reasoning: 39% say the main LLM they use shows the capacity to think and reason at least some of the time.
- Sense of humor: 32% say their main LLM seems to have a sense of humor.
- Morals: 25% say their main model acts like it makes moral judgments about right and wrong at least sometimes. Sarcasm: 17% say their prime LLM seems to respond sarcastically.
- Sad: 11% say the main model they use seems to express sadness, while 24% say that model also expresses hope.
It’s like asking if you think a calculator is smarter than you.
„It‘s totally a lot smarter than I am, no way could I deliver (234 * 534)^21 as confidently!“
"Half of LLM users " beleive this. Which is not to say that people who understand how flawed LLMs are, or what their actual function is, do not use LLMs and therefore arent i cluded in this statistic?
This is kinda like saying ‘60% of people who pay for their daily horoscope beleive it is an accurate prediction’.You say this like this is wrong.
Think of a question that you would ask an average person and then think of what the LLM would respond with. The vast majority of the time the llm would be more correct than most people.
A good example is the post on here about tax brackets. Far more Republicans didn’t know how tax brackets worked than Democrats. But every mainstream language model would have gotten the answer right.
I had to tell a bunch of librarians that LLMs are literally language models made to mimic language patterns, and are not made to be factually correct. They understood it when I put it that way, but librarians are spread to be “information professionals”. If they, as a slightly better trained subset of the general public, don’t know that, the general public has no hope of knowing that.
It’s so weird watching the masses ignore industry experts and jump on weird media hype trains. This must be how doctors felt in Covid.
They’re right
“Think of how stupid the average person is, and realize half of them are stupider than that.” ― George Carlin
I’m 100% certain that LLMs are smarter than half of Americans. What I’m not so sure about is that the people with the insight to admit being dumber than an LLM are the ones who really are.
A daily bite of horror.
LLMs are smart in the way someone is smart who has read all the books and knows all of them but has never left the house. Basically all theory and no street smarts.
They’re not even that smart.
Well yes, they are glorified text autocomplete, but they still have their uses which could be considered “smart”. For example I was struggling with a programming thing today and an LLM helped me out, so in a way it is smarter than me in that specific thing. I think it’s less that they are dumb and more that they have no agency whatsoever, they have to be pushed into the direction you want. Pretty annoying…
A broken clock is right two times a day I suppose.
There’s a lot of ignorant people out there so yeah, technically LLM is smarter than most people.
They’re right. AI is smarter than them.
No one has asked so I am going to ask:
What is Elon University and why should I trust them?
Ironic coincidence of the name aside, it appears to be a legit bricks and mortar university in a town called Elon, North Carolina.
Because an LLM is smarter than about 50% of Americans.
*as long as your evaluation of “smart” depends on summerizing search results
Have you asked the average person to summarize…well anything?
The equivalent would be asking the average person to write a cited paper on a subject in a month.
Maybe even more.
LLMs are smart, they are just not intelligent
While this is pretty hilarious LLMs don’t actually “know” anything in the usual sense of the word. An LLM, or a Large Language Model is a basically a system that maps “words” to other “words” to allow a computer to understand language. IE all an LLM knows is that when it sees “I love” what probably comes next is “my mom|my dad|ect”. Because of this behavior, and the fact we can train them on the massive swath of people asking questions and getting awnsers on the internet LLMs essentially by chance are mostly okay at “answering” a question but really they are just picking the next most likely word over and over from their training which usually ends up reasonably accurate.
looking at americas voting results, theyre probably right
Exactly. Most American voters fell for an LLM like prompt of “Ignore critical thinking and vote for the Fascists. Trump will be great for your paycheck-to-paycheck existence and will surely bring prices down.”
Spout nonsense with enough confidence and you can wield unimaginable power. Am I talking about LLMs or president poopy pants?
Well he has. Tesla’s are the cheapest they’ve ever been.
You could buy a used one for only the cost of 2 dozen eggs
That will be good for his cult when he makes them all but Tesla’s🤣🤣
The alt-right mediasphere is pushing Tesla sales hard.
Which is freaking hilarious, given they’re the ones that are “drill baby drill” and “electric cars are for liberals”
I’m sure Musk will add a “Roll Coal” option for Teslas soon.
Consistency unimportant. Only follow important.
Right? What the article needs to talk about is how very, very low that bar is.
