FWIW, this is why AI researchers have been screeching for decades not to create an AI that is anthropomorphized. It is already an issue we have with animals, now we are going to add a confabulation engine to the ass-end?
I was once in a restaurant and behind me was a group of 20 something year old people. Overheard someone asking something like:"so what are y’alls thoughts about VR? (This was just before the whole AI boom.)
And one guy said:“ith’s kind of scary to think about.”
I was super confused at that point, and they talked about how they heard people disappear in the cyberspace and people not knowing what’s real and what’s just VR.
I don’t think they were stupid, but they formed a very strong opinion about something they clearly didn’t know anything about.
The average IQ is 100. That is not a lot and half of the population is below that. I’m more surprised how bad our education system is in filtering out the dumb people. Someone who is ‘not smart’ but has good memory and is diligent can make it frighteningly far in our society. Not to mention nepo babies who are a different kind of problem
The average IQ is 100 because it is designed to always have the average at 100%. If magically everyone became exactly 20% better at IQ tests tomorrow, the average IQ would be adjusted and still be 100.
LLMs are trained on human writing, so they’ll always be fundamentally anthropomorphic. you could fine-tune them to sound more clinical, but it’s likely to make them worse at reasoning and planning.
for example, I notice GPT5 uses “I” a lot, especially saying things like “I need to make a choice” or “my suspicion is.” I think that’s actually a side effect of the RL training they’ve done to make it more agentic. having some concept of self is necessary when navigating an environment.
philosophical zombies are no longer a thought experiment.
FWIW, this is why AI researchers have been screeching for decades not to create an AI that is anthropomorphized. It is already an issue we have with animals, now we are going to add a confabulation engine to the ass-end?
Yeah apparently even Eliza messed up with people back in the day and that’s not even an LLM.
I’m starting to realize how easily fooled people are by this stuff. The average person cannot be this stupid, and yet, they are.
I was once in a restaurant and behind me was a group of 20 something year old people. Overheard someone asking something like:"so what are y’alls thoughts about VR? (This was just before the whole AI boom.) And one guy said:“ith’s kind of scary to think about.” I was super confused at that point, and they talked about how they heard people disappear in the cyberspace and people not knowing what’s real and what’s just VR.
I don’t think they were stupid, but they formed a very strong opinion about something they clearly didn’t know anything about.
I’d like to believe he heard a summary of sword art online’s plot and thought it was real
The average IQ is 100. That is not a lot and half of the population is below that. I’m more surprised how bad our education system is in filtering out the dumb people. Someone who is ‘not smart’ but has good memory and is diligent can make it frighteningly far in our society. Not to mention nepo babies who are a different kind of problem
Good memory is also part of being smart, besides problem-solving and thinking under pressure. But yeah nepo-babies do cause serious problem.
Tho also iq doesn’t matter as much. Tests are in a specific branch of math, you can literally study for the IQ test.
The average IQ is 100 because it is designed to always have the average at 100%. If magically everyone became exactly 20% better at IQ tests tomorrow, the average IQ would be adjusted and still be 100.
Smart argument.
“Half the people are smarter than other half”
People have this issue with video game characters who don’t even pretend to have intelligence. This could only go wrong.
LLMs are trained on human writing, so they’ll always be fundamentally anthropomorphic. you could fine-tune them to sound more clinical, but it’s likely to make them worse at reasoning and planning.
for example, I notice GPT5 uses “I” a lot, especially saying things like “I need to make a choice” or “my suspicion is.” I think that’s actually a side effect of the RL training they’ve done to make it more agentic. having some concept of self is necessary when navigating an environment.
philosophical zombies are no longer a thought experiment.