Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

marmar

(77,081 posts)
Mon Jan 2, 2023, 10:03 AM Jan 2023

An AI that can "write" is feeding delusions about how smart artificial intelligence really is

An AI that can "write" is feeding delusions about how smart artificial intelligence really is
GPT-3, which can converse and write compelling text, is more like a pseudo-intelligence than a real AI

By GARY N. SMITH
PUBLISHED JANUARY 1, 2023 7:30PM (EST)


(Salon) The internet revolution has made many people rich, and the lure of outrageous fortune has tempted many to exaggerate what computers can do. During the dot-com bubble, many companies discovered they could double the price of their stock simply by adding .com, .net, or internet to their names. Now, we face an comparable AI bubble — in which many companies woo customers and investors by claiming to have a business model based on artificial intelligence.

If computers can defeat the most talented human players of chess, Go, and Jeopardy, they surely can outperform humans in any task — or so the thinking goes. That brings us to the recent hullabaloo about an AI program that can pen such compelling writing that it seems to be naturally intelligent. It's called OpenAI's GPT-3 large language model (LLM), and though the name is obscure to a layperson — GPT-3 is short for Generative Pre-trained Transformer 3, which doesn't explain much more — what it does is relatively simple: GPT-3 can engage in remarkably articulate conversations and write compelling essays, stories, and even research papers. Many people—even some computer scientists—are convinced that GPT-3 demonstrates that computers now are (or soon will be) smarter than humans. As a finance professor and statistician who has written several books on AI and data science, I find this belief fanciful.

Alas, it is an illusion—a powerful illusion, but still an illusion reminiscent of the Eliza computer program that Joseph Weizenbaum created in the 1960s. Eliza was programmed to behave like a caricature of a psychiatrist. When a "patient" entered an input, Eliza would repeat the words and/or ask a followup question ("You were unhappy as a child? Tell me more about that.&quot .

Even though users knew they were interacting with a computer program, many were convinced that the program had human-like intelligence and emotions and were happy to share their deepest feelings and most closely held secrets. Scientists now call this the Eliza effect. We are vulnerable to this illusion because of our inclination to anthropomorphize—to attribute human-like qualities to non-human, even inanimate objects like computers.

....(snip)....

Large Language Models (LLMs) like GPT-3 do not use calculators, attempt any kind of logical reasoning, or try to distinguish between fact and falsehood. They are trained to identify likely sequences of words—nothing more. It is mind-boggling that statistical text prediction models can generate coherent and convincing text. However, not knowing what words mean, LLMs have no way of assessing whether its utterances are true or false. GPT-3 asserts its BS so confidently that its behavior is not described as lying but rather hallucinating (yet another example of anthropomorphizing). ...................(more)

https://www.salon.com/2023/01/01/an-ai-that-can-write-is-feeding-delusions-about-how-smart-artificial-intelligence-really-is/




12 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies
An AI that can "write" is feeding delusions about how smart artificial intelligence really is (Original Post) marmar Jan 2023 OP
Interesting... MiHale Jan 2023 #1
LOL marmar Jan 2023 #2
AlphaGo - The Movie Full award-winning documentary old as dirt Jan 2023 #3
We used it to compose a poem about Quakerfriend Jan 2023 #4
Sounds like a modern day implementation of ELIZA cojoel Jan 2023 #5
reservations stopdiggin Jan 2023 #6
I'm not so sure AI videos, photos, art and writing is always easily distinguishable from human Martin68 Jan 2023 #7
I've read a similar story some years ago. Beastly Boy Jan 2023 #8
I'm not convinced humans are any different, most of the time. hunter Jan 2023 #9
Great for Searches Chris Koch Jan 2023 #10
welcome to DU gopiscrap Jan 2023 #12
I used GPT-3 in part of a chat program I made to chat on audio chat servers XorXor Jan 2023 #11

MiHale

(9,737 posts)
1. Interesting...
Mon Jan 2, 2023, 10:11 AM
Jan 2023

So when I was chastised in college that my writing was a bit robotic (at the time I didn’t understand the comment) I was ahead of the times.

Quakerfriend

(5,450 posts)
4. We used it to compose a poem about
Mon Jan 2, 2023, 10:30 AM
Jan 2023

my childhood & I was amazed at how clever it was!

My parents, along with the neighbors, built a small ski hill with a rope tow, night lights and a chalet across the street from our house & the poem was about that.

cojoel

(957 posts)
5. Sounds like a modern day implementation of ELIZA
Mon Jan 2, 2023, 12:02 PM
Jan 2023

More sophisticated but not so much more capable.

As some one told me many years ago during a Computer Science class, it is important to not confuse Artificial Intelligence with Real Stupidity.

stopdiggin

(11,317 posts)
6. reservations
Mon Jan 2, 2023, 12:06 PM
Jan 2023

there is certainly a difference in regurgitating 'content' - even rearranged and pretty 'sounding' content - which these programs can do to a fairly impressive and convincing degree ... (with all due, and quite warranted, credit on that front)

To then get to a place where a program is actually cognizant, capable of judgement, discerning truth from fiction, or divining something like a 'fair' result, or the lesser of evils ...

A standard hackneyed trope (repeated often enough) will be assigned just as much value (and 'truth' ) - as the words from a celebrated mind - or the conclusions from a years long medical study.

(oh, wait ... have I just described the 'abilities' of major portions of our own population .. ?)
-------- ---------

Martin68

(22,822 posts)
7. I'm not so sure AI videos, photos, art and writing is always easily distinguishable from human
Mon Jan 2, 2023, 01:22 PM
Jan 2023

content anymore.

Beastly Boy

(9,375 posts)
8. I've read a similar story some years ago.
Tue Jan 3, 2023, 07:30 AM
Jan 2023

My immediate comment was that humans, in order to differentiate themselves from the AI bots, will eventually have to write like complete morons.

In certain instances, you have to give credit to some of our political figures for being trend setters and ahead of their time (Trump and MTG come to mind...)

hunter

(38,317 posts)
9. I'm not convinced humans are any different, most of the time.
Tue Jan 3, 2023, 11:02 AM
Jan 2023

Creativity and a deep understanding of any subject are uncommon things.

I had a couple of professors in college who were entirely intolerant of robotic thinking. I once worked for a general contractor who had a similar attitude. They were not popular.

My physics professor was the nicest guy in the world, his lectures were wonderful, his office was always open, his labs exciting, but his exams were absolute hell for anyone who'd gotten through school by rote memorization and regurgitation of facts. If you didn't feel the math and physics in your gut you weren't going to get an "A" in his class no matter how hard you studied, no matter how many equations you'd memorized, no matter how good you were at grinding through the math. He made kids who'd zipped through high school as valedictorians cry.

The trouble with all robots and many humans is that they don't know when they are being especially stupid and robotic.

Chris Koch

(1 post)
10. Great for Searches
Tue Jan 3, 2023, 12:18 PM
Jan 2023

OpenAI's GPT-3 is great for Internet searches. Add "Sources" to any text it generates and it will give you good starting points ... and also show how conventional its sources are.

XorXor

(621 posts)
11. I used GPT-3 in part of a chat program I made to chat on audio chat servers
Tue Jan 3, 2023, 12:34 PM
Jan 2023

Like teamspeak and discord. It was a very basic program that listened to audio, would parse it to text, then feed that into GPT-3, then it send the output of GPT-3 as synthesized speech. Despite it's very simple level of complexity, it was still amusing and could make some relevant discussion

Latest Discussions»Issue Forums»Editorials & Other Articles»An AI that can "write" is...