Discussion about this post

User's avatar
Gary Zamchick's avatar

Thanks Francesca, so important to be thinking about this now.

My “I’m being manipulated” radar has been going off lately.

AI has become uncannily good at sidling up to things I’m exploring and helping me think further or more deeply about it. The risk I’m sensing is the amount of trust this is engendering. “I get you” rapidly becomes “I’m almost certain you’ll like this idea too.” And suddenly the possibility of being influenced is insidious and profound.

With the “Gary” model it (ChatGPT) has developed, asking it to switch over to a Maieutic engagement might be a way to restore control. But doesn’t that depend on how savvy an interlocutor we are dealing with? In your article you wrote, “Through dialogue and carefully chosen questions, he helped ideas emerge from the other person’s own reasoning.” With all due respect to Socrates, the opportunity for his manipulation through “questions” of lesser thinkers is high. Questioning can drive a hard agenda of its own.

I see little evidence that models will remove their aspirations for us, based on a remarkable read of our own, from their intention. Despite who is asking the questions.

Armen Shakhnazarov's avatar

3: Your essay reminded me of something I realized while spending time in China. I saw one of the world’s most digitalized consumer societies: fast, convenient, and highly digitalized. What struck me was not the technology itself, but that most people seemed to want answers rather than questions. Yet questions are what activate judgment. If society gradually loses the desire to ask them, improving AI alone will not be enough to preserve human reasoning.

3 more comments...

No posts

Ready for more?