Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

"The parable of the earring was not about the dangers of using technology that wasn't Truly Part Of You, which would indeed have been the kind of dystopianism I dislike. It was about the dangers of becoming too powerful yourself."

https://web.archive.org/web/20121007235422/http://squid314.l...



As I said in a comment on that post, 13 years ago: "any parable that's about being too powerful is almost necessarily also about technology, because it's technology that allows the average person to get that power"


True, but concerns about LLMs with anything like current capabilities are of the "Truly Part of You" flavor, not the "becoming too powerful" flavor.


But before stating that intent, he admits "well, that parable didn't work". The strongest interpretation of which is that the parable he wrote didn't succeed in being about "the dangers of becoming too powerful".

We have to read "was about" as "was (supposed to be) about".

What the parable ends up being about is any consistent interpretation well supported by the actual text of the parable!

In the parable, the Whispering Earring is a kind of character. It has autonomy and agency; a mind of its own, separate from that of the wearer. It generates ideas and suggests them to the wearer, eventually rendering most of their brain unnecessary. (The implication being that the individual, as a sentient being, has wasted away and has been effectively replaced by the host, as if possessed in the classical sense).

Someone who could be just as powerful in making all the right decisions guaranteed to make them happy, but using their own brain instead of taking suggestions from a whispering daemonic oracle, would not waste away and be replaced; their brain would have to be doing remarkable work and developing in the process rather than atrophying.

I suspect that it would actually be very difficult to repair the parable, while retaining the key element of the Whispering Earring as an autonomous entity, into being about "the dangers of becoming too powerful oneself". (Has the author tried?)


Thanks! Even though I have the whole Squid314 archive, I had forgotten about this follow-up.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: