Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
lodi
on Nov 27, 2017
|
parent
|
context
|
favorite
| on:
The impossibility of intelligence explosion
Maximize human population divided by the time integral of all human suffering (taken from now to the heat death of the universe.)
chillee
on Nov 28, 2017
|
next
[–]
This kind of stuff is pretty tricky. If you only account for average human suffering, not only do you not account for happiness but you fall into the trap of concluding that it's best to kill all people suffering.
Strilanc
on Nov 28, 2017
|
prev
[–]
Congratulations, your AI wants to convert all matter in the universe into lobotomized humans.
lodi
on Nov 28, 2017
|
parent
[–]
That's suboptimal; a fully realized human would suffer less than a lobotomized human.
Also, we don't need an AI that's ethically perfect, just equal or better to an average human.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: