Even with the one-neuron-at-a-time thought experiment, I'm not sure if we are ever going to know for sure if we got uploads right — even in principle.
While a sufficiently detailed copy should be conscious, we don't know what "sufficiently detailed" is — and we can't just do this by external behaviour, because (1) People are still arguing both sides of the P-zombie thought experiment; and (2) LLMs regularly fooling people into thinking they're discoursing with a human, even though I think most people think LLMs aren't conscious.
There's something like 40 different definitions of "consciousness"; some are easy to test for, some are provably impossible, but I don't know if even one of them is actually what we want.
I remember my dreams, but was I really conscious, or was it an unconscious experience whose memory was available to my conscious mind when I woke? It's conceivable that I am fully conscious right now, that an upload of my brain would change and grow and report conscious throughout, that you could then download it into a new brain in a new body and that new mind would also report having remembered conscious experiences while uploaded — all without the upload having ever experienced anything that would match the hard-to-describe thing we often try to grasp at with the word "consciousness".
We have altered states of consciousness. People can have conversations and drive cars while sleepwalking. Am I only truly conscious while actively engaging in self-reflection, or all the time? Is my consciousness like your consciousness? Did my mother loose hers at some point during the course of her Alzheimer's, or did she keep it until the very end? When a Buddhist trains themselves to let go, do they lose theirs?
Before you were born you didn’t have the thing you call a consciousness. But now you do.
I think continuity is a red herring, realistically our whole idea of consciousness is probably off base. It might not even be a real thing, for example my pet cat doesn’t care if he has a consciousness or not because he never invented a word for it.
Perhaps I do. Perhaps it's only there when I pay attention to it, and my brain smooths over the gaps like I know it does with saccades and blind spots (both literal and metaphorical). And even if it is there all the time, is it like yours?
While a sufficiently detailed copy should be conscious, we don't know what "sufficiently detailed" is — and we can't just do this by external behaviour, because (1) People are still arguing both sides of the P-zombie thought experiment; and (2) LLMs regularly fooling people into thinking they're discoursing with a human, even though I think most people think LLMs aren't conscious.
There's something like 40 different definitions of "consciousness"; some are easy to test for, some are provably impossible, but I don't know if even one of them is actually what we want.
I remember my dreams, but was I really conscious, or was it an unconscious experience whose memory was available to my conscious mind when I woke? It's conceivable that I am fully conscious right now, that an upload of my brain would change and grow and report conscious throughout, that you could then download it into a new brain in a new body and that new mind would also report having remembered conscious experiences while uploaded — all without the upload having ever experienced anything that would match the hard-to-describe thing we often try to grasp at with the word "consciousness".
We have altered states of consciousness. People can have conversations and drive cars while sleepwalking. Am I only truly conscious while actively engaging in self-reflection, or all the time? Is my consciousness like your consciousness? Did my mother loose hers at some point during the course of her Alzheimer's, or did she keep it until the very end? When a Buddhist trains themselves to let go, do they lose theirs?