Ah.. The reason we can't see thoughts, is because we're not really quite sure how the brain fully works. Each thought is composed of trillions (or more?) of neural connections and neurons firing here and there.
Yeah, that's my theory too. I mean, I totally figure the answer is there somewhere. But unlike every other piece of information stored within a physical system, I don't think we've gotten very far with the
how qualia exist.
We barely understand the conditions required for their existence. We certainly have no real theory on what is necessary and sufficient, in any broad sense. Sure, maybe a reasonable understanding, in crude terms, what primate brains need to have qualia instead of sheer 'learning reflexes'.
I expect it's solvable. We've just not had a Darwin moment. The ongoing funding of neuroscience will eventually produce that moment, but it hasn't yet. If neuroscience was magnetics, we're still at the stage where we say "Hey, Maxwell, have you noticed that some rocks will align themselves in a North/South direction if you hang them from a string?"
"Yeah, I wonder why that is?"
"Not sure. Still trying to figure out how to tell the orienting rocks from the non-orienting rocks, y'know, without actually suspending them from a string"
When it comes to qualia, we basically don't have a better mechanism than
asking someone if they have qualia. Once we get outside of the mammalian brain, the neuroanatomy changes enough that the rules-of-thumb we developed regarding human consciousness cannot be robustly applied.
Borachio said:
But it looks like fish feel pain. So why wouldn't they?
There are many "nociceptor -> learning reflex" systems that look like pain, but don't actually
experience pain. This is mainly because they don't have the neurobiology for the
percept of pain. The neuroanatomical streams (in people) for
responding to aversive stimuli are independent of our neuroanatomy for
perceiving pain.
So, it's unclear whether fish have the neuroanatomy to experience pain, as a qualia. The model for whether a person, a primate, or even a mammal can experience pain doesn't apply to fish, because our neuroanatomies are too different.