There are plenty of people out there walking around sick, but don't know they are sick.
Irrelevant. My point was that you don't have to experience something to know you aren't/haven't been something. I've never experienced being shot, but I know I wasn't shot so far today, or ever. And you can know you aren't dead without ever having experienced death.
Are we not still made of the same things? What makes one conscious and the other not?
Are you asking what consciouness is? Well, it is a phenomenon that we don't quite understand the details of (yet). But that does not mean we don't know which things are conscious and which things are not. We are conscious, rocks are not.
That's all computer programs do, is bear intentionality. They bear the intentions of the original programmer. Those programmers pursuing A.I. are intentionally programming decision making faculties within the A.I., so that it can express its own intentions when confronted by stimuli, rather than just reacting to stimuli. The difference is cause/reaction vs thought/action.
So, computer programs intentionally do things? You believe this?
Do you think everything bears intentionality, then? If I swing a bat, did the bat intentionally swing on its own?
There is a theory which states that a sufficiently advanced technology would be able to create an ultimate simulation that for all intents and purposes duplicated reality to such a degree that both would be indistinguishable from one another.
I think I've heard of this theory, but can you cite a source? I'll respond once I know exactly what you're talking about.
Sounds like Fundamentalist Christian Dogma.
Not at all. I'm not saying you shouldn't question. It's good to question, but you should have a good reason to doubt. If you simply question everything and deny even those things which are the most apparant, you aren't being reasonable. You are being intellectually stagnant; extreme skepticism gets you nowhere. It can actually develop into a form of paranoia if you aren't careful.
On the other hand, if you do have reason to question but never do, you're being just as intellectually stagnant.