@Dosed,
My mother used to work with the mentally handicapped, thanks to her work as a "recreational therapist." (Job is fizzled out, now) But back then she would befriend, and even dates one still to this day (cerebral palsy), many different shades of people. It is almost natural to devalue them, and dehumanize them on some level precisely because of their identity. It's like a mental racism we all take for granted, because it is so rare their conditions.
I would be like an armchair president to judge you on your perceived guilty conscience - only to say, I probably would have done the same thing in your position, and at least you are wise enough to realize it.