There is a category of "zero-positive" people, with autism or severe Asperger's, who lack empathy but show no tendency to unkindness.