I had that question for a while, but after reading some other replies to other question, I think I figured that it is by rarity of the skills.
A yellow guy would have one more positive trait and I guess there would be a third category of villagers with 4 positive traits!