Does it confuse you when people change avatars?

If I know the person well enough, it isn't a problem. Otherwise I'll probably end up seeing you as a new person. I tend to associate users with their avatars first, then name second.