How do I make other people not judge him for his autism?

He is very inquisitive and lovable but the way people look at him bugs me. I don't think he notices, but I do. And it hurts how people judge him. We aren't related, I'm best friends with his older brother. He means so much to me, and I hate that people look down on him because of something he cannot control. He is like my little brother.