If you have social anxiety, then you have a fear of being embarrassed in front of a group of people, or you fear that they are making fun of you and criticizing you. When you have social anxiety, you avoid social situations and groups of people, as you have this fear of social scrutiny.
However, you say that you could care less what others think of you, so this is not a problem with social anxiety, where they do care what others think. You stated so yourself- you just don't like people. Nothing indicates anxiety there.
If you want to see if you have any problems with anxiety, please click here.