Little brown dots on my legs?

I have these little brown spots on my legs.. they look like goose bumps sort of. And when I scratch them, a little piece of hair will unfold.. Sounds disgusting, I know. But they're really annoying and ugly.. How do I get rid of them? I think I get them from shaving my legs.