How do I get rid of my annoying voice?

Try talking to a voice coach. They can figure out what it is that makes your voice grating for people to hear, and offer you some tips on how to improve it. Stuff like breathing, enunciation, tone, etc. I can imagine how frustrating it must be, but you don't have to feel stuck with it.