Here are some screenshots:

http://i.imgur.com/kodl4.jpg
http://i.imgur.com/lF7Cq.jpg

As you can see, I tried removing all of my armor. I've tried saving the game and reloading it, as well as quiting to desktop and relaunching. Still there!
Both the arrow and the spike have been there for quite a while now. Do I need to go somewhere or do anything ingame to get them out, or is it just a bug?
Anyway, if someone could tell me how to remove them if even possible, that would be great!

have you tried fast traveling?

they eventually disappear on there own. it's a bug

I have heard getting shot with more arrows makes the stuck one go but I haven't needed to try that .

Same thing happened to my wife's char.. She upgraded her armor at a workbench and it went away. I have also heard people say that if you equip and then unequip the type of arrow that is sticking out of you that it will make them go away.

I also had this once, just open the Console and type "sixchange", do it 2 times or u will stay as a woman or male depening on what u are from the start. This is risk free i have done it myself several times when stuff gets stuck in me ;P

The sixchange worked! Haha. Thanks. And thank you all for replying.

Guard: I've had enough of you. AND YOUR STUPID PIERCINGS.

Well, I have an ice spike stuck in my ass if you can believe it.