I was randmly attacking raven rock when in the middle of battle i was able to fast travel to skyrim. Well now he and a few guards fast traveled with me. What do?

That's what you get for messing with the Redoran Guard.