How do you clean a seatbelt purse??

I have one of those seatbelt purses and got like a small pen mark and black dirt mark on it [total bummer!] Does anyone know how to clean one of those purses or just seatbelts in general to get those marks off???