One of the many funny bugs you can find in Skyrim. I'm sure at least once anyone has experienced the non-fading arrows. Some use cheats to get rid of them, but it works by loading the game too. At times, it's just too damn funny to run by a guard and have him comment on arrows while you're full of them.