It's a general problem. I had a glitch that froze my game after the end of the Clavicus Vile Shrine quest.
If you have XBL there should be an update to fix any glitches, or if you buy or download the Shviering Isles that has a patch to.
I will try this as soon as I get back on the game. Luckily, I did not delete it yet.
And InfectedNinja, what do you mean by too many weapons, arrows, etc. Do you mean too many items in a single place in your house or just too many items in your inventory?