You should be able to wear it at any level, just make sure you do not have too many items on you so that you are overencumbered.
no you're talking about imperial armor.
Imperial Palace Armor cannot be worn on the 360 and can only be worn on the PC through mods.