The "Fast Skills Cooldown" option when activated is also working for the AI/computer controlled entities.
If the enemies have a stun capability, like the golem you fight before sitting on the throne, you get permanently stunned as it will spam its stun cage ability and have to disable the option to continue fighting.
Please check you PMs - thank you.