In my opinion having a gun and being able to kill the monsters seems to make the game less scary. I don't deny it is scary, not as scary as it could be.
Amnesia: The Dark Descent is true horror in my opinion. You have no weapons. All you can do is hide and pray.
Or play "if I can't see them they can't see me:" Link