Note that the writer uses the forest to paint how one would actually feel if one is alone in the forest, using the castle tower room gives the reader the idea about feeling unsafe in a seemingly safe place.
The symbolic significance of the forest setting tells us that the speaker may either be dreaming and as such be in an unconscious state of mind.
Thus, the speaker is frightened to the core because of his perceived ordeal in place of isolation–the forest.