I'm not into survival horror, so I haven't played too many games with scary bits. The campaign mission in Halo where you find Pvt. Jenkins was genuinely scary, though.
There's some parts of games I have found creepy, as opposed to scary - present-day Nibelheim in Final Fantasy VII and the hidden areas in the testchambers of Portal are two that come to mind.