Fast Travel Safety

It annoys me that fast travel in Fo4 can dump you right into a firefight. I thought a cardinal rule was that fast travel would put you into a safe spot. Now I have to assume that any fast travel, outside of settlements, will get me into trouble. I'm spamming VATS even before I materialize. Maybe that's by design but I still don't like it. I hate fast traveling to Satellite Station Olivia and getting jumped by bloat flies and mole rats which alert the raider guards. Oh well.