Funny place for a castle

Well, it is Scotland, we have castles round every corner. This is Newark Castle, a National Trust for Scotland property on the outskirts of Port Glasgow.
What's odd about it is that it sits right next to the Ferguson shipyard and looks completely out of place.
I've driven past it loads of times and never stopped there until today. It doesn't really look as though too many people stop by for a visit.