The thing of it is, a sworn brotherhood in some half ruined place, there on some gamble well outside the bounds of their society, you're pretty far off from your original sandboxy intent, that gets pretty focused. If the idea is also basically completely broken off from Realm society, that's not what I was looking myself to get into.
I'd for my part like a dynastic game where you are actually interacting with, y'know, the dynasty, the culture of the Realm, not some far off point in the Scavenger Lands with little to do with it. I was at least picturing something like a substantial Realm colony built up in the area to interact with ala Greyfalls or something. If it's some sworn Brotherhood far off from the trappings of the Realm, it's really not like unto that.