That's what vice presidents, ministers and viziers are for
To expand your idea, I think it will also be a good idea to appoint someone else as the administrator while you go adventuring/too lazy/unwilling too administrate your settlement...
Or to simply abandon the idea of building the settlement at all. The settlement feature is optional, right? ^^