With the newest beta:
Get notification of a settlement in need of help.
Go to that settlement (ex: Tenpines) and am given the quest
Complete quest
Turn in quest NPC is now located somewhere else (ex: Abernathy Farm) and will move around the map if I don't chase him/her down immediately or swift travel.