Don't remove all members when changing the group affililation, but only the users which aren't assigned anymore.
Changed paths: