In classic (not-coven) custom lobby – was able to add/remove roles with just two people in lobby, but after a third person joined, roles could no longer be removed. I left (and a different player became host) and confirmed that they could not remove roles either.
Don't have a screenshot unfortunately, just wanted to put this here.