Settings need to be saved to Flash and the system needs to be rebooted for the changes to take effect.