You shouldn't need to turn the NVR off.
If you are plugging the camera directly into a PoE port on the NVR the easiest way to swap cameras would be to disconnect the old camera, then in the NVR menus switch the channel/port you are adding the new camera from plug & play to manual and then back again. This will default the IP details of the channel making it ready to connect a new camera, then when you plug in the new camera it will power up and be activated with the NVRs activation password and the camera will be assigned an available subnet IP address.