A small drive does not limit performance - it just fills quickly.
An unsuitable drive could be a problem i.e. we would only recommend Western Digital Purple or Seagate Iron Wolf.
I don't know why you are seeing quality problems.
Are your cameras directly connected to your NVR?
(the cameras are plugged into the camera ports on the rear of the NVR?)
Are you using bought or home-made cables?