NEED HELP WITH LAG PROBLEM SOLVING

[dgarcia_cameras]

Hello,

I need help with lag.... bad..... We recently upgraded our surveillance system.

We installed:
- 46 - 8MP IP Cameras
- Ran all Cat6 for the 46 cameras
- Installed 4 POE switches for the cameras as the cameras were installed on 4 seperate buildings
- The original NVR was a 64 channel eye max which we used SMARTPSS as the viewing software
- We later changed the NVR to two 32 channel Magic IP and are now using CMS as the viewing software
- Our download speeds at our desktop are 189.4 Mbps and our upload speeds are 142.8 Mbps

Here is our dilemma in two different scenarios:

Scenario 1: The original NVR was the 64 channel eyemax per our request because we wanted the NVR and viewing software to have more capabilities. We installed a monitor in our server room and connected to the NVR. When checking the cameras on the monitor connected to the NVR there is no delay in any way shape or form. When checking the cameras at our desktop using SMARTPSS viewing multiple cameras there is no delay. The moment one single camera is chosen to be blown up and viewed there is about a 20 second freeze and then the image unfreezes. We have tried bringing down the resolution to view and it still has delay.

The vendor informed me it could be the NVR and he suggested the two 32 channel Magic IP NVR's that he was used to working with.

Scenario 2: Vendor installed the two 32 channel NVR's and installed CMS on our desktops. Similar scenario, when viewing multiple cameras at once, everything is okay. It is not until you select one camera to view it has now a 8-15 second delay. So, a little better but not ideal.
Here is the curious thing.... The vendor gave me access to view other cameras from his site. You would think that remoting in would cause about a similar delay of 8-15 seconds....... Nope, his cameras loaded in a matter of 1-2 seconds.
This is why I am stumped and need help. It is clearly something at our site that is causing this delay. I just cannot seem to figure out what it could be, our IT has no idea, and the vendor has no idea.

So, I am reaching to see if anyone on here might have some ideas..

Please help!

 

[David]

Hello,

I need help with lag.... bad..... We recently upgraded our surveillance system.

We installed:
- 46 - 8MP IP Cameras
- Ran all Cat6 for the 46 cameras
- Installed 4 POE switches for the cameras as the cameras were installed on 4 seperate buildings
- The original NVR was a 64 channel eye max which we used SMARTPSS as the viewing software
- We later changed the NVR to two 32 channel Magic IP and are now using CMS as the viewing software
- Our download speeds at our desktop are 189.4 Mbps and our upload speeds are 142.8 Mbps

Here is our dilemma in two different scenarios:

Scenario 1: The original NVR was the 64 channel eyemax per our request because we wanted the NVR and viewing software to have more capabilities. We installed a monitor in our server room and connected to the NVR. When checking the cameras on the monitor connected to the NVR there is no delay in any way shape or form. When checking the cameras at our desktop using SMARTPSS viewing multiple cameras there is no delay. The moment one single camera is chosen to be blown up and viewed there is about a 20 second freeze and then the image unfreezes. We have tried bringing down the resolution to view and it still has delay.

The vendor informed me it could be the NVR and he suggested the two 32 channel Magic IP NVR's that he was used to working with.

Scenario 2: Vendor installed the two 32 channel NVR's and installed CMS on our desktops. Similar scenario, when viewing multiple cameras at once, everything is okay. It is not until you select one camera to view it has now a 8-15 second delay. So, a little better but not ideal.
Here is the curious thing.... The vendor gave me access to view other cameras from his site. You would think that remoting in would cause about a similar delay of 8-15 seconds....... Nope, his cameras loaded in a matter of 1-2 seconds.
This is why I am stumped and need help. It is clearly something at our site that is causing this delay. I just cannot seem to figure out what it could be, our IT has no idea, and the vendor has no idea.

So, I am reaching to see if anyone on here might have some ideas..

Please help!

Could it be the desktop, can you try another?

On win10 / 11 ctrl+alt+del> task manager. look at the processes and performance tabs. Check before viewing cameras and after, pay attention to high CPU GPU / disk usage. See if any process is too demanding.

 

[dgarcia_cameras]

Before opening up camera viewing software
CPU 1%
Memory 58%
Disk 2%
Ethernet 8.0 Kbps
GPU 1%

After Opening up Software and loading all 46 cameras
CPU 32%
Memory 61%
Disk 0%
Ethernet 23.4 Mbps
GPU 25%

When Enlarging one camera
CPU 3%
Memory 61%
Disk 1%
Ethernet 288Kbps
GPU 6%

 

[David]

Obviously there are quite a few variables here, lets see if we can start to sort the wheat from the chaff.

Brief summary... please correct if needed.
The lag persists with 2 different sets of NVR's, the second pair of NVR's is slightly better.
The desktop does not seem to be the bottle neck.
Viewing other cameras remotely give little to no lag.

As remote viewing is ok, what is the data path from your desktop to your internet WAN?
Likewise what is the data path when you see the lag?
Can you check lag by accessing the cameras directly via a web GUI bypassing the NVR's?
Could you post a basic network diagram of your setup, pen and paper will be fine.
What are the model numbers of the switches / NVR's on your network?
Desktop details operating system etc.

David

 

[CQR-View]

Had a similar issue a while back with a System consisting of 58 Cameras & 2x DS-7732NI NVR's, following the network topology i discovered the Overall Network ran on a Gigabit Connection, however bottlenecked at the Workstation PC with a 100mbs LAN Card

 

[dgarcia_cameras]

Had a similar issue a while back with a System consisting of 58 Cameras & 2x DS-7732NI NVR's, following the network topology i discovered the Overall Network ran on a Gigabit Connection, however bottlenecked at the Workstation PC with a 100mbs LAN Card

Thank you for the suggestion! I hadn't looked at that! When I checked, the LAN card is 1Gbps. It made me see the rest of the system and I did notice that all of our patch panels are CAT 5E as well as the patch cords and cable ran. I wonder if that could be causing the problem and we need to upgrade to CAT 6?

 

[dgarcia_cameras]

Obviously there are quite a few variables here, lets see if we can start to sort the wheat from the chaff.

Brief summary... please correct if needed.
The lag persists with 2 different sets of NVR's, the second pair of NVR's is slightly better.
The desktop does not seem to be the bottle neck.
Viewing other cameras remotely give little to no lag.

As remote viewing is ok, what is the data path from your desktop to your internet WAN?
Likewise what is the data path when you see the lag?
Can you check lag by accessing the cameras directly via a web GUI bypassing the NVR's?
Could you post a basic network diagram of your setup, pen and paper will be fine.
What are the model numbers of the switches / NVR's on your network?
Desktop details operating system etc.

David

The summary is correct.

As for the data path I will have to get back to you on that as this is where my limited knowledge on data management begins to hinder me.

The switches we are using are ubiquiti gigabite switches and the NVR's are 2 NVST IP5832E-32.

Desktop info - Microsoft Windows 10 Pro Version 10.0.19045 Build 19045 with Intel(R) Core(TM) i5-10505 CPU @ 3.20 GHz, 3192 Mhz, 6 Core(s), 12 Logical Processor.