Hi - Just purchased a fleet of new HP Z6 G5s, pre-configured from a vendor. All seemingly identical, with intel x550s nics.

For the life of us, we can not get 10g speeds out of them hitting our network or storage. They all consistently hover around 350MB/s. We have other windows, mac, and linux machines that do not have this issue so we are ruling out existing infrastructure.

Noteworthy, randomly one of them is perfect and gets 800-1000 MB/s. We can not find any difference between this machine and the others. We have pulled the nic from that machine and placed it in others, as well as swapping ‘slow’ machine nics into this one, problem persists. Consistent speeds whether ran in iperf or a disk speed application like black magic speed test. We have tried multiple ports and the ‘fast’ machine is still fast.

Can I please get some suggestions of some not to obvious factors to look at here? Pulling our hair out!

Thank you!

4 Spice ups

OS in use?

Are the machines using the Intel drivers, not Microsoft’s?

Is the limit due to other actions on the network, is this being tested when the other side is idle?

Is this also true if you try new device to new device?

W11 24H2 has known network issues, be sure you are using manufacturer drivers.

How many 10G NICs does your storage have, and what is it?

Is there any QoS on this device/IP?

What is the underlying storage on this device, NVMe, SSD, RAID or not?

1 Spice up

Sorry, left a few important bits out
Specs of the mahcines:
Hp Z6 G5, Intel(R) Xeon(R) w5-3423, RTXA6000, Windows 11 23H2, 64gig RAM, intel X550s.

Nics using intel drivers

We have tested countless times over the last few weeks with differing network activity, machines hover around 350 always.

New device to new device still ‘slow’ speeds.

Our storage is an AVID Nexis connected, 150+ HDs where the chassis are connected into the network over 100g trunk from a datacenter. The storage should be able to service the speeds.

No QoS on them yet.

We have dropped other NICs into these machines and still can’t the speeds. It must be configure/software based.

It really is perplexing us as to why one machine is running well. They have been out testing for a little while and we think we might just image the ‘fast’ machine and drop it on the other machines!

1 Spice up

Check the driver settings, make sure low power mode/power saving is off, check for RSS (receive side scaling) and try disabling it.

Are you using jumbo packets, are all devices configured for it if so, if not, is it disabled everywhere too.

Hopefully you are testing with a single large file, not small files, as these wont hit anywhere near peak speeds.

Have you tried flipping the switch ports between the slow and fast machines?

Low power mode is off, RSS disabled.

Have tried playing with jumbo packets, doesn’t seem to be the issue.

For sure, single large files.

Yes, changed ports and locations in the business, behaviour is still persistent.

Noteworthy test - these machines were configued with a HP thunderbolt card. Even when using the thunderbolt cartd with a sonnet solo 10g this behaviour is persistent, ‘slow’ machines still around 350, ‘fast’ machine still hitting 1000. This points away from NIC or network settings and back to the machine itself.

Don’t mess with jumbo packets unless you are sure they are required. Jumbo frames must be set on every hop and the end devices.

Typically you’ll see them on a storage network, where the storage adapter, the switch, and the storage device are set to Jumbo and the whole path is isolated from everything else. You would not set the data network part of the server to Jumbo because clients speaking to it wouldn’t support it.

Did you test the machines on the same LAN port(s) or faceplates ?

Thanks for response. Yeah we have tested different ports and different switches in our stack.

But have you tested different machines using the same network LAN ports or faceplates ?

For example on my desk, all lappy & workstations can run 10Gbps network.
But some users desks can only use 1Gbps while some user desks can run 10Gbps as they are connected to different switches or may have even go through distribution switches

Ah copy. Understood.

The entire site is 10g, each port and each switch. But yes, have tested all with a single port with the same results.

Contact your HPe corporate sales and also their support team ? Could be a batch defect or DOA ?

Try uninstalling the network card driver, and replacing with the Win 10 driver from the vendor

Can you supply details of the driver version in use.

It’s usually always driver related.

As an FYI, intel X550s tend to work better in Linux compared to Windows.

You compare the firmware versions on the good vs bad systems?

How about imaging the good system and putting that image on one of the bad ones?

what device are they connected to and what is the devices speed lets start there