VMware: Bad performance on HP ProLiant DL380 G6 with ESXi 3.5 U4
At first I was really happy with my new HP ProLiant DL380 G6 because it is a really nice machine. This machine was going to be an ESX-server so I added a few disks, a second CPU and plenty of memory, new specifications:
- CPU(s): 2x Intel Xeon Quad E5520 (2.27GHz)
- Memory: 28GB (2x 2GB, 6x 4GB) DDR3
- Disk(s): 2x 36GB, 3x 300GB
Enough to make the machine running really fast, you would think. Once I had installed ESXi 3.5 U4 on the machine I started to install the environment consisting of a 4 Windows-servers and 5 client-systems (XP and Vista).
While installing I noticed that the machine appeared to be really slow when it comes to Disk I/O: During the installation of two 2008-Servers the extraction process of the disk image took over an hour (I installed both 2008 servers simultaneously, which normally would be no problem at all). When finished installing I saw the “Disk Performance” statistics (in the vSphere Client) peaking no higher than 7-8MB/s which was really frustrating. The esx-top utility on the command-line of the ESX-server gave the exact same results.
After some searching Arne Fokkema sent me a link where some people had similar problems on the VMware Communities and there was one response with someone who solved it by upgrading the firmware of the DL380’s Smart Array P410i Controller to version 2.00, and also by adding the Battery Pack for Smart Array to enable the Posted-Write Cache.
So here are the steps to take to solve this issue:
- Order the Battery Pack for Smart Array P212/P410/P411 (P/N: 462969-B21). Since ordering this can take some time it’s the smartest thing to do first
- Upgrade your Smart Array P410i Controller’s firmware to version 2.00. Which is not really easy of you’re not used to doing such. You can do this by:
- Downloading the latest HP ProLiant Firmware CD – which is version 8.60 at this moment and can be found here: http://bit.ly/1Luqts
- Download the Smart Array P410i v2.00 Firmware (both the CP011340.scexe and CP011340.md5 file) which can be found here: http://bit.ly/mDiqE
- Open the Firmware 8.60 ISO-file with your ISO-editor (PowerISO for example) and add the two files of the Smart Array firmware update and add them to the compaq\swpackages directory and save the ISO-file.
- Burn or mount the ISO through ILO on your server and boot from it and make it run all the Firmware-updates and it will automatically say it wants to update the Smart Array controller firmware to version 2.00, and this is what you need to do
- Furthermore, after receiving your Batttery Pack order, place it in the server and connect it to the memory of the Smart Array controller. If you don’t know how: consult the ProLiant DL380 G6 Manuals.
NOTE: The usage of the ‘altered’ HP ProLiant Firmware CD is necessary because normally you can run Firmware update like these from the server’s commandline or within Windows using the HP Smart Update tool. But ESXi 3.5 U4 lacks some commandline tools to do this.
After doing all of this you will still have to wait a few hours for the Battery Pack is fully charged, because the Posted-Write Cache will not work until then. After this your server will run on steroids and will reach up-to and above 70MB/s.
I hope I have saved you all lots of trouble finding the cause of the lack of disk performance on your brand-new server
We found out that too and since then any HP server we order comes up with the battery Pack option by default
Also, you can even more increase the bandwidth by enabling the Physical Drive Write Cache State setting that you can find in the Array Configuration Utility, a tool that runs under Windows. You must have a UPS to turn that thing on!
Cheers,
Didier
@PiroNet
I’m afraid that won’t work for us. We don’t have UPSes connected directly to the servers.
I had exactly the same problem.
Only firmware updates will not solve the problem.
I bought a 512mb bbwc controller (pn: 462967-B21) and my transfer rate was great.
In stead of 2 / 3 MB/s i’ve got now 70 till 100 MB/s disk transfer speed on my local disks.
HP Dl380G6
2x Quad Core
8 GB memory
4x 146 GB 10 K 2,5″inch disks in Raid 1+0
HP P410i controller 512mb BBWC
ESXi 4.0
I’m planning on buying an HP DL380 G6 and will use vmware ESXi 4.0 too with 3 VM (2 with Windows Server 2008 + 1 Linux) so this issue concerns me very much.
The model that is on stock right now in my country (Argentina) is 491324-001 which includes HP Smart Array P410i/256MB Controller.
What are my options? HP recommends 1) 512MB BBWC 462967-B21 2) Battery Kit upgrade (for BBWC) 462969-B21 3) 256MB Cache Module 462968-B21. But I’m not sure which one is for me. Do I need 512MB BBWC for use Battery Kit upgrade (for BBWC) 462969-B21?
I would appreciated your help.
Did you get this resolved?
I want to upgrade my server too but i dont know what i have to buy. I have the Smart Array P410i/256MB Controller too.
Thanks
gabrielpc1190 at gmail.com
Hi gabrielpc1190,
Buy a Battery Kit upgrade (for BBWC) 462969-B21.
Attach this to the connector on the cache and when the battery charges (may be 30mins to 2 hrs) then all will be fine.
If you are going to turn on Physical Drive Write Cache State make sure you have the server running off a UPS otherwise you may lose data on a unscheduled power outage.
I recommend that all servers should be on a suitable sized UPS with the monitoring/remote shutdown software installed.
It amazes me how many servers I see attached to UPS with no monitoring/remote shutdown software installed.
o.O
I installed the 512MB cache module with the battery backup unit, but I’m still experiencing AWFUL disk read/write performance. I’m running ESXi 4.1 U2. I’ve installed all of the latest firmware updates (Firmware DVD 9.30 plus the Service Pack disk from September 2011).
When I “F8″ into the controller setup at boot, I don’t see any options to verify/adjust the cache settings, so is there another way to do this?