We (our IT manager and myself) have been having some fun with out shiny new VMWare ESX 3.5 server. We have had it running for about two weeks now and we decided to change it’s IP address. The ESX server was on the same subnet as our LAN. This meant that it the virtual machines were taking IP addresses out of a pool that was needed for our physical computers. There were some other security issues, so we decided to put it on it’s own subnet.
It was fairly easy to change the IP address address via the command line (this site helped a lot), the fun started with the NFS connection. We are using NFS to mount a folder located on a Windows file server to add some offline storage for the ESX box. To mount with NFS, you have to create a VMKernel in the ESX networking and the VMKernel gets it’s own IP address. That IP address must be on the same subnet as the NFS server.
When we moved the ESX to it’s own subnet, we put it on it’s own physical network and that broke the NFS connection. We tried a few things and then we checked the Windows box that was running the NFS server. It had two network cards. The second one was not enabled, but fully functional. We enabled it and set it’s IP address to the subnet of the ESX box. I had to drop and recreate the NFS mount, but it all worked.
While testing the networking, the IT manager was running one of the virtual machines (XP 64-bit) and set the network adapter in the VM to a static IP address. It turned out he set it to the IP address of the ESX server. That’s when the fun started. When you connected to the VM, ESX would lose it’s connection and you lost control over ESX and the VM. After a minute or two, you could access ESX through the VMWare Infrastructure Client, but you couldn’t access the VM to change it’s IP address.
We racked our brains trying to figure out how to get control of the VM to reset it’s IP address. The fix turned out to be really simple. I powered down the VM from VIC and edited it’s hardware settings. I added a second network adapter (it’s all virtual) and set the first one to be disconnected. I powered the VM back up and the new adapter had a safe IP address. I connected to the VM’s console and opened up “Network Connections” in Windows. The first adapter was enabled, but not connected. I opened up it’s properties and set it to grab an IP through DHCP.
I powered down the VM, removed the second adapter, and reconnected the first one. I rebooted the VM and it had a new IP address. Peace and harmony reigned through my virtual kingdom.