Skip to main content

HBA & multipathing on RHEL

Introduction
The firmware gets updated by the driver or each time the "qla2300" or "qla2400" modules are loaded. Drivers need specific firmware versions. Nevertheless here's QLogic firmware repo :ftp.qlogic.com/outgoing/linux/firmware/

Note. it's ok to have a more recent BIOS than firmware, but not the contrary.


Driver & Firmware installation
The driver should be included into the RHEL distribution. If not, use constructor's provided one e.g.,
make sure you have the gcc package,
rpm -q gcc
and install the driver,
./INSTALL -h
./INSTALL -f -a

Note. make sure the default binary isn't a link to gcc 2.95 (as it's sometimes the case on Oracle installs),
ll /usr/bin/gcc
or check that the gcc version matches the distribution build,
dmesg | head -1
/usr/bin/gcc --version


Driver, firmware and BIOS versions
To check the driver and firmware versions,
cat /proc/scsi/qla2300/1 | grep Firmware

To check the BIOS version, either note it during machine's boot process, or use SANsurfer.


SANsurfer installation
Install the SANsurfer agent on the server and use the SANsurfer Windows GUI to access it. Note. the default password for SANsurfer is "config".


BIOS update
SANsurfer allows you to update HBA's BIOS, FCode and NVRAM (if you do so, read multi-boot's image release notes).


Failover & multipathing
SANsurfer
SANsurfer also allows you to configure failover and multipathing. It uses that module,
qla2xxx_conf
with that configuration file,
/etc/hba.conf

DS4000
Prerequesties,
yum install kernel-devel kernel-headers gcc
yum update kernel
sync
reboot
and check after boot,
uname -r
ls -l /lib/modules

Install IBM RDAC,
tar xvzf rdac-LINUX-09.03.0C05.0030-source.tar.gz
cd linuxrdac-09.03.0C05.0030
make clean
make
make install

Edit GRUB,
cd /boot/grub
vi menu.lst
add above the other titles (default=0),
title CentOS (2.6.18-164.el5) with MPP support
root (hd0,0)
kernel /vmlinuz-2.6.18-164.el5 ro root=LABEL=/
initrd /mpp-2.6.18-164.el5.img
N.B. change kernel package version accordingly

Reboot and before Redhat starts up, connect the fiber channel cables,
shutdown -r now
once started check everything's fine,
fdisk -l
sfdisk -s
Note. you should see one multipathed disk per LUN, as sdX.

Redhat multipathing
Prerequesties,
rpm -q device-mapper-multipath

Configure,
cd /etc
mv multipath.conf multipath.conf.dist
sed '/^#/d; /^$/d' multipath.conf.dist > multipath.conf
vi multipath.conf
change to blacklist local harddrive only,
blacklist {
devnode "sda"
}
enable,
service multipathd start
chkconfig multipathd on
check everything's fine,
fdisk -l
sfdisk -s

Note. SLES names it "multipath-tools"
Note. the old method was to use an "md" raid device on both pathes, treating one path as spare,
#mdadm --create -f -lmp -n2 -x1 /dev/md0 /dev/<channela> /dev/<channelb>
Note. make sure write cach mirroring is enabled (marc.info/?l=linux-lvm&m=108690553031551&w=2).

EMC
Use PowerPath. Also install "navihostagent" and "navicli".

IBM ESS, DS600, DS9000
Use "sdd" for failover and load balancing.


Labels:

Popular posts from this blog

Fixing Tanzu Kubernetes Pod to External Services Connectivity Issues with NSX-T

Fixing Tanzu Kubernetes Pod to External Services Connectivity Issues with NSX-T Last month I got a call from a customer who was pulling their hair out over a networking issue. They had just deployed VMware Tanzu Kubernetes Grid on their vSphere with Tanzu environment, everything looked good in the dashboards, all pods were running, but their applications inside the pods could not reach external databases running on traditional VMs in the same datacenter. The frustrating part was that some pods could reach external services perfectly fine, while others would just timeout. There was no clear pattern. Let me tell you how we figured this out and fixed it. The Initial Problem Here is what the customer setup looked like: vSphere 8.0 with Tanzu enabled NSX-T 4.1.2 for networking Three Tanzu Kubernetes clusters running different microservices applications External PostgreSQL database running on traditional VMs (non-Kubernetes) External API services running on another se...
Read more

Troubleshooting vSAN Storage Policy Migration Failures in VMware Cloud Foundation 9.0

Recently I had a customer who migrated their VMware infrastructure from vSphere 7.0 to VMware Cloud Foundation 9.0. After the migration, they wanted to update their vSAN storage policies to take advantage of the new vSAN ESA (Express Storage Architecture) features. However, when they tried to change the storage policy for their production VMs, the operation kept failing with a cryptic error message. The error they were getting was: "Cannot complete operation due to insufficient resources to satisfy current storage policy." This was strange because they had plenty of disk space available. The vSAN cluster was only at 45% capacity, and all the hosts were healthy. Let me walk through how we troubleshooted and fixed this issue. Understanding the Problem First, let's understand what was happening in their environment: They had a 6-node vSAN cluster running VCF 9.0 vSAN was configured with the new ESA architecture They were trying to migrate VMs fro...
Read more

Unlocking VMware Cloud Foundation 9.0: A Strategic Blueprint for Enterprise Transformation

The evolution of VMware under Broadcom represents not disruption, but clarification—a focused vision toward unified private cloud excellence. As organizations navigate this transformation, the opportunity has never been greater to build truly modern, efficient, and powerful infrastructure with VMware Cloud Foundation. After architecting VMware solutions across diverse enterprise environments, I've observed a pattern: organizations that embrace VMware Cloud Foundation (VCF) strategically—rather than viewing the transition as a burden—emerge with significantly more capable, cost-effective, and future-ready infrastructure. This post shares a practical framework for successfully modernizing your VMware environment, maximizing your investment, and positioning your organization for the AI-driven, cloud-native future. Understanding the VMware Cloud Foundation Vision Let's start with clarity about what Broadcom and VMware are building: VMware Cloud Foundati...
Read more