| Last reviewed: 06/02/2009 | |
| HP iLO2 NMI Watchdog Driver | |
| NMI sourcing for iLO2 based ProLiant Servers | |
| Documentation and Driver by | |
| Thomas Mingarelli <thomas.mingarelli@hp.com> | |
| The HP iLO2 NMI Watchdog driver is a kernel module that provides basic | |
| watchdog functionality and the added benefit of NMI sourcing. Both the | |
| watchdog functionality and the NMI sourcing capability need to be enabled | |
| by the user. Remember that the two modes are not dependent on one another. | |
| A user can have the NMI sourcing without the watchdog timer and vice-versa. | |
| Watchdog functionality is enabled like any other common watchdog driver. That | |
| is, an application needs to be started that kicks off the watchdog timer. A | |
| basic application exists in the Documentation/watchdog/src directory called | |
| watchdog-test.c. Simply compile the C file and kick it off. If the system | |
| gets into a bad state and hangs, the HP ProLiant iLO 2 timer register will | |
| not be updated in a timely fashion and a hardware system reset (also known as | |
| an Automatic Server Recovery (ASR)) event will occur. | |
| The hpwdt driver also has four (4) module parameters. They are the following: | |
| soft_margin - allows the user to set the watchdog timer value | |
| allow_kdump - allows the user to save off a kernel dump image after an NMI | |
| nowayout - basic watchdog parameter that does not allow the timer to | |
| be restarted or an impending ASR to be escaped. | |
| priority - determines whether or not the hpwdt driver is first on the | |
| die_notify list to handle NMIs or last. The default value | |
| for this module parameter is 0 or LAST. If the user wants to | |
| enable NMI sourcing then reload the hpwdt driver with | |
| priority=1 (and boot with nmi_watchdog=0). | |
| NOTE: More information about watchdog drivers in general, including the ioctl | |
| interface to /dev/watchdog can be found in | |
| Documentation/watchdog/watchdog-api.txt and Documentation/IPMI.txt. | |
| The priority parameter was introduced due to other kernel software that relied | |
| on handling NMIs (like oprofile). Keeping hpwdt's priority at 0 (or LAST) | |
| enables the users of NMIs for non critical events to be work as expected. | |
| The NMI sourcing capability is disabled by default due to the inability to | |
| distinguish between "NMI Watchdog Ticks" and "HW generated NMI events" in the | |
| Linux kernel. What this means is that the hpwdt nmi handler code is called | |
| each time the NMI signal fires off. This could amount to several thousands of | |
| NMIs in a matter of seconds. If a user sees the Linux kernel's "dazed and | |
| confused" message in the logs or if the system gets into a hung state, then | |
| the hpwdt driver can be reloaded with the "priority" module parameter set | |
| (priority=1). | |
| 1. If the kernel has not been booted with nmi_watchdog turned off then | |
| edit /boot/grub/menu.lst and place the nmi_watchdog=0 at the end of the | |
| currently booting kernel line. | |
| 2. reboot the sever | |
| 3. Once the system comes up perform a rmmod hpwdt | |
| 4. insmod /lib/modules/`uname -r`/kernel/drivers/char/watchdog/hpwdt.ko priority=1 | |
| Now, the hpwdt can successfully receive and source the NMI and provide a log | |
| message that details the reason for the NMI (as determined by the HP BIOS). | |
| Below is a list of NMIs the HP BIOS understands along with the associated | |
| code (reason): | |
| No source found 00h | |
| Uncorrectable Memory Error 01h | |
| ASR NMI 1Bh | |
| PCI Parity Error 20h | |
| NMI Button Press 27h | |
| SB_BUS_NMI 28h | |
| ILO Doorbell NMI 29h | |
| ILO IOP NMI 2Ah | |
| ILO Watchdog NMI 2Bh | |
| Proc Throt NMI 2Ch | |
| Front Side Bus NMI 2Dh | |
| PCI Express Error 2Fh | |
| DMA controller NMI 30h | |
| Hypertransport/CSI Error 31h | |
| -- Tom Mingarelli | |
| (thomas.mingarelli@hp.com) |