Network problems with OpenBSD 4.6 on a IBM xSeries 335

[Mauro Rezzonico]

I get myself an IBM xSeries 335 model 8676 on eBay a couple of weeks
ago, installed OpenBSD 4.5 updated to 4.5-stable and did not notice any
problems...

Today I did a Fresh install of OpenBSD 4.6 and the network does not work!

Unfortunately I am not able to understand what's the matter, meaning
that the output of ifconfig & netstat look right to me, if I ping the
first configured NIC (bge0), output is like I'm pinging lo0, any other
IP (away, same segment, same machine) alway return 'Host is down'.

Additionally, the machine is now unable to reboot itself: it shows the
kernel message "Syncing disks" and then hangs (with OpenBSD 4.5 it did
properly reboot itself as long as powerdown itself).

As I said the machine is second hand from eBay, so there may be hardware
issues I am unaware of, but everything 'just worked fine' with OpenBSD
(I was able to checkout the 4.5-stable branch e recompile everything).

There is a fxp0 NIC installed in a PCI-X slot.

Moreover my network should not be the issue, as I have a HP Proliant
DL145 G2 on the same segment and on the same switch, that was running
OpenBSD 4.5 (following 4.5-stable), and received a fresh install of
OpenBSD 4.6 this morning (followed by a checkout of 4.6-stable and a
rebuild of everything) that is working perfectly fine...

Transcript follows (with dmesg, ifconfig, netstat etc)

**This is the dmesg with OpenBSD 4.5 GENERIC.MP**

OpenBSD 4.5 (GENERIC.MP) #108: Sat Feb 28 14:58:58 MST 2009
     deraadt@...:/usr/src/sys/arch/i386/compile/GENERIC.MP
cpu0: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
cpu0: CPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
real mem  = 3220766720 (3071MB)
avail mem = 3120787456 (2976MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 09/11/02, BIOS32 rev. 0 @ 0xfd7e1,
SMBIOS rev. 2.3 @ 0xf7141 (43 entries)
bios0: vendor IBM version "-[T2E110AUS-1.01]-" date 09/11/2002
bios0: IBM eserver xSeries 335 -[867665X]-
acpi0 at bios0: rev 0
acpi0: tables DSDT FACP APIC ASF!
acpi0: wakeup devices PCI0(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: apic clock running at 99MHz
cpu1 at mainbus0: apid 6 (application processor)
cpu1: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
cpu1: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
cpu2 at mainbus0: apid 1 (application processor)
cpu2: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
cpu2: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
cpu3 at mainbus0: apid 7 (application processor)
cpu3: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
cpu3: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
ioapic0 at mainbus0: apid 14 pa 0xfec00000, version 11, 16 pins
ioapic1 at mainbus0: apid 13 pa 0xfec01000, version 11, 16 pins
ioapic2 at mainbus0: apid 12 pa 0xfec02000, version 11, 16 pins
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 1 (PCI1)
acpiprt2 at acpi0: bus 2 (PCI2)
acpicpu0 at acpi0
acpicpu1 at acpi0
acpicpu2 at acpi0
acpicpu3 at acpi0
bios0: ROM list: 0xc0000/0x8000 0xc8000/0x4000 0xcc000/0x1800
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
pchb0 at pci0 dev 0 function 0 "ServerWorks CMIC-WS Host (GC-LE)" rev 0x13
pchb1 at pci0 dev 0 function 1 "ServerWorks CMIC-WS Host (GC-LE)" rev 0x00
pchb2 at pci0 dev 0 function 2 "ServerWorks CMIC-LE" rev 0x00
pci1 at pchb2 bus 1
mpi0 at pci1 dev 1 function 0 "Symbios Logic 53c1030" rev 0x07: apic 13
int 6 (irq 9)
scsibus0 at mpi0: 16 targets, initiator 7
sd0 at scsibus0 targ 0 lun 0: <IBM-ESXS, ST373405LC !#, B245> SCSI3
0/direct fixed
sd0: 70006MB, 512 bytes/sec, 143374000 sec total
safte0 at scsibus0 targ 8 lun 0: <IBM, 25P3495a S320 1, 1> SCSI2
3/processor fixed
mpi0: target 0 Sync at 80MHz width 16bit offset 63 QAS 0 DT 1 IU 0
vga1 at pci0 dev 1 function 0 "ATI Rage XL" rev 0x27
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
fxp0 at pci0 dev 2 function 0 "Intel 8255x" rev 0x0d, i82550: apic 13
int 0 (irq 10), address 00:02:b3:da:76:86
inphy0 at fxp0 phy 1: i82555 10/100 PHY, rev. 4
piixpm0 at pci0 dev 15 function 0 "ServerWorks CSB5" rev 0x93: polling
iic0 at piixpm0
spdmem0 at iic0 addr 0x50: 1GB DDR SDRAM registered ECC PC2100CL2.5
spdmem1 at iic0 addr 0x51: 512MB DDR SDRAM registered ECC PC2100CL2.5
spdmem2 at iic0 addr 0x52: 1GB DDR SDRAM registered ECC PC2100CL2.5
spdmem3 at iic0 addr 0x53: 512MB DDR SDRAM registered ECC PC2100CL2.5
pciide0 at pci0 dev 15 function 1 "ServerWorks CSB5 IDE" rev 0x93: DMA
atapiscsi0 at pciide0 channel 1 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, 2.9B> ATAPI 5/cdrom removable
cd0(pciide0:1:0): using PIO mode 4, DMA mode 2, Ultra-DMA mode 2
ohci0 at pci0 dev 15 function 2 "ServerWorks OSB4/CSB5 USB" rev 0x05:
apic 14 int 11 (irq 11), version 1.0, legacy support
pcib0 at pci0 dev 15 function 3 "ServerWorks CSB5 LPC" rev 0x00
pchb3 at pci0 dev 17 function 0 "ServerWorks CIOB-X2 PCIX" rev 0x03
pchb4 at pci0 dev 17 function 2 "ServerWorks CIOB-X2 PCIX" rev 0x03
pci2 at pchb4 bus 2
bge0 at pci2 dev 1 function 0 "Broadcom BCM5703X" rev 0x02, BCM5703 A2
(0x1002): apic 13 int 8 (irq 11), address 00:02:55:67:15:5e
brgphy0 at bge0 phy 1: BCM5703 10/100/1000baseT PHY, rev. 2
bge1 at pci2 dev 2 function 0 "Broadcom BCM5703X" rev 0x02, BCM5703 A2
(0x1002): apic 13 int 9 (irq 3), address 00:02:55:67:15:5f
brgphy1 at bge1 phy 1: BCM5703 10/100/1000baseT PHY, rev. 2
usb0 at ohci0: USB revision 1.0
uhub0 at usb0 "ServerWorks OHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pmsi0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pmsi0 mux 0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
mtrr: Pentium Pro MTRR support
softraid0 at root
root on sd0a swap on sd0b dump on sd0b
arp: attempt to add entry for 192.168.2.1 on bge0 by 00:50:bf:55:9e:83
on fxp0

**this is the log of a session captured over a serial line**

OpenBSD/i386 (dwa.ch23.lan) (tty00)

login: root
Password:
Last login: Thu Oct 22 20:30:31 on ttyC0
OpenBSD 4.6 (GENERIC.MP) #89: Thu Jul  9 21:32:39 MDT 2009

Welcome to OpenBSD

root@dwa:~# dmesg
OpenBSD 4.6 (GENERIC.MP) #89: Thu Jul  9 21:32:39 MDT 2009
     deraadt@...:/usr/src/sys/arch/i386/compile/GENERIC.MP
cpu0: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
real mem  = 4160290816 (3967MB)
avail mem = 4045332480 (3857MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 09/11/02, BIOS32 rev. 0 @ 0xfd7e1,
SMBIOS rev. 2.3 @ 0xf7141 (43 entries)
bios0: vendor IBM version "-[T2E110AUS-1.01]-" date 09/11/2002
bios0: IBM eserver xSeries 335 -[867665X]-
acpi0 at bios0: rev 0
acpi0: tables DSDT FACP APIC ASF!
acpi0: wakeup devices PCI0(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: apic clock running at 99MHz
cpu1 at mainbus0: apid 6 (application processor)
cpu1: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
cpu1: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
cpu2 at mainbus0: apid 1 (application processor)
cpu2: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
cpu2: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
cpu3 at mainbus0: apid 7 (application processor)
cpu3: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
cpu3: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
ioapic0 at mainbus0: apid 14 pa 0xfec00000, version 11, 16 pins
ioapic1 at mainbus0: apid 13 pa 0xfec01000, version 11, 16 pins
ioapic2 at mainbus0: apid 12 pa 0xfec02000, version 11, 16 pins
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 1 (PCI1)
acpiprt2 at acpi0: bus 2 (PCI2)
acpicpu0 at acpi0
acpicpu1 at acpi0
acpicpu2 at acpi0
acpicpu3 at acpi0
bios0: ROM list: 0xc0000/0x8000 0xc8000/0x4000 0xcc000/0x1800
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
pchb0 at pci0 dev 0 function 0 "ServerWorks CMIC-WS Host (GC-LE)" rev 0x13
pchb1 at pci0 dev 0 function 1 "ServerWorks CMIC-WS Host (GC-LE)" rev 0x00
pchb2 at pci0 dev 0 function 2 "ServerWorks CMIC-LE" rev 0x00
pci1 at pchb2 bus 1
mpi0 at pci1 dev 1 function 0 "Symbios Logic 53c1030" rev 0x07: apic 13
int 6 (irq 9)
scsibus0 at mpi0: 16 targets, initiator 7
sd0 at scsibus0 targ 0 lun 0: <IBM-ESXS, ST373405LC !#, B245> SCSI3
0/direct fixed
sd0: 70006MB, 512 bytes/sec, 143374000 sec total
safte0 at scsibus0 targ 8 lun 0: <IBM, 25P3495a S320 1, 1> SCSI2
3/processor fixed
mpi0: target 0 Sync at 80MHz width 16bit offset 63 QAS 0 DT 1 IU 0
vga1 at pci0 dev 1 function 0 "ATI Rage XL" rev 0x27
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
fxp0 at pci0 dev 2 function 0 "Intel 8255x" rev 0x0d, i82550: apic 13
int 0 (irq 10), address 00:02:b3:da:76:86
inphy0 at fxp0 phy 1: i82555 10/100 PHY, rev. 4
piixpm0 at pci0 dev 15 function 0 "ServerWorks CSB5" rev 0x93: polling
iic0 at piixpm0
spdmem0 at iic0 addr 0x50: 1GB DDR SDRAM registered ECC PC2100CL2.5
spdmem1 at iic0 addr 0x51: 1GB DDR SDRAM registered ECC PC2300CL2.5
spdmem2 at iic0 addr 0x52: 1GB DDR SDRAM registered ECC PC2100CL2.5
spdmem3 at iic0 addr 0x53: 1GB DDR SDRAM registered ECC PC2300CL2.5
pciide0 at pci0 dev 15 function 1 "ServerWorks CSB5 IDE" rev 0x93: DMA
atapiscsi0 at pciide0 channel 1 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, 2.9B> ATAPI 5/cdrom removable
cd0(pciide0:1:0): using PIO mode 4, DMA mode 2, Ultra-DMA mode 2
ohci0 at pci0 dev 15 function 2 "ServerWorks OSB4/CSB5 USB" rev 0x05:
apic 14 int 11 (irq 11), version 1.0, legacy support
pcib0 at pci0 dev 15 function 3 "ServerWorks CSB5 LPC" rev 0x00
pchb3 at pci0 dev 17 function 0 "ServerWorks CIOB-X2 PCIX" rev 0x03
pchb4 at pci0 dev 17 function 2 "ServerWorks CIOB-X2 PCIX" rev 0x03
pci2 at pchb4 bus 2
bge0 at pci2 dev 1 function 0 "Broadcom BCM5703X" rev 0x02, BCM5703 A2
(0x1002): apic 13 int 8 (irq 11), address 00:02:55:67:15:5e
brgphy0 at bge0 phy 1: BCM5703 10/100/1000baseT PHY, rev. 2
bge1 at pci2 dev 2 function 0 "Broadcom BCM5703X" rev 0x02, BCM5703 A2
(0x1002): apic 13 int 9 (irq 3), address 00:02:55:67:15:5f
brgphy1 at bge1 phy 1: BCM5703 10/100/1000baseT PHY, rev. 2
usb0 at ohci0: USB revision 1.0
uhub0 at usb0 "ServerWorks OHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pmsi0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pmsi0 mux 0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
mtrr: Pentium Pro MTRR support
softraid0 at root
root on sd0a swap on sd0b dump on sd0b
root@dwa:~# netstat -nrf inet
Routing tables

Internet:
Destination        Gateway            Flags   Refs      Use   Mtu  Prio
Iface
default            192.168.2.1        UGS        0        0     -     8 bge0
127/8              127.0.0.1          UGRS       0        0 33200     8 lo0
127.0.0.1          127.0.0.1          UH         1        0 33200     4 lo0
192.168.2/24       link#2             UC         2        0     -     4 bge0
192.168.2.1        link#2             UHRLc      1        6     -     4 bge0
192.168.2.2        link#2             UHRLc      1        6     -     4 bge0
224/4              127.0.0.1          URS        0        0 33200     8 lo0
root@dwa:~# ping 192.168.2.1
PING 192.168.2.1 (192.168.2.1): 56 data bytes
ping: sendto: Host is down
ping: wrote 192.168.2.1 64 chars, ret=-1
...
^C--- 192.168.2.1 ping statistics ---
12 packets transmitted, 0 packets received, 100.0% packet loss
root@dwa:~# ping 192.168.2.19
PING 192.168.2.19 (192.168.2.19): 56 data bytes
64 bytes from 192.168.2.19: icmp_seq=0 ttl=255 time=0.077 ms
...
^C--- 192.168.2.19 ping statistics ---
8 packets transmitted, 8 packets received, 0.0% packet loss
round-trip min/avg/max/std-dev = 0.026/0.033/0.077/0.017 ms
root@dwa:~# ping 192.168.2.20
PING 192.168.2.20 (192.168.2.20): 56 data bytes
^C--- 192.168.2.20 ping statistics ---
6 packets transmitted, 0 packets received, 100.0% packet loss
root@dwa:~# netstat -nrf inet
Routing tables

Internet:
Destination        Gateway            Flags   Refs      Use   Mtu  Prio
Iface
default            192.168.2.1        UGS        0        0     -     8 bge0
127/8              127.0.0.1          UGRS       0        0 33200     8 lo0
127.0.0.1          127.0.0.1          UH         1        0 33200     4 lo0
192.168.2/24       link#2             UC         4        0     -     4 bge0
192.168.2.1        link#2             UHLc       1       32     -     4 bge0
192.168.2.2        link#2             UHLc       1       21     -     4 bge0
192.168.2.19       00:02:55:67:15:5e  UHLc       0       16     -     4 lo0
192.168.2.20       link#2             UHRLc      0        6     -     4 bge0
224/4              127.0.0.1          URS        0        0 33200     8 lo0
root@dwa:~# ifconfig
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 33200
         priority: 0
         groups: lo
         inet 127.0.0.1 netmask 0xff000000
         inet6 ::1 prefixlen 128
         inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5
fxp0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> mtu 1500
         lladdr 00:02:b3:da:76:86
         priority: 0
         media: Ethernet autoselect (none)
         status: no carrier
bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
         lladdr 00:02:55:67:15:5e
         priority: 0
         groups: egress
         media: Ethernet autoselect (100baseTX full-duplex,rxpause,txpause)
         status: active
         inet 192.168.2.19 netmask 0xffffff00 broadcast 192.168.2.255
         inet6 fe80::202:55ff:fe67:155e%bge0 prefixlen 64 scopeid 0x2
bge1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
         lladdr 00:02:55:67:15:5f
         priority: 0
         media: Ethernet autoselect (100baseTX full-duplex,rxpause,txpause)
         status: active
         inet 192.168.2.20 netmask 0xffffff00 broadcast 192.168.2.255
         inet6 fe80::202:55ff:fe67:155f%bge1 prefixlen 64 scopeid 0x3
enc0: flags=0<> mtu 1536
         priority: 0
pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33200
         priority: 0
         groups: pflog
root@dwa:/etc# shutdown -r now
Shutdown NOW!
shutdown: [pid 18998]
root@dwa:/etc#

*** FINAL System shutdown message from root@... ***
System going down IMMEDIATELY

System shutdown time has arrived

--
Mauro Rezzonico <mauro@...>, Como, Italia
"Maybe this world is another planet's hell" - H.Huxley

[Jorge Enrique Valbuena Vargas]

What happend if you change the  bge1 interface to other network, example,
10.4.1.2 , for me, two interfaces on the same network, sometimes produces a
strange behavior.
I hope this can help !



On Thu, Oct 22, 2009 at 3:18 PM, Mauro Rezzonico <list@...> wrote:

> I get myself an IBM xSeries 335 model 8676 on eBay a couple of weeks ago,
> installed OpenBSD 4.5 updated to 4.5-stable and did not notice any
> problems...
>
> Today I did a Fresh install of OpenBSD 4.6 and the network does not work!
>
> Unfortunately I am not able to understand what's the matter, meaning that
> the output of ifconfig & netstat look right to me, if I ping the first
> configured NIC (bge0), output is like I'm pinging lo0, any other IP (away,
> same segment, same machine) alway return 'Host is down'.
>
> Additionally, the machine is now unable to reboot itself: it shows the
> kernel message "Syncing disks" and then hangs (with OpenBSD 4.5 it did
> properly reboot itself as long as powerdown itself).
>
> As I said the machine is second hand from eBay, so there may be hardware
> issues I am unaware of, but everything 'just worked fine' with OpenBSD (I
> was able to checkout the 4.5-stable branch e recompile everything).
>
> There is a fxp0 NIC installed in a PCI-X slot.
>
> Moreover my network should not be the issue, as I have a HP Proliant DL145
> G2 on the same segment and on the same switch, that was running OpenBSD 4.5
> (following 4.5-stable), and received a fresh install of OpenBSD 4.6 this
> morning (followed by a checkout of 4.6-stable and a rebuild of everything)
> that is working perfectly fine...
>
> Transcript follows (with dmesg, ifconfig, netstat etc)
>
> **This is the dmesg with OpenBSD 4.5 GENERIC.MP**
>
> OpenBSD 4.5 (GENERIC.MP) #108: Sat Feb 28 14:58:58 MST 2009
>    deraadt@...:/usr/src/sys/arch/i386/compile/GENERIC.MP
> cpu0: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
> cpu0: CPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
>  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
> real mem  = 3220766720 (3071MB)
> avail mem = 3120787456 (2976MB)
> mainbus0 at root
> bios0 at mainbus0: AT/286+ BIOS, date 09/11/02, BIOS32 rev. 0 @ 0xfd7e1,
> SMBIOS rev. 2.3 @ 0xf7141 (43 entries)
> bios0: vendor IBM version "-[T2E110AUS-1.01]-" date 09/11/2002
> bios0: IBM eserver xSeries 335 -[867665X]-
> acpi0 at bios0: rev 0
> acpi0: tables DSDT FACP APIC ASF!
> acpi0: wakeup devices PCI0(S5)
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: apic clock running at 99MHz
> cpu1 at mainbus0: apid 6 (application processor)
> cpu1: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
> cpu1: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
>  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
> cpu2 at mainbus0: apid 1 (application processor)
> cpu2: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
> cpu2: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
>  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
> cpu3 at mainbus0: apid 7 (application processor)
> cpu3: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
> cpu3: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
>  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
> ioapic0 at mainbus0: apid 14 pa 0xfec00000, version 11, 16 pins
> ioapic1 at mainbus0: apid 13 pa 0xfec01000, version 11, 16 pins
> ioapic2 at mainbus0: apid 12 pa 0xfec02000, version 11, 16 pins
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus 1 (PCI1)
> acpiprt2 at acpi0: bus 2 (PCI2)
> acpicpu0 at acpi0
> acpicpu1 at acpi0
> acpicpu2 at acpi0
> acpicpu3 at acpi0
> bios0: ROM list: 0xc0000/0x8000 0xc8000/0x4000 0xcc000/0x1800
> pci0 at mainbus0 bus 0: configuration mode 1 (bios)
> pchb0 at pci0 dev 0 function 0 "ServerWorks CMIC-WS Host (GC-LE)" rev 0x13
> pchb1 at pci0 dev 0 function 1 "ServerWorks CMIC-WS Host (GC-LE)" rev 0x00
> pchb2 at pci0 dev 0 function 2 "ServerWorks CMIC-LE" rev 0x00
> pci1 at pchb2 bus 1
> mpi0 at pci1 dev 1 function 0 "Symbios Logic 53c1030" rev 0x07: apic 13 int
> 6 (irq 9)
> scsibus0 at mpi0: 16 targets, initiator 7
> sd0 at scsibus0 targ 0 lun 0: <IBM-ESXS, ST373405LC !#, B245> SCSI3
> 0/direct fixed
> sd0: 70006MB, 512 bytes/sec, 143374000 sec total
> safte0 at scsibus0 targ 8 lun 0: <IBM, 25P3495a S320 1, 1> SCSI2
> 3/processor fixed
> mpi0: target 0 Sync at 80MHz width 16bit offset 63 QAS 0 DT 1 IU 0
> vga1 at pci0 dev 1 function 0 "ATI Rage XL" rev 0x27
> wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
> wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
> fxp0 at pci0 dev 2 function 0 "Intel 8255x" rev 0x0d, i82550: apic 13 int 0
> (irq 10), address 00:02:b3:da:76:86
> inphy0 at fxp0 phy 1: i82555 10/100 PHY, rev. 4
> piixpm0 at pci0 dev 15 function 0 "ServerWorks CSB5" rev 0x93: polling
> iic0 at piixpm0
> spdmem0 at iic0 addr 0x50: 1GB DDR SDRAM registered ECC PC2100CL2.5
> spdmem1 at iic0 addr 0x51: 512MB DDR SDRAM registered ECC PC2100CL2.5
> spdmem2 at iic0 addr 0x52: 1GB DDR SDRAM registered ECC PC2100CL2.5
> spdmem3 at iic0 addr 0x53: 512MB DDR SDRAM registered ECC PC2100CL2.5
> pciide0 at pci0 dev 15 function 1 "ServerWorks CSB5 IDE" rev 0x93: DMA
> atapiscsi0 at pciide0 channel 1 drive 0
> scsibus1 at atapiscsi0: 2 targets
> cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, 2.9B> ATAPI 5/cdrom removable
> cd0(pciide0:1:0): using PIO mode 4, DMA mode 2, Ultra-DMA mode 2
> ohci0 at pci0 dev 15 function 2 "ServerWorks OSB4/CSB5 USB" rev 0x05: apic
> 14 int 11 (irq 11), version 1.0, legacy support
> pcib0 at pci0 dev 15 function 3 "ServerWorks CSB5 LPC" rev 0x00
> pchb3 at pci0 dev 17 function 0 "ServerWorks CIOB-X2 PCIX" rev 0x03
> pchb4 at pci0 dev 17 function 2 "ServerWorks CIOB-X2 PCIX" rev 0x03
> pci2 at pchb4 bus 2
> bge0 at pci2 dev 1 function 0 "Broadcom BCM5703X" rev 0x02, BCM5703 A2
> (0x1002): apic 13 int 8 (irq 11), address 00:02:55:67:15:5e
> brgphy0 at bge0 phy 1: BCM5703 10/100/1000baseT PHY, rev. 2
> bge1 at pci2 dev 2 function 0 "Broadcom BCM5703X" rev 0x02, BCM5703 A2
> (0x1002): apic 13 int 9 (irq 3), address 00:02:55:67:15:5f
> brgphy1 at bge1 phy 1: BCM5703 10/100/1000baseT PHY, rev. 2
> usb0 at ohci0: USB revision 1.0
> uhub0 at usb0 "ServerWorks OHCI root hub" rev 1.00/1.00 addr 1
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> pckbc0 at isa0 port 0x60/5
> pckbd0 at pckbc0 (kbd slot)
> pckbc0: using irq 1 for kbd slot
> wskbd0 at pckbd0: console keyboard, using wsdisplay0
> pmsi0 at pckbc0 (aux slot)
> pckbc0: using irq 12 for aux slot
> wsmouse0 at pmsi0 mux 0
> pcppi0 at isa0 port 0x61
> midi0 at pcppi0: <PC speaker>
> spkr0 at pcppi0
> npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
> fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
> fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
> mtrr: Pentium Pro MTRR support
> softraid0 at root
> root on sd0a swap on sd0b dump on sd0b
> arp: attempt to add entry for 192.168.2.1 on bge0 by 00:50:bf:55:9e:83 on
> fxp0
>
> **this is the log of a session captured over a serial line**
>
> OpenBSD/i386 (dwa.ch23.lan) (tty00)
>
> login: root
> Password:
> Last login: Thu Oct 22 20:30:31 on ttyC0
> OpenBSD 4.6 (GENERIC.MP) #89: Thu Jul  9 21:32:39 MDT 2009
>
> Welcome to OpenBSD
>
> root@dwa:~# dmesg
> OpenBSD 4.6 (GENERIC.MP) #89: Thu Jul  9 21:32:39 MDT 2009
>    deraadt@...:/usr/src/sys/arch/i386/compile/GENERIC.MP
> cpu0: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
> cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
>  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
> real mem  = 4160290816 (3967MB)
> avail mem = 4045332480 (3857MB)
> mainbus0 at root
> bios0 at mainbus0: AT/286+ BIOS, date 09/11/02, BIOS32 rev. 0 @ 0xfd7e1,
> SMBIOS rev. 2.3 @ 0xf7141 (43 entries)
> bios0: vendor IBM version "-[T2E110AUS-1.01]-" date 09/11/2002
> bios0: IBM eserver xSeries 335 -[867665X]-
> acpi0 at bios0: rev 0
> acpi0: tables DSDT FACP APIC ASF!
> acpi0: wakeup devices PCI0(S5)
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: apic clock running at 99MHz
> cpu1 at mainbus0: apid 6 (application processor)
> cpu1: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
> cpu1: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
>  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
> cpu2 at mainbus0: apid 1 (application processor)
> cpu2: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
> cpu2: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
>  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
> cpu3 at mainbus0: apid 7 (application processor)
> cpu3: Intel(R) XEON(TM) CPU 2.40GHz ("GenuineIntel" 686-class) 2.40 GHz
> cpu3: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
>  PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM
> ioapic0 at mainbus0: apid 14 pa 0xfec00000, version 11, 16 pins
> ioapic1 at mainbus0: apid 13 pa 0xfec01000, version 11, 16 pins
> ioapic2 at mainbus0: apid 12 pa 0xfec02000, version 11, 16 pins
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus 1 (PCI1)
> acpiprt2 at acpi0: bus 2 (PCI2)
> acpicpu0 at acpi0
> acpicpu1 at acpi0
> acpicpu2 at acpi0
> acpicpu3 at acpi0
> bios0: ROM list: 0xc0000/0x8000 0xc8000/0x4000 0xcc000/0x1800
> pci0 at mainbus0 bus 0: configuration mode 1 (bios)
> pchb0 at pci0 dev 0 function 0 "ServerWorks CMIC-WS Host (GC-LE)" rev 0x13
> pchb1 at pci0 dev 0 function 1 "ServerWorks CMIC-WS Host (GC-LE)" rev 0x00
> pchb2 at pci0 dev 0 function 2 "ServerWorks CMIC-LE" rev 0x00
> pci1 at pchb2 bus 1
> mpi0 at pci1 dev 1 function 0 "Symbios Logic 53c1030" rev 0x07: apic 13 int
> 6 (irq 9)
> scsibus0 at mpi0: 16 targets, initiator 7
> sd0 at scsibus0 targ 0 lun 0: <IBM-ESXS, ST373405LC !#, B245> SCSI3
> 0/direct fixed
> sd0: 70006MB, 512 bytes/sec, 143374000 sec total
> safte0 at scsibus0 targ 8 lun 0: <IBM, 25P3495a S320 1, 1> SCSI2
> 3/processor fixed
> mpi0: target 0 Sync at 80MHz width 16bit offset 63 QAS 0 DT 1 IU 0
> vga1 at pci0 dev 1 function 0 "ATI Rage XL" rev 0x27
> wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
> wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
> fxp0 at pci0 dev 2 function 0 "Intel 8255x" rev 0x0d, i82550: apic 13 int 0
> (irq 10), address 00:02:b3:da:76:86
> inphy0 at fxp0 phy 1: i82555 10/100 PHY, rev. 4
> piixpm0 at pci0 dev 15 function 0 "ServerWorks CSB5" rev 0x93: polling
> iic0 at piixpm0
> spdmem0 at iic0 addr 0x50: 1GB DDR SDRAM registered ECC PC2100CL2.5
> spdmem1 at iic0 addr 0x51: 1GB DDR SDRAM registered ECC PC2300CL2.5
> spdmem2 at iic0 addr 0x52: 1GB DDR SDRAM registered ECC PC2100CL2.5
> spdmem3 at iic0 addr 0x53: 1GB DDR SDRAM registered ECC PC2300CL2.5
> pciide0 at pci0 dev 15 function 1 "ServerWorks CSB5 IDE" rev 0x93: DMA
> atapiscsi0 at pciide0 channel 1 drive 0
> scsibus1 at atapiscsi0: 2 targets
> cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, 2.9B> ATAPI 5/cdrom removable
> cd0(pciide0:1:0): using PIO mode 4, DMA mode 2, Ultra-DMA mode 2
> ohci0 at pci0 dev 15 function 2 "ServerWorks OSB4/CSB5 USB" rev 0x05: apic
> 14 int 11 (irq 11), version 1.0, legacy support
> pcib0 at pci0 dev 15 function 3 "ServerWorks CSB5 LPC" rev 0x00
> pchb3 at pci0 dev 17 function 0 "ServerWorks CIOB-X2 PCIX" rev 0x03
> pchb4 at pci0 dev 17 function 2 "ServerWorks CIOB-X2 PCIX" rev 0x03
> pci2 at pchb4 bus 2
> bge0 at pci2 dev 1 function 0 "Broadcom BCM5703X" rev 0x02, BCM5703 A2
> (0x1002): apic 13 int 8 (irq 11), address 00:02:55:67:15:5e
> brgphy0 at bge0 phy 1: BCM5703 10/100/1000baseT PHY, rev. 2
> bge1 at pci2 dev 2 function 0 "Broadcom BCM5703X" rev 0x02, BCM5703 A2
> (0x1002): apic 13 int 9 (irq 3), address 00:02:55:67:15:5f
> brgphy1 at bge1 phy 1: BCM5703 10/100/1000baseT PHY, rev. 2
> usb0 at ohci0: USB revision 1.0
> uhub0 at usb0 "ServerWorks OHCI root hub" rev 1.00/1.00 addr 1
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> pckbc0 at isa0 port 0x60/5
> pckbd0 at pckbc0 (kbd slot)
> pckbc0: using irq 1 for kbd slot
> wskbd0 at pckbd0: console keyboard, using wsdisplay0
> pmsi0 at pckbc0 (aux slot)
> pckbc0: using irq 12 for aux slot
> wsmouse0 at pmsi0 mux 0
> pcppi0 at isa0 port 0x61
> midi0 at pcppi0: <PC speaker>
> spkr0 at pcppi0
> npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
> fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
> fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
> mtrr: Pentium Pro MTRR support
> softraid0 at root
> root on sd0a swap on sd0b dump on sd0b
> root@dwa:~# netstat -nrf inet
> Routing tables
>
> Internet:
> Destination        Gateway            Flags   Refs      Use   Mtu  Prio
> Iface
> default            192.168.2.1        UGS        0        0     -     8
> bge0
> 127/8              127.0.0.1          UGRS       0        0 33200     8 lo0
> 127.0.0.1          127.0.0.1          UH         1        0 33200     4 lo0
> 192.168.2/24       link#2             UC         2        0     -     4
> bge0
> 192.168.2.1        link#2             UHRLc      1        6     -     4
> bge0
> 192.168.2.2        link#2             UHRLc      1        6     -     4
> bge0
> 224/4              127.0.0.1          URS        0        0 33200     8 lo0
> root@dwa:~# ping 192.168.2.1
> PING 192.168.2.1 (192.168.2.1): 56 data bytes
> ping: sendto: Host is down
> ping: wrote 192.168.2.1 64 chars, ret=-1
> ...
> ^C--- 192.168.2.1 ping statistics ---
> 12 packets transmitted, 0 packets received, 100.0% packet loss
> root@dwa:~# ping 192.168.2.19
> PING 192.168.2.19 (192.168.2.19): 56 data bytes
> 64 bytes from 192.168.2.19: icmp_seq=0 ttl=255 time=0.077 ms
> ...
> ^C--- 192.168.2.19 ping statistics ---
> 8 packets transmitted, 8 packets received, 0.0% packet loss
> round-trip min/avg/max/std-dev = 0.026/0.033/0.077/0.017 ms
> root@dwa:~# ping 192.168.2.20
> PING 192.168.2.20 (192.168.2.20): 56 data bytes
> ^C--- 192.168.2.20 ping statistics ---
> 6 packets transmitted, 0 packets received, 100.0% packet loss
> root@dwa:~# netstat -nrf inet
> Routing tables
>
> Internet:
> Destination        Gateway            Flags   Refs      Use   Mtu  Prio
> Iface
> default            192.168.2.1        UGS        0        0     -     8
> bge0
> 127/8              127.0.0.1          UGRS       0        0 33200     8 lo0
> 127.0.0.1          127.0.0.1          UH         1        0 33200     4 lo0
> 192.168.2/24       link#2             UC         4        0     -     4
> bge0
> 192.168.2.1        link#2             UHLc       1       32     -     4
> bge0
> 192.168.2.2        link#2             UHLc       1       21     -     4
> bge0
> 192.168.2.19       00:02:55:67:15:5e  UHLc       0       16     -     4 lo0
> 192.168.2.20       link#2             UHRLc      0        6     -     4
> bge0
> 224/4              127.0.0.1          URS        0        0 33200     8 lo0
> root@dwa:~# ifconfig
> lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 33200
>        priority: 0
>        groups: lo
>        inet 127.0.0.1 netmask 0xff000000
>        inet6 ::1 prefixlen 128
>        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5
> fxp0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> mtu 1500
>        lladdr 00:02:b3:da:76:86
>        priority: 0
>        media: Ethernet autoselect (none)
>        status: no carrier
> bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>        lladdr 00:02:55:67:15:5e
>        priority: 0
>        groups: egress
>        media: Ethernet autoselect (100baseTX full-duplex,rxpause,txpause)
>        status: active
>        inet 192.168.2.19 netmask 0xffffff00 broadcast 192.168.2.255
>        inet6 fe80::202:55ff:fe67:155e%bge0 prefixlen 64 scopeid 0x2
> bge1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>        lladdr 00:02:55:67:15:5f
>        priority: 0
>        media: Ethernet autoselect (100baseTX full-duplex,rxpause,txpause)
>        status: active
>        inet 192.168.2.20 netmask 0xffffff00 broadcast 192.168.2.255
>        inet6 fe80::202:55ff:fe67:155f%bge1 prefixlen 64 scopeid 0x3
> enc0: flags=0<> mtu 1536
>        priority: 0
> pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33200
>        priority: 0
>        groups: pflog
> root@dwa:/etc# shutdown -r now
> Shutdown NOW!
> shutdown: [pid 18998]
> root@dwa:/etc#
> *** FINAL System shutdown message from root@... ***
> System going down IMMEDIATELY
> System shutdown time has arrived
>
> --
> Mauro Rezzonico <mauro@...>, Como, Italia
> "Maybe this world is another planet's hell" - H.Huxley

[Mauro Rezzonico]

What bugs me the most is that on:
http://www.openbsd.org/images/newrack.jpg you can see at least three 1U
IBM xSeries eServers.
So it looks like (for Theo at least) running the latest version DOES
work! And Still I am unable to diagnose mi problem!!!

--
Mauro Rezzonico <mauro@...>, Como, Italia
"Maybe this world is another planet's hell" - H.Huxley

[Mauro Rezzonico]

It appears that installing from a recent snapshot totally solved the
problem...

Many public Thanks to Noah Pugsley for pointing me to the right
direction (off-list).

Now, on the very same machine I experience a totally different and
unrelated problem:
I enabled RAID1 (mirroring) on the embedded Symbios Logic 53c1030
hardware raid controller, now OpenBSD complains filling the console
every few seconds with: "mpi0: can't get RAID vol cfg page 0".
I must add that at this very moment the hardware raid controller is
actively rebuilding the mirror (copying a 36Gb primary disk with my
install over an identical, but empty secondary disk).

Beside the fact that I am too n00b to understand the meaning to the
message, here there is my question: when you can do RAID1 both hardware
and in software, what do you do?

(Please: Leave aside the issue of the "crappy controllers" and/or the
issue of the vendor not disclosing the API etc. etc. I am not here for
the flames, even when they are funny and/or monkeys related)

1. Do you *always* trust the OS more than the firmware?
2. Do you trust at least /some/ of the hardware raid controllers?
2.5 Is my "Symbios Logic 53c1030" one of the trustable ones?
3. Do you consider that an hardware controller rebuilds without
bothering the OS and the CPU and give some merit to the thing?
4. Etc. Etc.

--
Mauro Rezzonico <mauro@...>, Como, Italia
"Maybe this world is another planet's hell" - H.Huxley