This is a small desktop / short tower case which is connected to a couple of tape libraries.
This post replaces a previous post.
Partitions
[dan@tape01:~] $ gpart show => 40 5860533088 ada0 GPT (2.7T) 40 1024 1 freebsd-boot (512K) 1064 984 - free - (492K) 2048 4194304 2 freebsd-swap (2.0G) 4196352 5856335872 3 freebsd-zfs (2.7T) 5860532224 904 - free - (452K) => 40 5860533088 ada1 GPT (2.7T) 40 1024 1 freebsd-boot (512K) 1064 984 - free - (492K) 2048 4194304 2 freebsd-swap (2.0G) 4196352 5856335872 3 freebsd-zfs (2.7T) 5860532224 904 - free - (452K)
zpools
Well. That’s not good.
[dan@tape01:~] $ zpool status pool: zroot state: DEGRADED status: One or more devices could not be opened. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Attach the missing device and online it using 'zpool online'. see: http://illumos.org/msg/ZFS-8000-2Q scan: none requested config: NAME STATE READ WRITE CKSUM zroot DEGRADED 0 0 0 mirror-0 DEGRADED 0 0 0 91228858897502323 UNAVAIL 0 0 0 was /dev/ada0p3 ada1p3 ONLINE 0 0 0 gpt/zfs2 ONLINE 0 0 0 errors: No known data errors [dan@tape01:~] $
This appears to be a three-way mirror with one missing drive. Let’s get rid of that drive from the configuration by removing it, logically.
First, detach the device:
[dan@tape01:~] $ sudo zpool detach zroot 91228858897502323 [dan@tape01:~] $ zpool status pool: zroot state: ONLINE status: Some supported features are not enabled on the pool. The pool can still be used, but some features are unavailable. action: Enable all features using 'zpool upgrade'. Once this is done, the pool may no longer be accessible by software that does not support the features. See zpool-features(7) for details. scan: none requested config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada1p3 ONLINE 0 0 0 ada0p3 ONLINE 0 0 0 errors: No known data errors
Do the zpool upgrade:
[dan@tape01:~] $ sudo zpool upgrade zroot This system supports ZFS pool feature flags. Enabled the following features on 'zroot': large_dnode device_removal obsolete_counts zpool_checkpoint spacemap_v2 If you boot from pool 'zroot', don't forget to update boot code. Assuming you use GPT partitioning and da0 is your boot disk the following command will do it: gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 da0
We need to update the boot code so boot will always work. Do every drive you might boot from. This means every drive.
partcode written to ada0p1 bootcode written to ada0 [dan@tape01:~] $ sudo gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ada1 partcode written to ada1p1 bootcode written to ada1 [dan@tape01:~] $ zpool status pool: zroot state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada1p3 ONLINE 0 0 0 ada0p3 ONLINE 0 0 0 errors: No known data errors
Let’s do a scrub, just because we can.
[dan@tape01:~] $ sudo zpool scrub zroot [dan@tape01:~] $ zpool status pool: zroot state: ONLINE scan: scrub repaired 0 in 0 days 00:00:41 with 0 errors on Tue Jan 7 19:37:15 2020 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada1p3 ONLINE 0 0 0 ada0p3 ONLINE 0 0 0 errors: No known data errors
All good now.
Filesystems
The filesystems:
[dan@tape01:~] $ zfs list NAME USED AVAIL REFER MOUNTPOINT zroot 1.42G 2.63T 88K /zroot zroot/ROOT 1.41G 2.63T 88K none zroot/ROOT/default 1.41G 2.63T 1.41G / zroot/tmp 192K 2.63T 192K /tmp zroot/usr 472K 2.63T 88K /usr zroot/usr/home 208K 2.63T 208K /usr/home zroot/usr/ports 88K 2.63T 88K /usr/ports zroot/usr/src 88K 2.63T 88K /usr/src zroot/var 996K 2.63T 88K /var zroot/var/audit 88K 2.63T 88K /var/audit zroot/var/crash 88K 2.63T 88K /var/crash zroot/var/log 504K 2.63T 504K /var/log zroot/var/mail 112K 2.63T 112K /var/mail zroot/var/tmp 116K 2.63T 116K /var/tmp [dan@tape01:~] $
dmesg
And dmesg:
[dan@tape01:~] $ cat /var/run/dmesg.boot Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.2-RELEASE-p4 #0: Thu Sep 27 08:16:24 UTC 2018 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) VT(vga): resolution 640x480 CPU: AMD Opteron(tm) Processor 6128 (2000.04-MHz K8-class CPU) Origin="AuthenticAMD" Id=0x100f91 Family=0x10 Model=0x9 Stepping=1 Features=0x178bfbffFeatures2=0x802009 AMD Features=0xee500800 AMD Features2=0x837ff SVM: NP,NRIP,NAsids=64 TSC: P-state invariant real memory = 34359738368 (32768 MB) avail memory = 33311207424 (31768 MB) Event timer "LAPIC" quality 100 ACPI APIC Table: <083112 APIC1535> FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 8 core(s) Firmware Warning (ACPI): 32/64X length mismatch in FADT/Gpe0Block: 64/32 (20171214/tbfadt-748) ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-55 on motherboard SMP: AP CPU #1 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #3 Launched! Timecounter "TSC" frequency 2000040859 Hz quality 800 random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff80ff4580, 0) error 19 nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: irq 53 at device 9.0 on pci0 pci1: on pcib1 em0: port 0xb800-0xb81f mem 0xfdde0000-0xfddfffff,0xfdddc000-0xfdddffff irq 48 at device 0.0 on pci1 em0: Using MSIX interrupts with 3 vectors em0: Ethernet address: 00:25:90:82:21:5a em0: netmap queues/slots: TX 1/1024, RX 1/1024 pcib2: irq 54 at device 10.0 on pci0 pci2: on pcib2 em1: port 0xc800-0xc81f mem 0xfdee0000-0xfdefffff,0xfdedc000-0xfdedffff irq 47 at device 0.0 on pci2 em1: Using MSIX interrupts with 3 vectors em1: Ethernet address: 00:25:90:82:21:5b em1: netmap queues/slots: TX 1/1024, RX 1/1024 ahci0: port 0xa000-0xa007,0x9000-0x9003,0x8000-0x8007,0x7000-0x7003,0x6000-0x600f mem 0xfdcffc00-0xfdcfffff irq 22 at device 17.0 on pci0 ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported ahci0: quirks=0x22000 ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ohci0: mem 0xfdcfd000-0xfdcfdfff irq 16 at device 18.0 on pci0 usbus0 on ohci0 usbus0: 12Mbps Full Speed USB v1.0 ohci1: mem 0xfdcfe000-0xfdcfefff irq 16 at device 18.1 on pci0 usbus1 on ohci1 usbus1: 12Mbps Full Speed USB v1.0 ehci0: mem 0xfdcff800-0xfdcff8ff irq 17 at device 18.2 on pci0 usbus2: EHCI version 1.0 usbus2 on ehci0 usbus2: 480Mbps High Speed USB v2.0 ohci2: mem 0xfdcf7000-0xfdcf7fff irq 18 at device 19.0 on pci0 usbus3 on ohci2 usbus3: 12Mbps Full Speed USB v1.0 ohci3: mem 0xfdcfc000-0xfdcfcfff irq 18 at device 19.1 on pci0 usbus4 on ohci3 usbus4: 12Mbps Full Speed USB v1.0 ehci1: mem 0xfdcff400-0xfdcff4ff irq 19 at device 19.2 on pci0 usbus5: EHCI version 1.0 usbus5 on ehci1 usbus5: 480Mbps High Speed USB v2.0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0 ata0: at channel 0 on atapci0 ata1: at channel 1 on atapci0 isab0: at device 20.3 on pci0 isa0: on isab0 pcib3: at device 20.4 on pci0 pci3: on pcib3 sym0: <895> port 0xe000-0xe0ff mem 0xfebeec00-0xfebeecff,0xfebef000-0xfebeffff irq 23 at device 1.0 on pci3 sym0: Symbios NVRAM, ID 7, Fast-40, LVD, parity checking sym0: open drain IRQ line driver, using on-chip SRAM sym0: using LOAD/STORE-based firmware. sym1: <875> port 0xd000-0xd0ff mem 0xfebcec00-0xfebcecff,0xfebcf000-0xfebcffff irq 21 at device 3.0 on pci3 sym1: Symbios NVRAM, ID 7, Fast-20, SE, parity checking sym1: open drain IRQ line driver, using on-chip SRAM sym1: using LOAD/STORE-based firmware. vgapci0: mem 0xfc000000-0xfcffffff,0xfdffc000-0xfdffffff,0xfe000000-0xfe7fffff irq 20 at device 4.0 on pci3 vgapci0: Boot video device ohci4: mem 0xfdcf6000-0xfdcf6fff irq 18 at device 20.5 on pci0 usbus6 on ohci4 usbus6: 12Mbps Full Speed USB v1.0 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc87ff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] ppc0: cannot reserve I/O port range hwpstate0: on cpu0 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec ugen0.1: at usbus0 ugen2.1: at usbus2 ugen5.1: at usbus5 ugen6.1: at usbus6 ugen1.1: at usbus1 ugen3.1: at usbus3 ugen4.1: at usbus4 uhub0: on usbus0 uhub2: on usbus6 uhub1: on usbus4 uhub4: on usbus1 uhub5: on usbus3 uhub3: on usbus5 uhub6: on usbus2 uhub2: 2 ports with 2 removable, self powered uhub0: 3 ports with 3 removable, self powered uhub1: 3 ports with 3 removable, self powered uhub4: 3 ports with 3 removable, self powered uhub5: 3 ports with 3 removable, self powered uhub3: 6 ports with 6 removable, self powered uhub6: 6 ports with 6 removable, self powered (noperiph:sym0:0:-1:ffffffff): SCSI BUS reset delivered. (noperiph:sym1:0:-1:ffffffff): SCSI BUS reset delivered. ugen0.2: at usbus0 ukbd0 on uhub0 ukbd0: on usbus0 kbd2 at ukbd0 random: unblocking device. ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA8-ACS SATA 3.x device ada0: Serial Number Z2T3BD3AS ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 2861588MB (5860533168 512 byte sectors) ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ACS-2 ATA SATA 3.x device ada1: Serial Number WD-WMC1T1962399 ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 2861588MB (5860533168 512 byte sectors) ada1: quirks=0x1<4K> Trying to mount root from zfs:zroot/ROOT/default []... Root mount waiting for: GMIRROR Root mount waiting for: GMIRROR Root mount waiting for: GMIRROR Root mount waiting for: GMIRROR GEOM_MIRROR: Force device swap start due to timeout. GEOM_MIRROR: Device mirror/swap launched (2/3). GEOM_ELI: Device mirror/swap.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: software em0: link state changed to UP ums0 on uhub0 ums0: on usbus0 ums0: 5 buttons and [XYZ] coordinates ID=0 [dan@tape01:~] $
Filesystems
The filesystems:
[dan@tape01:~] $ zfs list NAME USED AVAIL REFER MOUNTPOINT zroot 1.42G 2.63T 88K /zroot zroot/ROOT 1.41G 2.63T 88K none zroot/ROOT/default 1.41G 2.63T 1.41G / zroot/tmp 192K 2.63T 192K /tmp zroot/usr 472K 2.63T 88K /usr zroot/usr/home 208K 2.63T 208K /usr/home zroot/usr/ports 88K 2.63T 88K /usr/ports zroot/usr/src 88K 2.63T 88K /usr/src zroot/var 996K 2.63T 88K /var zroot/var/audit 88K 2.63T 88K /var/audit zroot/var/crash 88K 2.63T 88K /var/crash zroot/var/log 504K 2.63T 504K /var/log zroot/var/mail 112K 2.63T 112K /var/mail zroot/var/tmp 116K 2.63T 116K /var/tmp [dan@tape01:~] $
dmesg
And dmesg:
[dan@tape01:~] $ cat /var/run/dmesg.boot Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.2-RELEASE-p4 #0: Thu Sep 27 08:16:24 UTC 2018 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) VT(vga): resolution 640x480 CPU: AMD Opteron(tm) Processor 6128 (2000.04-MHz K8-class CPU) Origin="AuthenticAMD" Id=0x100f91 Family=0x10 Model=0x9 Stepping=1 Features=0x178bfbffFeatures2=0x802009 AMD Features=0xee500800 AMD Features2=0x837ff SVM: NP,NRIP,NAsids=64 TSC: P-state invariant real memory = 34359738368 (32768 MB) avail memory = 33311207424 (31768 MB) Event timer "LAPIC" quality 100 ACPI APIC Table: <083112 APIC1535> FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 8 core(s) Firmware Warning (ACPI): 32/64X length mismatch in FADT/Gpe0Block: 64/32 (20171214/tbfadt-748) ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-55 on motherboard SMP: AP CPU #1 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #3 Launched! Timecounter "TSC" frequency 2000040859 Hz quality 800 random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff80ff4580, 0) error 19 nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: irq 53 at device 9.0 on pci0 pci1: on pcib1 em0: port 0xb800-0xb81f mem 0xfdde0000-0xfddfffff,0xfdddc000-0xfdddffff irq 48 at device 0.0 on pci1 em0: Using MSIX interrupts with 3 vectors em0: Ethernet address: 00:25:90:82:21:5a em0: netmap queues/slots: TX 1/1024, RX 1/1024 pcib2: irq 54 at device 10.0 on pci0 pci2: on pcib2 em1: port 0xc800-0xc81f mem 0xfdee0000-0xfdefffff,0xfdedc000-0xfdedffff irq 47 at device 0.0 on pci2 em1: Using MSIX interrupts with 3 vectors em1: Ethernet address: 00:25:90:82:21:5b em1: netmap queues/slots: TX 1/1024, RX 1/1024 ahci0: port 0xa000-0xa007,0x9000-0x9003,0x8000-0x8007,0x7000-0x7003,0x6000-0x600f mem 0xfdcffc00-0xfdcfffff irq 22 at device 17.0 on pci0 ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported ahci0: quirks=0x22000 ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ohci0: mem 0xfdcfd000-0xfdcfdfff irq 16 at device 18.0 on pci0 usbus0 on ohci0 usbus0: 12Mbps Full Speed USB v1.0 ohci1: mem 0xfdcfe000-0xfdcfefff irq 16 at device 18.1 on pci0 usbus1 on ohci1 usbus1: 12Mbps Full Speed USB v1.0 ehci0: mem 0xfdcff800-0xfdcff8ff irq 17 at device 18.2 on pci0 usbus2: EHCI version 1.0 usbus2 on ehci0 usbus2: 480Mbps High Speed USB v2.0 ohci2: mem 0xfdcf7000-0xfdcf7fff irq 18 at device 19.0 on pci0 usbus3 on ohci2 usbus3: 12Mbps Full Speed USB v1.0 ohci3: mem 0xfdcfc000-0xfdcfcfff irq 18 at device 19.1 on pci0 usbus4 on ohci3 usbus4: 12Mbps Full Speed USB v1.0 ehci1: mem 0xfdcff400-0xfdcff4ff irq 19 at device 19.2 on pci0 usbus5: EHCI version 1.0 usbus5 on ehci1 usbus5: 480Mbps High Speed USB v2.0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0 ata0: at channel 0 on atapci0 ata1: at channel 1 on atapci0 isab0: at device 20.3 on pci0 isa0: on isab0 pcib3: at device 20.4 on pci0 pci3: on pcib3 sym0: <895> port 0xe000-0xe0ff mem 0xfebeec00-0xfebeecff,0xfebef000-0xfebeffff irq 23 at device 1.0 on pci3 sym0: Symbios NVRAM, ID 7, Fast-40, LVD, parity checking sym0: open drain IRQ line driver, using on-chip SRAM sym0: using LOAD/STORE-based firmware. sym1: <875> port 0xd000-0xd0ff mem 0xfebcec00-0xfebcecff,0xfebcf000-0xfebcffff irq 21 at device 3.0 on pci3 sym1: Symbios NVRAM, ID 7, Fast-20, SE, parity checking sym1: open drain IRQ line driver, using on-chip SRAM sym1: using LOAD/STORE-based firmware. vgapci0: mem 0xfc000000-0xfcffffff,0xfdffc000-0xfdffffff,0xfe000000-0xfe7fffff irq 20 at device 4.0 on pci3 vgapci0: Boot video device ohci4: mem 0xfdcf6000-0xfdcf6fff irq 18 at device 20.5 on pci0 usbus6 on ohci4 usbus6: 12Mbps Full Speed USB v1.0 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc87ff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] ppc0: cannot reserve I/O port range hwpstate0: on cpu0 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec ugen0.1: at usbus0 ugen2.1: at usbus2 ugen5.1: at usbus5 ugen6.1: at usbus6 ugen1.1: at usbus1 ugen3.1: at usbus3 ugen4.1: at usbus4 uhub0: on usbus0 uhub2: on usbus6 uhub1: on usbus4 uhub4: on usbus1 uhub5: on usbus3 uhub3: on usbus5 uhub6: on usbus2 uhub2: 2 ports with 2 removable, self powered uhub0: 3 ports with 3 removable, self powered uhub1: 3 ports with 3 removable, self powered uhub4: 3 ports with 3 removable, self powered uhub5: 3 ports with 3 removable, self powered uhub3: 6 ports with 6 removable, self powered uhub6: 6 ports with 6 removable, self powered (noperiph:sym0:0:-1:ffffffff): SCSI BUS reset delivered. (noperiph:sym1:0:-1:ffffffff): SCSI BUS reset delivered. ugen0.2: at usbus0 ukbd0 on uhub0 ukbd0: on usbus0 kbd2 at ukbd0 random: unblocking device. ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA8-ACS SATA 3.x device ada0: Serial Number Z2T3BD3AS ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 2861588MB (5860533168 512 byte sectors) ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ACS-2 ATA SATA 3.x device ada1: Serial Number WD-WMC1T1962399 ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 2861588MB (5860533168 512 byte sectors) ada1: quirks=0x1<4K> Trying to mount root from zfs:zroot/ROOT/default []... Root mount waiting for: GMIRROR Root mount waiting for: GMIRROR Root mount waiting for: GMIRROR Root mount waiting for: GMIRROR GEOM_MIRROR: Force device swap start due to timeout. GEOM_MIRROR: Device mirror/swap launched (2/3). GEOM_ELI: Device mirror/swap.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: software em0: link state changed to UP ums0 on uhub0 ums0: on usbus0 ums0: 5 buttons and [XYZ] coordinates ID=0 [dan@tape01:~] $