For future reference, this is the knew server … oh wait, I think it’s this server which is mounted in the 4U chassis mentioned in this post. It runs a few jails, including Bacula regression testing services.
This recent post outlines the modifications so it boots off a mirror of SSDs.
File systems
NAME USED AVAIL REFER MOUNTPOINT system 30.8T 36.0T 320K none system/backups-by-snapshot 9.37G 36.0T 384K /usr/home/ansel/snapshots system/backups-by-snapshot/mailjail 9.37G 36.0T 9.37G /usr/home/ansel/snapshots/mailjail system/backups-by-snapshot/mounted 329K 36.0T 329K /usr/home/ansel/snapshots/mounted system/backups-by-snapshot/testing 329K 36.0T 329K /usr/home/ansel/snapshots/testing system/bootenv 329K 36.0T 329K none system/data 30.2T 36.0T 329K none system/data/bacula 1.30M 36.0T 219K /usr/jails/bacula-sd-01/usr/local/bacula system/data/bacula-volumes 28.1T 36.0T 219K none system/data/bacula-volumes/DailyBackups 214G 36.0T 168G /usr/jails/bacula-sd-01/usr/local/bacula/volumes/DailyBackups system/data/bacula-volumes/DiffFile 344G 36.0T 344G /usr/jails/bacula-sd-01/usr/local/bacula/volumes/DiffFile system/data/bacula-volumes/FullAutoNoNextPool 681G 36.0T 681G /usr/jails/bacula-sd-01/usr/local/bacula/volumes/FullAutoNoNextPool system/data/bacula-volumes/FullFile 25.5T 36.0T 24.9T /usr/jails/bacula-sd-01/usr/local/bacula/volumes/FullFile system/data/bacula-volumes/IncrFile 1.09T 36.0T 813G /usr/jails/bacula-sd-01/usr/local/bacula/volumes/IncrFile system/data/bacula-volumes/IncrFileNoNextPool 193G 36.0T 193G /usr/jails/bacula-sd-01/usr/local/bacula/volumes/IncrFileNoNextPool system/data/bacula-volumes/MonthlyBackups 66.7G 36.0T 66.7G /usr/jails/bacula-sd-01/usr/local/bacula/volumes/MonthlyBackups system/data/bacula-volumes/TwoHourlyBackups 20.7G 36.0T 13.9G /usr/jails/bacula-sd-01/usr/local/bacula/volumes/TwoHourlyBackups system/data/bacula-volumes/WeeklyBackups 45.8G 36.0T 45.8G /usr/jails/bacula-sd-01/usr/local/bacula/volumes/WeeklyBackups system/data/bacula/spooling 201K 36.0T 201K /usr/jails/bacula-sd-01/usr/local/bacula/spooling system/data/bacula/working 914K 36.0T 283K /usr/jails/bacula-sd-01/usr/local/bacula/working system/data/time_capsule 2.06T 36.0T 201K /data/time_capsule system/data/time_capsule/dvl-air01 739G 30.0G 570G /data/time_capsule/dvl-air01 system/data/time_capsule/dvl-dent 424G 75.7G 408G /data/time_capsule/dvl-dent system/data/time_capsule/dvl-dent-sparse 361G 153G 167G /data/time_capsule/dvl-dent-sparse system/data/time_capsule/dvl-pro02 590G 26.6G 573G /data/time_capsule/dvl-pro02 system/root 612K 36.0T 612K none system/rootfs 15.6G 36.0T 15.6G none system/tank_data 4.39G 36.0T 4.39G none system/tank_data/data 402K 36.0T 201K none system/tank_data/data/bacula-volumes 201K 36.0T 201K none system/tmp 2.95M 36.0T 2.95M none system/usr 592G 36.0T 329K none system/usr/home 2.15G 36.0T 329K /usr/home system/usr/home/dan 2.15G 36.0T 2.15G /usr/home/dan system/usr/jails 584G 36.0T 35.3M /usr/jails system/usr/jails/ansible 3.22G 36.0T 2.78G /usr/jails/ansible system/usr/jails/bacula-sd-01 3.06G 36.0T 2.26G /usr/jails/bacula-sd-01 system/usr/jails/basejail 2.60G 36.0T 2.25G /usr/jails/basejail system/usr/jails/cliff 2.38G 36.0T 1.99G /usr/jails/cliff system/usr/jails/crey 1.70G 36.0T 1.70G /usr/jails/crey system/usr/jails/dbclone 144G 36.0T 132G /usr/jails/dbclone system/usr/jails/dbclone.backups.rsyncer 213G 36.0T 107G /usr/jails/dbclone/usr/home/rsyncer/backups system/usr/jails/empty 6.25G 36.0T 5.81G /usr/jails/empty system/usr/jails/ezjail_archives 256K 36.0T 256K /usr/jails/ezjail_archives system/usr/jails/fruity-ext 1.71G 36.0T 1.22G /usr/jails/fruity-ext system/usr/jails/fruity-int 1.80G 36.0T 1.31G /usr/jails/fruity-int system/usr/jails/metrics2 177G 36.0T 177G /usr/jails/metrics2 system/usr/jails/mysql51 7.12M 36.0T 7.12M /usr/jails/mysql51 system/usr/jails/mysql55 3.86G 36.0T 3.51G /usr/jails/mysql55 system/usr/jails/mysql56 3.27G 36.0T 2.93G /usr/jails/mysql56 system/usr/jails/newjail 6.34M 36.0T 6.34M /usr/jails/newjail system/usr/jails/pg10 3.41G 36.0T 3.05G /usr/jails/pg10 system/usr/jails/pg93 3.45G 36.0T 3.11G /usr/jails/pg93 system/usr/jails/pg94 2.88G 36.0T 2.53G /usr/jails/pg94 system/usr/jails/pg95 2.25G 36.0T 1.92G /usr/jails/pg95 system/usr/jails/pg96 2.00G 36.0T 1.64G /usr/jails/pg96 system/usr/jails/snapshots 3.33G 36.0T 2.06G /usr/jails/snapshots system/usr/jails/toiler 2.61G 36.0T 2.20G /usr/jails/toiler system/usr/local 883M 36.0T 883M none system/usr/obj 1.74G 36.0T 1.74G none system/usr/ports 1.80G 36.0T 1.80G none system/usr/ports/distfiles 256K 36.0T 256K none system/usr/src 1.82G 36.0T 1.82G none system/var 717M 36.0T 329K none system/var/audit 366K 36.0T 366K none system/var/empty 329K 36.0T 329K none system/var/log 716M 36.0T 716M none system/var/tmp 457K 36.0T 457K none zroot 14.8G 4.50G 23K /zroot zroot/ROOT 9.61G 4.50G 23K none zroot/ROOT/10.3-RELEASE 1K 4.50G 6.97G / zroot/ROOT/11.1-RELEASE 1K 4.50G 8.05G / zroot/ROOT/default 9.61G 4.50G 8.22G / zroot/tmp 46K 2.00G 28K /tmp zroot/usr 652M 4.50G 23K /usr zroot/usr/local 652M 4.50G 472M /usr/local zroot/var 4.50G 4.50G 25K /var zroot/var/audit 23K 4.50G 23K /var/audit zroot/var/crash 1.50G 4.50G 1.50G /var/crash zroot/var/empty 23K 4.50G 23K /var/empty zroot/var/log 3G 0 3.00G /var/log zroot/var/mail 41K 459K 27K /var/mail zroot/var/tmp 163K 2.00G 142K /var/tmp [dan@knew:~] $
Paritions
[dan@knew:~] $ gpart show
=> 40 468862048 ada0 GPT (224G)
40 2008 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 41943040 3 freebsd-zfs (20G)
50335744 418526344 - free - (200G)
=> 34 937703021 ada1 GPT (447G)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 41943040 3 freebsd-zfs (20G)
50335744 887367311 - free - (423G)
=> 34 937703021 ada2 GPT (447G)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 41943040 3 freebsd-zfs (20G)
50335744 887367311 - free - (423G)
=> 40 468862048 ada3 GPT (224G)
40 2008 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 41943040 3 freebsd-zfs (20G)
50335744 418526344 - free - (200G)
=> 34 9767541101 da0 GPT (4.5T)
34 6 - free - (3.0K)
40 9766000000 1 freebsd-zfs (4.5T)
9766000040 1541095 - free - (752M)
=> 34 9767541101 da1 GPT (4.5T)
34 6 - free - (3.0K)
40 9766000000 1 freebsd-zfs (4.5T)
9766000040 1541095 - free - (752M)
=> 34 9767541101 da2 GPT (4.5T)
34 6 - free - (3.0K)
40 9766000000 1 freebsd-zfs (4.5T)
9766000040 1541095 - free - (752M)
=> 34 9767541101 da3 GPT (4.5T)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 9759129600 3 freebsd-zfs (4.5T)
9767522304 18831 - free - (9.2M)
=> 34 9767541101 da4 GPT (4.5T)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 9759129600 3 freebsd-zfs (4.5T)
9767522304 18831 - free - (9.2M)
=> 34 9767541101 da5 GPT (4.5T)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 9759129600 3 freebsd-zfs (4.5T)
9767522304 18831 - free - (9.2M)
=> 34 9767541101 da6 GPT (4.5T)
34 6 - free - (3.0K)
40 9766000000 1 freebsd-zfs (4.5T)
9766000040 1541095 - free - (752M)
=> 34 9767541101 da7 GPT (4.5T)
34 6 - free - (3.0K)
40 9766000000 1 freebsd-zfs (4.5T)
9766000040 1541095 - free - (752M)
=> 34 9767541101 da8 GPT (4.5T)
34 6 - free - (3.0K)
40 9766000000 1 freebsd-zfs (4.5T)
9766000040 1541095 - free - (752M)
=> 34 9767541101 da9 GPT (4.5T)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 9759129600 3 freebsd-zfs (4.5T)
9767522304 18831 - free - (9.2M)
=> 34 9767541101 da10 GPT (4.5T)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 9759129600 3 freebsd-zfs (4.5T)
9767522304 18831 - free - (9.2M)
=> 34 9767541101 da11 GPT (4.5T)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 9759129600 3 freebsd-zfs (4.5T)
9767522304 18831 - free - (9.2M)
=> 34 9767541101 da12 GPT (4.5T)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 9759129600 3 freebsd-zfs (4.5T)
9767522304 18831 - free - (9.2M)
=> 34 9767541101 da13 GPT (4.5T)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 9759129600 3 freebsd-zfs (4.5T)
9767522304 18831 - free - (9.2M)
=> 34 9767541101 da14 GPT (4.5T)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 9759129600 3 freebsd-zfs (4.5T)
9767522304 18831 - free - (9.2M)
=> 34 9767541101 da15 GPT (4.5T)
34 2014 - free - (1.0M)
2048 1024 1 freebsd-boot (512K)
3072 1024 - free - (512K)
4096 8388608 2 freebsd-swap (4.0G)
8392704 9759129600 3 freebsd-zfs (4.5T)
9767522304 18831 - free - (9.2M)
=> 34 9767541101 da16 GPT (4.5T)
34 6 - free - (3.0K)
40 9766000000 1 freebsd-zfs (4.5T)
9766000040 1541095 - free - (752M)
=> 34 9767541101 da17 GPT (4.5T)
34 6 - free - (3.0K)
40 9766000000 1 freebsd-zfs (4.5T)
9766000040 1541095 - free - (752M)
=> 34 9767541101 da18 GPT (4.5T)
34 6 - free - (3.0K)
40 9766000000 1 freebsd-zfs (4.5T)
9766000040 1541095 - free - (752M)
=> 34 9767541101 da19 GPT (4.5T)
34 6 - free - (3.0K)
40 9766000000 1 freebsd-zfs (4.5T)
9766000040 1541095 - free - (752M)
[dan@knew:~] $
zpools
[dan@knew:~] $ zpool status pool: system state: ONLINE scan: scrub repaired 0 in 14h35m with 0 errors on Thu Aug 2 18:16:27 2018 config: NAME STATE READ WRITE CKSUM system ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 da3p3 ONLINE 0 0 0 da10p3 ONLINE 0 0 0 da15p3 ONLINE 0 0 0 da4p3 ONLINE 0 0 0 da13p3 ONLINE 0 0 0 da12p3 ONLINE 0 0 0 da9p3 ONLINE 0 0 0 da14p3 ONLINE 0 0 0 da11p3 ONLINE 0 0 0 da5p3 ONLINE 0 0 0 raidz2-1 ONLINE 0 0 0 da6p1 ONLINE 0 0 0 da7p1 ONLINE 0 0 0 da16p1 ONLINE 0 0 0 da8p1 ONLINE 0 0 0 da0p1 ONLINE 0 0 0 da1p1 ONLINE 0 0 0 da17p1 ONLINE 0 0 0 da18p1 ONLINE 0 0 0 da2p1 ONLINE 0 0 0 da19p1 ONLINE 0 0 0 errors: No known data errors pool: zroot state: ONLINE scan: scrub repaired 0 in 0h0m with 0 errors on Thu Aug 2 03:41:21 2018 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada3p3 ONLINE 0 0 0 ada0p3 ONLINE 0 0 0 errors: No known data errors [dan@knew:~] $
/var/run/dmesg.boot
[dan@knew:~] $ cat /var/run/dmesg.boot
Copyright (c) 1992-2018 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.2-RELEASE-p1 #0: Sun Aug 5 12:04:13 UTC 2018
root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0)
VT(vga): resolution 640x480
CPU: Intel(R) Xeon(R) CPU E5-1630 v3 @ 3.70GHz (3691.54-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x7ffefbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
AMD Features2=0x21<LAHF,ABM>
Structured Extended Features=0x37ab<FSGSBASE,TSCADJ,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,NFPUSG>
XSAVE Features=0x1<XSAVEOPT>
VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
TSC: P-state invariant, performance statistics
real memory = 68719476736 (65536 MB)
avail memory = 66537951232 (63455 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <SUPERM SMCI--MB>
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 hardware threads
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
SMP: AP CPU #1 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #5 Launched!
Timecounter "TSC-low" frequency 1845768690 Hz quality 1000
random: entropy device external interface
kbd1 at kbdmux0
netmap: loaded module
module_register_init: MOD_LOAD (vesa, 0xffffffff80ff4550, 0) error 19
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
nexus0
vtvga0: <VT VGA driver> on motherboard
cryptosoft0: <software crypto> on motherboard
acpi0: <SUPERM SMCI--MB> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x71,0x74-0x77 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pcib0: _OSC returned error 0x10
pci0: <ACPI PCI bus> on pcib0
pci0: <dasp, performance counters> at device 11.1 (no driver attached)
pci0: <dasp, performance counters> at device 11.2 (no driver attached)
pci0: <dasp, performance counters> at device 16.1 (no driver attached)
pci0: <dasp, performance counters> at device 16.6 (no driver attached)
pci0: <dasp, performance counters> at device 18.1 (no driver attached)
acpi_syscontainer0: <System Container> on acpi0
acpi_syscontainer1: <System Container> on acpi0
acpi_syscontainer2: <System Container> on acpi0
acpi_syscontainer3: <System Container> on acpi0
pcib1: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0
pcib1: _OSC returned error 0x10
pci1: <ACPI PCI bus> numa-domain 0 on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 26 at device 1.0 numa-domain 0 on pci1
pci2: <ACPI PCI bus> numa-domain 0 on pcib2
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xe000-0xe01f mem 0xfb840000-0xfb85ffff,0xfb800000-0xfb83ffff,0xfb860000-0xfb863fff irq 26 at device 0.0 numa-domain 0 on pci2
ix0: Using MSI-X interrupts with 9 vectors
ix0: Ethernet address: 00:1b:21:39:a9:a1
ix0: PCI Express Bus: Speed 2.5GT/s Width x8
ix0: netmap queues/slots: TX 8/2048, RX 8/2048
pcib3: <ACPI PCI-PCI bridge> irq 32 at device 2.0 numa-domain 0 on pci1
pci3: <ACPI PCI bus> numa-domain 0 on pcib3
mps0: <Avago Technologies (LSI) SAS2008> port 0xd000-0xd0ff mem 0xfb7c0000-0xfb7c3fff,0xfb780000-0xfb7bffff irq 32 at device 0.0 numa-domain 0 on pci3
mps0: Firmware: 20.00.04.00, Driver: 21.02.00.00-fbsd
mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
pcib4: <ACPI PCI-PCI bridge> irq 32 at device 2.2 numa-domain 0 on pci1
pci4: <ACPI PCI bus> numa-domain 0 on pcib4
mps1: <Avago Technologies (LSI) SAS2008> port 0xc000-0xc0ff mem 0xfb6c0000-0xfb6c3fff,0xfb680000-0xfb6bffff irq 34 at device 0.0 numa-domain 0 on pci4
mps1: Firmware: 20.00.04.00, Driver: 21.02.00.00-fbsd
mps1: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
pcib5: <ACPI PCI-PCI bridge> irq 40 at device 3.0 numa-domain 0 on pci1
pci5: <ACPI PCI bus> numa-domain 0 on pcib5
mps2: <Avago Technologies (LSI) SAS2008> port 0xb000-0xb0ff mem 0xfb5c0000-0xfb5c3fff,0xfb580000-0xfb5bffff irq 40 at device 0.0 numa-domain 0 on pci5
mps2: Firmware: 20.00.04.00, Driver: 21.02.00.00-fbsd
mps2: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
pci1: <unknown> at device 17.0 (no driver attached)
ahci0: <Intel Wellsburg AHCI SATA controller> port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb91c000-0xfb91c7ff irq 16 at device 17.4 numa-domain 0 on pci1
ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
xhci0: <Intel Wellsburg USB 3.0 controller> mem 0xfb900000-0xfb90ffff irq 19 at device 20.0 numa-domain 0 on pci1
xhci0: 32 bytes context size, 64-bit DMA
usbus0 numa-domain 0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
ehci0: <Intel Wellsburg USB 2.0 controller> mem 0xfb918000-0xfb9183ff irq 18 at device 26.0 numa-domain 0 on pci1
usbus1: EHCI version 1.0
usbus1 numa-domain 0 on ehci0
usbus1: 480Mbps High Speed USB v2.0
hdac0: <Intel Wellsburg HDA Controller> mem 0xfb910000-0xfb913fff irq 22 at device 27.0 numa-domain 0 on pci1
pcib6: <ACPI PCI-PCI bridge> irq 16 at device 28.0 numa-domain 0 on pci1
pci6: <ACPI PCI bus> numa-domain 0 on pcib6
xhci1: <ASMedia ASM1042A USB 3.0 controller> mem 0xfb400000-0xfb407fff irq 16 at device 0.0 numa-domain 0 on pci6
xhci1: 32 bytes context size, 64-bit DMA
xhci1: Unable to map MSI-X table
usbus2 numa-domain 0 on xhci1
usbus2: 5.0Gbps Super Speed USB v3.0
pcib7: <ACPI PCI-PCI bridge> irq 18 at device 28.2 numa-domain 0 on pci1
pci7: <ACPI PCI bus> numa-domain 0 on pcib7
igb0: <Intel(R) PRO/1000 Network Connection, Version - 2.5.3-k> port 0xa000-0xa01f mem 0xfb300000-0xfb37ffff,0xfb380000-0xfb383fff irq 18 at device 0.0 numa-domain 0 on pci7
igb0: Using MSIX interrupts with 5 vectors
igb0: Ethernet address: 0c:c4:7a:4c:b1:40
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 to cpu 3
igb0: netmap queues/slots: TX 4/1024, RX 4/1024
pcib8: <ACPI PCI-PCI bridge> irq 19 at device 28.3 numa-domain 0 on pci1
pci8: <ACPI PCI bus> numa-domain 0 on pcib8
igb1: <Intel(R) PRO/1000 Network Connection, Version - 2.5.3-k> port 0x9000-0x901f mem 0xfb200000-0xfb27ffff,0xfb280000-0xfb283fff irq 19 at device 0.0 numa-domain 0 on pci8
igb1: Using MSIX interrupts with 5 vectors
igb1: Ethernet address: 0c:c4:7a:4c:b1:41
igb1: Bound queue 0 to cpu 4
igb1: Bound queue 1 to cpu 5
igb1: Bound queue 2 to cpu 6
igb1: Bound queue 3 to cpu 7
igb1: netmap queues/slots: TX 4/1024, RX 4/1024
pcib9: <ACPI PCI-PCI bridge> irq 16 at device 28.4 numa-domain 0 on pci1
pci9: <ACPI PCI bus> numa-domain 0 on pcib9
xhci2: <ASMedia ASM1042A USB 3.0 controller> mem 0xfb100000-0xfb107fff irq 16 at device 0.0 numa-domain 0 on pci9
xhci2: 32 bytes context size, 64-bit DMA
xhci2: Unable to map MSI-X table
usbus3 numa-domain 0 on xhci2
usbus3: 5.0Gbps Super Speed USB v3.0
pcib10: <ACPI PCI-PCI bridge> irq 18 at device 28.6 numa-domain 0 on pci1
pci10: <ACPI PCI bus> numa-domain 0 on pcib10
pcib11: <ACPI PCI-PCI bridge> at device 0.0 numa-domain 0 on pci10
pci11: <ACPI PCI bus> numa-domain 0 on pcib11
vgapci0: <VGA-compatible display> port 0x8000-0x807f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 numa-domain 0 on pci11
vgapci0: Boot video device
pcib12: <ACPI PCI-PCI bridge> irq 19 at device 28.7 numa-domain 0 on pci1
pci12: <ACPI PCI bus> numa-domain 0 on pcib12
pcib13: <PCI-PCI bridge> irq 16 at device 0.0 numa-domain 0 on pci12
pci13: <PCI bus> numa-domain 0 on pcib13
pcib14: <PCI-PCI bridge> irq 19 at device 3.0 numa-domain 0 on pci13
pci14: <PCI bus> numa-domain 0 on pcib14
pcib15: <PCI-PCI bridge> irq 19 at device 7.0 numa-domain 0 on pci13
pci15: <PCI bus> numa-domain 0 on pcib15
ehci1: <Intel Wellsburg USB 2.0 controller> mem 0xfb917000-0xfb9173ff irq 18 at device 29.0 numa-domain 0 on pci1
usbus4: EHCI version 1.0
usbus4 numa-domain 0 on ehci1
usbus4: 480Mbps High Speed USB v2.0
isab0: <PCI-ISA bridge> at device 31.0 numa-domain 0 on pci1
isa0: <ISA bus> numa-domain 0 on isab0
ahci1: <Intel Wellsburg AHCI SATA controller> port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb916000-0xfb9167ff irq 16 at device 31.2 numa-domain 0 on pci1
ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich4: <AHCI channel> at channel 0 on ahci1
ahcich5: <AHCI channel> at channel 1 on ahci1
ahcich6: <AHCI channel> at channel 2 on ahci1
ahcich7: <AHCI channel> at channel 3 on ahci1
ahcich8: <AHCI channel> at channel 4 on ahci1
ahcich9: <AHCI channel> at channel 5 on ahci1
ahciem1: <AHCI enclosure management bridge> on ahci1
acpi_button0: <Power Button> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc87ff on isa0
ppc0: cannot reserve I/O port range
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 221700002500
device_attach: est0 attach returned 6
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 21ef00002500
device_attach: est1 attach returned 6
coretemp2: <CPU On-Die Thermal Sensors> on cpu2
est2: <Enhanced SpeedStep Frequency Control> on cpu2
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 221700002500
device_attach: est2 attach returned 6
coretemp3: <CPU On-Die Thermal Sensors> on cpu3
est3: <Enhanced SpeedStep Frequency Control> on cpu3
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 221700002500
device_attach: est3 attach returned 6
coretemp4: <CPU On-Die Thermal Sensors> on cpu4
est4: <Enhanced SpeedStep Frequency Control> on cpu4
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 221700002500
device_attach: est4 attach returned 6
coretemp5: <CPU On-Die Thermal Sensors> on cpu5
est5: <Enhanced SpeedStep Frequency Control> on cpu5
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 221700002500
device_attach: est5 attach returned 6
coretemp6: <CPU On-Die Thermal Sensors> on cpu6
est6: <Enhanced SpeedStep Frequency Control> on cpu6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 221700002500
device_attach: est6 attach returned 6
coretemp7: <CPU On-Die Thermal Sensors> on cpu7
est7: <Enhanced SpeedStep Frequency Control> on cpu7
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 221700002500
device_attach: est7 attach returned 6
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
ugen1.1: <Intel EHCI root HUB> at usbus1
ugen0.1: <0x8086 XHCI root HUB> at usbus0
ugen3.1: <0x1b21 XHCI root HUB> at usbus3
ugen4.1: <Intel EHCI root HUB> at usbus4
ugen2.1: <0x1b21 XHCI root HUB> at usbus2
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
uhub2: <0x1b21 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus2
uhub3: <0x1b21 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus3
uhub4: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus4
hdacc0: <Realtek ALC1150 HDA CODEC> at cad 0 on hdac0
hdaa0: <Realtek ALC1150 Audio Function Group> at nid 1 on hdacc0
pcm0: <Realtek ALC1150 (Rear Analog 5.1/2.0)> at nid 20,22,21 and 24,26 on hdaa0
pcm1: <Realtek ALC1150 (Front Analog)> at nid 27 and 25 on hdaa0
pcm2: <Realtek ALC1150 (Rear Digital)> at nid 30 on hdaa0
uhub2: 4 ports with 4 removable, self powered
uhub3: 4 ports with 4 removable, self powered
uhub4: 2 ports with 2 removable, self powered
uhub0: 2 ports with 2 removable, self powered
uhub1: 21 ports with 21 removable, self powered
mps0: SAS Address for SATA device = d53d5a19adac7082
mps0: SAS Address from SATA device = d53d5a19adac7082
mps1: SAS Address for SATA device = 4544280e97809a84
mps1: SAS Address from SATA device = 4544280e97809a84
mps2: SAS Address for SATA device = d5395220adac7077
mps2: SAS Address from SATA device = d5395220adac7077
mps2: SAS Address for SATA device = d537351cadac7080
mps2: SAS Address from SATA device = d537351cadac7080
mps0: SAS Address for SATA device = 453a3c119580a686
mps0: SAS Address from SATA device = 453a3c119580a686
mps0: SAS Address for SATA device = 45403407ba7f9685
mps0: SAS Address from SATA device = 45403407ba7f9685
mps0: SAS Address for SATA device = d5374c18adac7087
mps0: SAS Address from SATA device = d5374c18adac7087
mps0: SAS Address for SATA device = d53f3627adac7083
mps0: SAS Address from SATA device = d53f3627adac7083
mps0: SAS Address for SATA device = 453d3e0fba7fab97
mps0: SAS Address from SATA device = 453d3e0fba7fab97
mps0: SAS Address for SATA device = d53d5a17adac7082
mps0: SAS Address from SATA device = d53d5a17adac7082
ugen0.2: <vendor 0x0557 product 0x7000> at usbus0
mps0: SAS Address for SATA device = d5373520adac7080
uhub5mps1: SAS Address for SATA device = d538471dadac6f73
mps0: numa-domain 0 on uhub1
mps1: uhub5: SAS Address from SATA device = d5373520adac7080
SAS Address from SATA device = d538471dadac6f73
mps2: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 1> on usbus0
mps1: SAS Address for SATA device = 453c4c1997809b9a
SAS Address for SATA device = d538502eadac707f
mps1: SAS Address from SATA device = 453c4c1997809b9a
mps2: mps1: SAS Address from SATA device = d538502eadac707f
SAS Address for SATA device = 4544281797809a84
mps2: SAS Address for SATA device = d53f3626adac7083
ugen4.2: <vendor 0x8087 product 0x8002> at usbus4
mps1: mps2: SAS Address from SATA device = d53f3626adac7083
uhub6 numa-domain 0SAS Address from SATA device = 4544281797809a84
on uhub4
mps1: uhub6: SAS Address for SATA device = d53d5a26adac7082
<vendor 0x8087 product 0x8002, class 9/0, rev 2.00/0.05, addr 2> on usbus4
mps1: SAS Address from SATA device = d53d5a26adac7082
ugen1.2: <vendor 0x8087 product 0x800a> at usbus1
mps1: SAS Address for SATA device = 452a26149680948a
uhub7 numa-domain 0 on uhub0
mps1: uhub7: <vendor 0x8087 product 0x800a, class 9/0, rev 2.00/0.05, addr 2> on usbus1
SAS Address from SATA device = 452a26149680948a
mps1: SAS Address for SATA device = 453c4c1a97809b9a
mps1: SAS Address from SATA device = 453c4c1a97809b9a
mps1: SAS Address for SATA device = 45293c139580ada8
mps1: SAS Address from SATA device = 45293c139580ada8
uhub5: 4 ports with 3 removable, self powered
uhub6: 8 ports with 8 removable, self powered
uhub7: 6 ports with 6 removable, self powered
ugen0.3: <vendor 0x0557 product 0x2419> at usbus0
ukbd0 numa-domain 0 on uhub5
ukbd0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 2> on usbus0
kbd2 at ukbd0
ses0 at ahciem0 bus 0 scbus7 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
ses1 at ahciem1 bus 0 scbus14 target 0 lun 0
ses1: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses1: SEMB SES Device
ada0 at ahcich1 bus 0 scbus4 target 0 lun 0
ada0: <INTEL SSDSC2BP240G4 L2010420> ATA8-ACS SATA 3.x device
ada0: Serial Number BTJR5090037J240AGN
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada0: Command Queueing enabled
ada0: 228936MB (468862128 512 byte sectors)
ada1 at ahcich5 bus 0 scbus9 target 0 lun 0
ada1: <CT480BX200SSD1 MU01.4> ACS-2 ATA SATA 3.x device
ada1: Serial Number 1543F00F287F
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 1024bytes)
ada1: Command Queueing enabled
ada1: 457862MB (937703088 512 byte sectors)
ada2 at ahcich7 bus 0 scbus11 target 0 lun 0
ada2: <CT480BX200SSD1 MU01.4> ACS-2 ATA SATA 3.x device
ada2: Serial Number 1543F00F3587
ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 1024bytes)
ada2: Command Queueing enabled
ada2: 457862MB (937703088 512 byte sectors)
ada3 at ahcich9 bus 0 scbus13 target 0 lun 0
ada3: <INTEL SSDSC2BP240G4 L2010420> ATA8-ACS SATA 3.x device
ada3: Serial Number BTJR509003N7240AGN
ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada3: Command Queueing enabled
ada3: 228936MB (468862128 512 byte sectors)
random: unblocking device.
Trying to mount root from zfs:zroot/ROOT/default []...
da0 at mps0 bus 0 scbus0 target 8 lun 0
da0: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number 653DK7WCFS9A
da0: 600.000MB/s transfers
da0: Command Queueing enabled
da0: 4769307MB (9767541168 512 byte sectors)
da5 at mps0 bus 0 scbus0 target 31 lun 0
da5: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da5: Serial Number X6IEKELNF57D
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 4769307MB (9767541168 512 byte sectors)
da11 at mps1 bus 0 scbus1 target 24 lun 0
da11: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da11: Serial Number 5782KL6MF57D
da11: 600.000MB/s transfers
da11: Command Queueing enabled
da11: 4769307MB (9767541168 512 byte sectors)
da3 at mps0 bus 0 scbus0 target 24 lun 0
da3: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da3: Serial Number X643KHBFF57D
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 4769307MB (9767541168 512 byte sectors)
da7 at mps0 bus 0 scbus0 target 33 lun 0
da7: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da7: Serial Number 653DK7WAFS9A
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 4769307MB (9767541168 512 byte sectors)
da6 at mps0 bus 0 scbus0 target 32 lun 0
da6: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da6: Serial Number 653BK12JFS9A
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 4769307MB (9767541168 512 byte sectors)
da18 at mps2 bus 0 scbus2 target 10 lun 0
da18: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da18: Serial Number 6539K3OJFS9A
da18: 600.000MB/s transfers
da18: Command Queueing enabled
da18: 4769307MB (9767541168 512 byte sectors)
da14 at mps1 bus 0 scbus1 target 27 lun 0
da14: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da14: Serial Number 579HKDZXF57D
da14: 600.000MB/s transfers
da14: Command Queueing enabled
da14: 4769307MB (9767541168 512 byte sectors)
da12 at mps1 bus 0 scbus1 target 25 lun 0
da12: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da12: Serial Number 6525K2DGFS9A
da12: 600.000MB/s transfers
da12: Command Queueing enabled
da12: 4769307MB (9767541168 512 byte sectors)
da13 at mps1 bus 0 scbus1 target 26 lun 0
da13: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da13: Serial Number 5782KL6VF57D
da13: 600.000MB/s transfers
da13: Command Queueing enabled
da13: 4769307MB (9767541168 512 byte sectors)
da15 at mps1 bus 0 scbus1 target 28 lun 0
da15: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da15: Serial Number 37KVK1JRF57D
da15: 600.000MB/s transfers
da15: Command Queueing enabled
da15: 4769307MB (9767541168 512 byte sectors)
da1 at mps0 bus 0 scbus0 target 12 lun 0
da1: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da1: Serial Number 653EK93QFS9A
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 4769307MB (9767541168 512 byte sectors)
da4 at mps0 bus 0 scbus0 target 26 lun 0
da4: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da4: Serial Number 37D4KBJPF57D
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 4769307MB (9767541168 512 byte sectors)
da17 at mps2 bus 0 scbus2 target 2 lun 0
da17: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da17: Serial Number 653AK2MXFS9A
da17: 600.000MB/s transfers
da17: Command Queueing enabled
da17: 4769307MB (9767541168 512 byte sectors)
da9 at mps1 bus 0 scbus1 target 19 lun 0
da9: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da9: Serial Number 579HKDZYF57D
da9: 600.000MB/s transfers
da9: Command Queueing enabled
da9: 4769307MB (9767541168 512 byte sectors)
da2 at mps0 bus 0 scbus0 target 13 lun 0
da2: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da2: Serial Number 653IK1IBFS9A
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 4769307MB (9767541168 512 byte sectors)
da16 at mps2 bus 0 scbus2 target 0 lun 0
da16: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da16: Serial Number 653EK93PFS9A
da16: 600.000MB/s transfers
da16: Command Queueing enabled
da16: 4769307MB (9767541168 512 byte sectors)
da10 at mps1 bus 0 scbus1 target 23 lun 0
da10: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da10: Serial Number 4728K24SF57D
da10: 600.000MB/s transfers
da10: Command Queueing enabled
da10: 4769307MB (9767541168 512 byte sectors)
da8 at mps1 bus 0 scbus1 target 16 lun 0
da8: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da8: Serial Number 653DK7WPFS9A
da8: 600.000MB/s transfers
da8: Command Queueing enabled
da8: 4769307MB (9767541168 512 byte sectors)
da19 at mps2 bus 0 scbus2 target 12 lun 0
da19: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da19: Serial Number 653BK12FFS9A
da19: 600.000MB/s transfers
da19: Command Queueing enabled
da19: 4769307MB (9767541168 512 byte sectors)
GEOM_MIRROR: Force device swap start due to timeout.
GEOM_MIRROR: Device mirror/swap launched (3/10).
ix0: link state changed to UP
igb0: link state changed to UP
ums0 numa-domain 0 on uhub5
ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 2> on usbus0
ums0: 3 buttons and [Z] coordinates ID=0
[dan@knew:~] $
