NOTE: this post has been replaced by a newer version.
The older post is still available
This is x8dtu (named after the SuperMicro motherboard). This is the new FreshPorts server.
In short:
- FreeBSD 11 booting off a mirrored pair of zfsroot SSDs
- 4.5TB of mirrored ZFS
- 196612 MB of RAM (yeah, that’s 196GB of RAM)
- SuperMicro X8TDU motherboard
- Intel Xeon E5620 @ 2.40GHz (two of those, giving 16 CPUs)
NOTE: this post replaces an older version.
[dan@x8dtu:~] $ gpart show
=> 6 1220942635 ada0 GPT (4.5T)
6 1220280320 1 freebsd-zfs (4.5T)
1220280326 662315 - free - (2.5G)
=> 6 1220942635 ada1 GPT (4.5T)
6 1220280320 1 freebsd-zfs (4.5T)
1220280326 662315 - free - (2.5G)
=> 40 234441568 ada2 GPT (112G)
40 1024 1 freebsd-boot (512K)
1064 984 - free - (492K)
2048 4194304 2 freebsd-swap (2.0G)
4196352 230244352 3 freebsd-zfs (110G)
234440704 904 - free - (452K)
=> 40 234441568 ada3 GPT (112G)
40 1024 1 freebsd-boot (512K)
1064 984 - free - (492K)
2048 4194304 2 freebsd-swap (2.0G)
4196352 230244352 3 freebsd-zfs (110G)
234440704 904 - free - (452K)
[dan@x8dtu:~] $
[dan@x8dtu:~] $ zpool list NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT main_tank 4.53T 70.0G 4.46T - 1% 1% 1.00x ONLINE - zroot 109G 53.3G 55.7G - 32% 48% 1.00x ONLINE - [dan@x8dtu:~] $
[dan@x8dtu:~] $ zpool status pool: main_tank state: ONLINE scan: scrub repaired 0 in 0h28m with 0 errors on Sat Nov 11 04:28:07 2017 config: NAME STATE READ WRITE CKSUM main_tank ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada0p1 ONLINE 0 0 0 ada1p1 ONLINE 0 0 0 errors: No known data errors pool: zroot state: ONLINE scan: scrub repaired 0 in 0h6m with 0 errors on Sat Nov 11 04:06:18 2017 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada2p3 ONLINE 0 0 0 ada3p3 ONLINE 0 0 0 errors: No known data errors [dan@x8dtu:~] $
[dan@x8dtu:~] $ zpool get all zroot NAME PROPERTY VALUE SOURCE zroot size 109G - zroot capacity 48% - zroot altroot - default zroot health ONLINE - zroot guid 3940978777956737756 default zroot version - default zroot bootfs zroot/ROOT/default local zroot delegation on default zroot autoreplace off default zroot cachefile - default zroot failmode wait default zroot listsnapshots off default zroot autoexpand off default zroot dedupditto 0 default zroot dedupratio 1.00x - zroot free 55.7G - zroot allocated 53.3G - zroot readonly off - zroot comment - default zroot expandsize - - zroot freeing 0 default zroot fragmentation 32% - zroot leaked 0 default zroot feature@async_destroy enabled local zroot feature@empty_bpobj active local zroot feature@lz4_compress active local zroot feature@multi_vdev_crash_dump enabled local zroot feature@spacemap_histogram active local zroot feature@enabled_txg active local zroot feature@hole_birth active local zroot feature@extensible_dataset enabled local zroot feature@embedded_data active local zroot feature@bookmarks enabled local zroot feature@filesystem_limits enabled local zroot feature@large_blocks enabled local zroot feature@sha512 enabled local zroot feature@skein enabled local [dan@x8dtu:~] $
[dan@x8dtu:~] $ zpool get all main_tank NAME PROPERTY VALUE SOURCE main_tank size 4.53T - main_tank capacity 1% - main_tank altroot - default main_tank health ONLINE - main_tank guid 376274468418206170 default main_tank version - default main_tank bootfs - default main_tank delegation on default main_tank autoreplace off default main_tank cachefile - default main_tank failmode wait default main_tank listsnapshots off default main_tank autoexpand off default main_tank dedupditto 0 default main_tank dedupratio 1.00x - main_tank free 4.46T - main_tank allocated 70.0G - main_tank readonly off - main_tank comment - default main_tank expandsize - - main_tank freeing 0 default main_tank fragmentation 1% - main_tank leaked 0 default main_tank feature@async_destroy enabled local main_tank feature@empty_bpobj active local main_tank feature@lz4_compress active local main_tank feature@multi_vdev_crash_dump enabled local main_tank feature@spacemap_histogram active local main_tank feature@enabled_txg active local main_tank feature@hole_birth active local main_tank feature@extensible_dataset active local main_tank feature@embedded_data active local main_tank feature@bookmarks enabled local main_tank feature@filesystem_limits enabled local main_tank feature@large_blocks enabled local main_tank feature@sha512 enabled local main_tank feature@skein active local [dan@x8dtu:~] $
[dan@x8dtu:~] $ cat /var/run/dmesg.boot
Copyright (c) 1992-2017 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.1-RELEASE-p4 #0: Tue Nov 14 06:12:40 UTC 2017
root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 4.0.0 (tags/RELEASE_400/final 297347) (based on LLVM 4.0.0)
VT(vga): resolution 640x480
CPU: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz (2400.13-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x206c2 Family=0x6 Model=0x2c Stepping=2
Features=0xbfebfbff
Features2=0x29ee3ff
AMD Features=0x2c100800
AMD Features2=0x1
VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
TSC: P-state invariant, performance statistics
real memory = 206162624512 (196612 MB)
avail memory = 200487944192 (191200 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <080312 APIC1521>
FreeBSD/SMP: Multiprocessor System Detected: 16 CPUs
FreeBSD/SMP: 2 package(s) x 4 core(s) x 2 hardware threads
random: unblocking device.
ACPI BIOS Warning (bug): 32/64X length mismatch in FADT/Gpe0Block: 128/64 (20170303/tbfadt-748)
ioapic0: Changing APIC ID to 6
ioapic1: Changing APIC ID to 7
ioapic0 irqs 0-23 on motherboard
ioapic1 irqs 24-47 on motherboard
SMP: AP CPU #1 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #15 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #8 Launched!
SMP: AP CPU #13 Launched!
SMP: AP CPU #11 Launched!
SMP: AP CPU #9 Launched!
SMP: AP CPU #14 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #10 Launched!
SMP: AP CPU #12 Launched!
SMP: AP CPU #7 Launched!
Timecounter "TSC-low" frequency 1200065434 Hz quality 1000
random: entropy device external interface
kbd1 at kbdmux0
netmap: loaded module
module_register_init: MOD_LOAD (vesa, 0xffffffff80f5b220, 0) error 19
nexus0
vtvga0: on motherboard
cryptosoft0: on motherboard
acpi0: on motherboard
acpi0: Power Button (fixed)
cpu0: on acpi0
cpu1: on acpi0
cpu2: on acpi0
cpu3: on acpi0
cpu4: on acpi0
cpu5: on acpi0
cpu6: on acpi0
cpu7: on acpi0
cpu8: on acpi0
cpu9: on acpi0
cpu10: on acpi0
cpu11: on acpi0
cpu12: on acpi0
cpu13: on acpi0
cpu14: on acpi0
cpu15: on acpi0
attimer0: port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 340
Event timer "HPET2" frequency 14318180 Hz quality 340
Event timer "HPET3" frequency 14318180 Hz quality 340
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: port 0xcf8-0xcff numa-domain 0 on acpi0
pcib0: _OSC returned error 0x10
pci0: numa-domain 0 on pcib0
pcib1: at device 1.0 numa-domain 0 on pci0
pci1: numa-domain 0 on pcib1
igb0: port 0xec00-0xec1f mem 0xfbde0000-0xfbdfffff,0xfbdc0000-0xfbddffff,0xfbdbc000-0xfbdbffff irq 28 at device 0.0 numa-domain 0 on pci1
igb0: Using MSIX interrupts with 9 vectors
igb0: Ethernet address: 00:25:90:92:2d:b8
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 to cpu 3
igb0: Bound queue 4 to cpu 4
igb0: Bound queue 5 to cpu 5
igb0: Bound queue 6 to cpu 6
igb0: Bound queue 7 to cpu 7
igb0: netmap queues/slots: TX 8/1024, RX 8/1024
igb1: port 0xe880-0xe89f mem 0xfbd80000-0xfbd9ffff,0xfbd60000-0xfbd7ffff,0xfbd5c000-0xfbd5ffff irq 40 at device 0.1 numa-domain 0 on pci1
igb1: Using MSIX interrupts with 9 vectors
igb1: Ethernet address: 00:25:90:92:2d:b9
igb1: Bound queue 0 to cpu 8
igb1: Bound queue 1 to cpu 9
igb1: Bound queue 2 to cpu 10
igb1: Bound queue 3 to cpu 11
igb1: Bound queue 4 to cpu 12
igb1: Bound queue 5 to cpu 13
igb1: Bound queue 6 to cpu 14
igb1: Bound queue 7 to cpu 15
igb1: netmap queues/slots: TX 8/1024, RX 8/1024
pcib2: at device 3.0 numa-domain 0 on pci0
pci2: numa-domain 0 on pcib2
pcib3: at device 5.0 numa-domain 0 on pci0
pci3: numa-domain 0 on pcib3
pcib4: at device 7.0 numa-domain 0 on pci0
pci4: numa-domain 0 on pcib4
pcib5: at device 9.0 numa-domain 0 on pci0
pci5: numa-domain 0 on pcib5
pci0: port 0xdc00-0xdc1f irq 16 at device 26.0 numa-domain 0 on pci0
uhci0: LegSup = 0x2f00
usbus0 numa-domain 0 on uhci0
usbus0: 12Mbps Full Speed USB v1.0
uhci1: port 0xd880-0xd89f irq 21 at device 26.1 numa-domain 0 on pci0
uhci1: LegSup = 0x2f00
usbus1 numa-domain 0 on uhci1
usbus1: 12Mbps Full Speed USB v1.0
uhci2: port 0xd800-0xd81f irq 19 at device 26.2 numa-domain 0 on pci0
uhci2: LegSup = 0x2f00
usbus2 numa-domain 0 on uhci2
usbus2: 12Mbps Full Speed USB v1.0
ehci0: mem 0xfbeda000-0xfbeda3ff irq 18 at device 26.7 numa-domain 0 on pci0
usbus3: EHCI version 1.0
usbus3 numa-domain 0 on ehci0
usbus3: 480Mbps High Speed USB v2.0
uhci3: port 0xd480-0xd49f irq 23 at device 29.0 numa-domain 0 on pci0
uhci3: LegSup = 0x2f00
usbus4 numa-domain 0 on uhci3
usbus4: 12Mbps Full Speed USB v1.0
uhci4: port 0xd400-0xd41f irq 19 at device 29.1 numa-domain 0 on pci0
uhci4: LegSup = 0x2f00
usbus5 numa-domain 0 on uhci4
usbus5: 12Mbps Full Speed USB v1.0
uhci5: port 0xd080-0xd09f irq 18 at device 29.2 numa-domain 0 on pci0
uhci5: LegSup = 0x2f00
usbus6 numa-domain 0 on uhci5
usbus6: 12Mbps Full Speed USB v1.0
ehci1: mem 0xfbed8000-0xfbed83ff irq 23 at device 29.7 numa-domain 0 on pci0
usbus7: EHCI version 1.0
usbus7 numa-domain 0 on ehci1
usbus7: 480Mbps High Speed USB v2.0
pcib6: at device 30.0 numa-domain 0 on pci0
pci6: numa-domain 0 on pcib6
vgapci0: mem 0xf9000000-0xf9ffffff,0xfaffc000-0xfaffffff,0xfb000000-0xfb7fffff irq 18 at device 1.0 numa-domain 0 on pci6
vgapci0: Boot video device
isab0: at device 31.0 numa-domain 0 on pci0
isa0: numa-domain 0 on isab0
ahci0: port 0xc480-0xc487,0xd000-0xd003,0xcc00-0xcc07,0xc880-0xc883,0xc800-0xc81f mem 0xfbed6000-0xfbed67ff irq 19 at device 31.2 numa-domain 0 on pci0
ahci0: AHCI v1.20 with 6 3Gbps ports, Port Multiplier not supported
ahcich0: at channel 0 on ahci0
ahcich1: at channel 1 on ahci0
ahcich2: at channel 2 on ahci0
ahcich3: at channel 3 on ahci0
ahcich4: at channel 4 on ahci0
ahcich5: at channel 5 on ahci0
ahciem0: on ahci0
acpi_button0: on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
qpi0: on motherboard
pcib7: pcibus 255 on qpi0
pci7: on pcib7
pcib8: pcibus 254 on qpi0
pci8: on pcib8
orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0
atkbdc0: at port 0x60,0x64 on isa0
atkbd0: irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ppc0: cannot reserve I/O port range
coretemp0: on cpu0
est0: on cpu0
coretemp1: on cpu1
est1: on cpu1
coretemp2: on cpu2
est2: on cpu2
coretemp3: on cpu3
est3: on cpu3
coretemp4: on cpu4
est4: on cpu4
coretemp5: on cpu5
est5: on cpu5
coretemp6: on cpu6
est6: on cpu6
coretemp7: on cpu7
est7: on cpu7
coretemp8: on cpu8
est8: on cpu8
coretemp9: on cpu9
est9: on cpu9
coretemp10: on cpu10
est10: on cpu10
coretemp11: on cpu11
est11: on cpu11
coretemp12: on cpu12
est12: on cpu12
coretemp13: on cpu13
est13: on cpu13
coretemp14: on cpu14
est14: on cpu14
coretemp15: on cpu15
est15: on cpu15
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
nvme cam probe device init
ugen3.1: at usbus3
ugen1.1: at usbus1
ugen0.1: at usbus0
ugen7.1: at usbus7
ugen4.1: at usbus4
ugen6.1: at usbus6
ugen5.1: at usbus5
ugen2.1: at usbus2
uhub0: on usbus3
uhub1: on usbus6
uhub2: on usbus7
uhub3: on usbus0
uhub4: on usbus2
uhub5: on usbus1
uhub7: on usbus5
uhub6: on usbus4
ses0 at ahciem0 bus 0 scbus6 target 0 lun 0
ses0: SEMB S-E-S 2.00 device
ses0: SEMB SES Device
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: ATA8-ACS SATA 3.x device
ada0: Serial Number 44E1K00HFK7A
ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 4769307MB (1220942646 4096 byte sectors)
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: ATA8-ACS SATA 3.x device
ada1: Serial Number 44E1K00IFK7A
ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 4769307MB (1220942646 4096 byte sectors)
ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
ada2: ATA8-ACS SATA 3.x device
ada2: Serial Number LNEL132300KL120CGN
ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 114473MB (234441648 512 byte sectors)
ada2: quirks=0x1<4K>
ada3 at ahcich3 bus 0 scbus3 target 0 lun 0
ada3: ATA8-ACS SATA 3.x device
ada3: Serial Number LNEL126400MA120CGN
ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 114473MB (234441648 512 byte sectors)
ada3: quirks=0x1<4K>
Trying to mount root from zfs:zroot/ROOT/default []...
cd0 at ahcich4 bus 0 scbus4 target 0 lun 0
cd0: Removable CD-ROM SCSI device
cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes)
cd0: 656MB (336256 2048 byte sectors)
uhub1: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
uhub4: 2 ports with 2 removable, self powered
uhub5: 2 ports with 2 removable, self powered
uhub7: 2 ports with 2 removable, self powered
uhub6: 2 ports with 2 removable, self powered
uhub0: 6 ports with 6 removable, self powered
uhub2: 6 ports with 6 removable, self powered
ugen1.2: at usbus1
ukbd0 numa-domain 0 on uhub5
ukbd0: on usbus1
kbd2 at ukbd0
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
ums0 numa-domain 0 on uhub5
ums0: on usbus1
pflog0: promiscuous mode enabled
igb0: link state changed to UP
[dan@x8dtu:~] $
[dan@x8dtu:~] $ zfs list NAME USED AVAIL REFER MOUNTPOINT main_tank 70.0G 4.32T 96K /main_tank main_tank/data 41.3G 4.32T 88K /main_tank/data main_tank/data/freshports 41.3G 4.32T 88K /main_tank/data/freshports main_tank/data/freshports/backend 173M 4.32T 88K /main_tank/data/freshports/backend main_tank/data/freshports/backend/cache 460K 4.32T 96K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/cache main_tank/data/freshports/backend/cache/html 276K 4.32T 276K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/cache/html main_tank/data/freshports/backend/cache/spooling 88K 4.32T 88K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/cache/spooling main_tank/data/freshports/backend/queues 172M 4.32T 88K none main_tank/data/freshports/backend/queues/freshports 172M 4.32T 88K none main_tank/data/freshports/backend/queues/freshports/message-queues 172M 4.32T 88K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/message-queues main_tank/data/freshports/backend/queues/freshports/message-queues/archive 80.6M 4.32T 80.6M /iocage/jails/x8dtu-ingress01/root/var/db/freshports/message-queues/archive main_tank/data/freshports/backend/queues/freshports/message-queues/recent 91.2M 4.32T 91.2M /iocage/jails/x8dtu-ingress01/root/var/db/freshports/message-queues/recent main_tank/data/freshports/backend/queues/freshports/message-queues/retry 88K 4.32T 88K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/message-queues/retry main_tank/data/freshports/backend/queues/ingress 264K 4.32T 88K none main_tank/data/freshports/backend/queues/ingress/message-queues 176K 4.32T 88K /iocage/jails/x8dtu-ingress01/root/var/db/ingress/message-queues main_tank/data/freshports/backend/queues/ingress/message-queues/incoming 88K 4.32T 88K /iocage/jails/x8dtu-ingress01/root/var/db/ingress/message-queues/incoming main_tank/data/freshports/ports-jail 39.4G 4.32T 20.4G /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail main_tank/data/freshports/ports-jail/var 19.0G 4.32T 88K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var main_tank/data/freshports/ports-jail/var/db 19.0G 4.32T 88K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var/db main_tank/data/freshports/ports-jail/var/db/repos 19.0G 4.32T 19.0G /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var/db/repos main_tank/data/freshports/website 1.77G 4.32T 88K none main_tank/data/freshports/website/cache 1.77G 4.32T 2.52M /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache main_tank/data/freshports/website/cache/daily 748K 4.32T 748K /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/daily main_tank/data/freshports/website/cache/news 904K 4.32T 904K /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/news main_tank/data/freshports/website/cache/pages 88K 4.32T 88K /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/pages main_tank/data/freshports/website/cache/ports 1.76G 4.32T 1.76G /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/ports main_tank/data/freshports/website/cache/spooling 112K 4.32T 112K /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/spooling main_tank/home 10.5G 4.32T 10.5G /usr/home main_tank/iocage 18.1G 4.32T 112K /iocage main_tank/iocage/download 231M 4.32T 96K /iocage/download main_tank/iocage/download/11.0-RELEASE 112M 4.32T 112M /iocage/download/11.0-RELEASE main_tank/iocage/download/11.1-RELEASE 119M 4.32T 119M /iocage/download/11.1-RELEASE main_tank/iocage/images 96K 4.32T 96K /iocage/images main_tank/iocage/jails 17.2G 4.32T 96K /iocage/jails main_tank/iocage/jails/mx-ingress01 503M 4.32T 92K /iocage/jails/mx-ingress01 main_tank/iocage/jails/mx-ingress01/root 503M 4.32T 624M /iocage/jails/mx-ingress01/root main_tank/iocage/jails/x8dtu-ingress01 1.48G 4.32T 108K /iocage/jails/x8dtu-ingress01 main_tank/iocage/jails/x8dtu-ingress01/root 1.48G 4.32T 950M /iocage/jails/x8dtu-ingress01/root main_tank/iocage/jails/x8dtu-nginx01 1.11G 4.32T 108K /iocage/jails/x8dtu-nginx01 main_tank/iocage/jails/x8dtu-nginx01/root 1.11G 4.32T 1.06G /iocage/jails/x8dtu-nginx01/root main_tank/iocage/jails/x8dtu-pg01 14.1G 4.32T 92K /iocage/jails/x8dtu-pg01 main_tank/iocage/jails/x8dtu-pg01/root 14.1G 4.32T 7.76G /iocage/jails/x8dtu-pg01/root main_tank/iocage/log 312K 4.32T 144K /iocage/log main_tank/iocage/releases 660M 4.32T 96K /iocage/releases main_tank/iocage/releases/11.0-RELEASE 355M 4.32T 96K /iocage/releases/11.0-RELEASE main_tank/iocage/releases/11.0-RELEASE/root 355M 4.32T 355M /iocage/releases/11.0-RELEASE/root main_tank/iocage/releases/11.1-RELEASE 305M 4.32T 88K /iocage/releases/11.1-RELEASE main_tank/iocage/releases/11.1-RELEASE/root 305M 4.32T 302M /iocage/releases/11.1-RELEASE/root main_tank/iocage/templates 96K 4.32T 96K /iocage/templates zroot 53.3G 52.3G 96K /zroot zroot/ROOT 2.21G 52.3G 96K none zroot/ROOT/default 2.21G 52.3G 1.98G / zroot/data 51.1G 52.3G 88K /zroot/data zroot/data/dan-pg 8.54G 52.3G 8.54G /usr/home/dan/pg zroot/data/freshports 1.39G 52.3G 88K none zroot/data/freshports/repo 1.39G 52.3G 88K none zroot/data/freshports/repo/PORTS-head 1.39G 52.3G 1.39G /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var/db/repos/PORTS-head zroot/data/ingress01-testing 675M 52.3G 675M /iocage/jails/x8dtu-ingress01/root/usr/home/dan/tmp-fast zroot/data/pg01-pg96 40.5G 52.3G 40.2G /iocage/jails/x8dtu-pg01/root/var/db/postgres/data96 zroot/tmp 192K 52.3G 112K /tmp zroot/usr 192K 52.3G 96K /usr zroot/usr/src 96K 52.3G 96K /usr/src zroot/var 5.13M 52.3G 96K /var zroot/var/audit 96K 52.3G 96K /var/audit zroot/var/crash 96K 52.3G 96K /var/crash zroot/var/log 4.12M 52.3G 3.47M /var/log zroot/var/mail 184K 52.3G 120K /var/mail zroot/var/tmp 564K 52.3G 468K /var/tmp [dan@x8dtu:~] $
