This is x8dtu (named after the SuperMicro motherboard). This is the new FreshPorts server.
The older post is still available
In short:
- FreeBSD 11.2 booting off a mirrored pair of zfsroot SSDs
- 4.5TB of mirrored ZFS
- 196612 MB of RAM (yeah, that’s 196GB of RAM)
- SuperMicro X8DTU motherboard
- Intel Xeon E5620 @ 2.40GHz (two of those, giving 16 CPUs)
NOTE: this post replaces an older version.
[dan@x8dtu:~] $ sudo camcontrol devlistat scbus0 target 0 lun 0 (ada0,pass0) at scbus1 target 0 lun 0 (ada1,pass1) at scbus2 target 0 lun 0 (ada2,pass2) at scbus3 target 0 lun 0 (ada3,pass3) at scbus4 target 0 lun 0 (cd0,pass4) at scbus6 target 0 lun 0 (ses0,pass5) [dan@x8dtu:~] $
[dan@x8dtu:~] $ cat /etc/fstab # Device Mountpoint FStype Options Dump Pass# /dev/ada2p2 none swap sw 0 0 /dev/ada3p2 none swap sw 0 0 fdescfs /dev/fd fdescfs rw 0 0 /main_tank/data/dvl/Maildir /iocage/jails/mailjail/root/var/db/Maildir nullfs ro,nosuid,noexec 0 0 [dan@x8dtu:~] $
[dan@x8dtu:~] $ gpart show => 6 1220942635 ada0 GPT (4.5T) 6 1220280320 1 freebsd-zfs (4.5T) 1220280326 662315 - free - (2.5G) => 6 1220942635 ada1 GPT (4.5T) 6 1220280320 1 freebsd-zfs (4.5T) 1220280326 662315 - free - (2.5G) => 40 234441568 ada2 GPT (112G) 40 1024 1 freebsd-boot (512K) 1064 984 - free - (492K) 2048 4194304 2 freebsd-swap (2.0G) 4196352 230244352 3 freebsd-zfs (110G) 234440704 904 - free - (452K) => 40 234441568 ada3 GPT (112G) 40 1024 1 freebsd-boot (512K) 1064 984 - free - (492K) 2048 4194304 2 freebsd-swap (2.0G) 4196352 230244352 3 freebsd-zfs (110G) 234440704 904 - free - (452K) [dan@x8dtu:~] $
[dan@x8dtu:~] $ zpool list NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT main_tank 4.53T 870G 3.68T - - 10% 18% 1.00x ONLINE - zroot 109G 29.0G 80.0G - - 65% 26% 1.00x ONLINE - [dan@x8dtu:~] $
[dan@x8dtu:~] $ zpool status pool: main_tank state: ONLINE scan: scrub repaired 0 in 4h0m with 0 errors on Fri Nov 30 07:11:27 2018 config: NAME STATE READ WRITE CKSUM main_tank ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada0p1 ONLINE 0 0 0 ada1p1 ONLINE 0 0 0 errors: No known data errors pool: zroot state: ONLINE scan: scrub repaired 0 in 0h3m with 0 errors on Fri Nov 30 03:14:39 2018 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada2p3 ONLINE 0 0 0 ada3p3 ONLINE 0 0 0 errors: No known data errors [dan@x8dtu:~] $
[dan@x8dtu:~] $ zpool get all zroot NAME PROPERTY VALUE SOURCE zroot size 109G - zroot capacity 26% - zroot altroot - default zroot health ONLINE - zroot guid 3940978777956737756 default zroot version - default zroot bootfs zroot/ROOT/default local zroot delegation on default zroot autoreplace off default zroot cachefile - default zroot failmode wait default zroot listsnapshots off default zroot autoexpand off default zroot dedupditto 0 default zroot dedupratio 1.00x - zroot free 80.0G - zroot allocated 29.0G - zroot readonly off - zroot comment - default zroot expandsize - - zroot freeing 0 default zroot fragmentation 65% - zroot leaked 0 default zroot bootsize - default zroot checkpoint - - zroot feature@async_destroy enabled local zroot feature@empty_bpobj active local zroot feature@lz4_compress active local zroot feature@multi_vdev_crash_dump enabled local zroot feature@spacemap_histogram active local zroot feature@enabled_txg active local zroot feature@hole_birth active local zroot feature@extensible_dataset enabled local zroot feature@embedded_data active local zroot feature@bookmarks enabled local zroot feature@filesystem_limits enabled local zroot feature@large_blocks enabled local zroot feature@sha512 enabled local zroot feature@skein enabled local zroot feature@device_removal enabled local zroot feature@obsolete_counts enabled local zroot feature@zpool_checkpoint enabled local [dan@x8dtu:~] $
[dan@x8dtu:~] $ zpool get all main_tank NAME PROPERTY VALUE SOURCE main_tank size 4.53T - main_tank capacity 18% - main_tank altroot - default main_tank health ONLINE - main_tank guid 376274468418206170 default main_tank version - default main_tank bootfs - default main_tank delegation on default main_tank autoreplace off default main_tank cachefile - default main_tank failmode wait default main_tank listsnapshots off default main_tank autoexpand off default main_tank dedupditto 0 default main_tank dedupratio 1.00x - main_tank free 3.68T - main_tank allocated 870G - main_tank readonly off - main_tank comment - default main_tank expandsize - - main_tank freeing 0 default main_tank fragmentation 10% - main_tank leaked 0 default main_tank bootsize - default main_tank checkpoint - - main_tank feature@async_destroy enabled local main_tank feature@empty_bpobj active local main_tank feature@lz4_compress active local main_tank feature@multi_vdev_crash_dump enabled local main_tank feature@spacemap_histogram active local main_tank feature@enabled_txg active local main_tank feature@hole_birth active local main_tank feature@extensible_dataset active local main_tank feature@embedded_data active local main_tank feature@bookmarks enabled local main_tank feature@filesystem_limits enabled local main_tank feature@large_blocks enabled local main_tank feature@sha512 enabled local main_tank feature@skein active local main_tank feature@device_removal enabled local main_tank feature@obsolete_counts enabled local main_tank feature@zpool_checkpoint enabled local [dan@x8dtu:~] $
[dan@x8dtu:~] $ cat /var/run/dmesg.boot Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.2-RELEASE-p5 #0: Tue Nov 27 09:33:52 UTC 2018 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz (2400.13-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206c2 Family=0x6 Model=0x2c Stepping=2 Features=0xbfebfbffFeatures2=0x29ee3ff AMD Features=0x2c100800 AMD Features2=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 206162624512 (196612 MB) avail memory = 200484589568 (191197 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: <080312 APIC1521> FreeBSD/SMP: Multiprocessor System Detected: 16 CPUs FreeBSD/SMP: 2 package(s) x 4 core(s) x 2 hardware threads Firmware Warning (ACPI): 32/64X length mismatch in FADT/Gpe0Block: 128/64 (20171214/tbfadt-748) ioapic0: Changing APIC ID to 6 ioapic1: Changing APIC ID to 7 ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard SMP: AP CPU #1 Launched! SMP: AP CPU #10 Launched! SMP: AP CPU #11 Launched! SMP: AP CPU #14 Launched! SMP: AP CPU #15 Launched! SMP: AP CPU #9 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #13 Launched! SMP: AP CPU #12 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #8 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #4 Launched! Timecounter "TSC-low" frequency 1200067234 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff80ff4580, 0) error 19 nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 cpu8: on acpi0 cpu9: on acpi0 cpu10: on acpi0 cpu11: on acpi0 cpu12: on acpi0 cpu13: on acpi0 cpu14: on acpi0 cpu15: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: port 0xcf8-0xcff numa-domain 0 on acpi0 pcib0: _OSC returned error 0x10 pci0: numa-domain 0 on pcib0 pcib1: at device 1.0 numa-domain 0 on pci0 pci1: numa-domain 0 on pcib1 igb0: port 0xec00-0xec1f mem 0xfbde0000-0xfbdfffff,0xfbdc0000-0xfbddffff,0xfbdbc000-0xfbdbffff irq 28 at device 0.0 numa-domain 0 on pci1 igb0: Using MSIX interrupts with 9 vectors igb0: Ethernet address: 00:25:90:92:2d:b8 igb0: Bound queue 0 to cpu 0 igb0: Bound queue 1 to cpu 1 igb0: Bound queue 2 to cpu 2 igb0: Bound queue 3 to cpu 3 igb0: Bound queue 4 to cpu 4 igb0: Bound queue 5 to cpu 5 igb0: Bound queue 6 to cpu 6 igb0: Bound queue 7 to cpu 7 igb0: netmap queues/slots: TX 8/1024, RX 8/1024 igb1: port 0xe880-0xe89f mem 0xfbd80000-0xfbd9ffff,0xfbd60000-0xfbd7ffff,0xfbd5c000-0xfbd5ffff irq 40 at device 0.1 numa-domain 0 on pci1 igb1: Using MSIX interrupts with 9 vectors igb1: Ethernet address: 00:25:90:92:2d:b9 igb1: Bound queue 0 to cpu 8 igb1: Bound queue 1 to cpu 9 igb1: Bound queue 2 to cpu 10 igb1: Bound queue 3 to cpu 11 igb1: Bound queue 4 to cpu 12 igb1: Bound queue 5 to cpu 13 igb1: Bound queue 6 to cpu 14 igb1: Bound queue 7 to cpu 15 igb1: netmap queues/slots: TX 8/1024, RX 8/1024 pcib2: at device 3.0 numa-domain 0 on pci0 pci2: numa-domain 0 on pcib2 pcib3: at device 5.0 numa-domain 0 on pci0 pci3: numa-domain 0 on pcib3 pcib4: at device 7.0 numa-domain 0 on pci0 pci4: numa-domain 0 on pcib4 pcib5: at device 9.0 numa-domain 0 on pci0 pci5: numa-domain 0 on pcib5 pci0: at device 20.0 (no driver attached) pci0: at device 20.1 (no driver attached) pci0: at device 20.2 (no driver attached) pci0: at device 20.3 (no driver attached) uhci0: port 0xdc00-0xdc1f irq 16 at device 26.0 numa-domain 0 on pci0 uhci0: LegSup = 0x2f00 usbus0 numa-domain 0 on uhci0 usbus0: 12Mbps Full Speed USB v1.0 uhci1: port 0xd880-0xd89f irq 21 at device 26.1 numa-domain 0 on pci0 uhci1: LegSup = 0x2f00 usbus1 numa-domain 0 on uhci1 usbus1: 12Mbps Full Speed USB v1.0 uhci2: port 0xd800-0xd81f irq 19 at device 26.2 numa-domain 0 on pci0 uhci2: LegSup = 0x2f00 usbus2 numa-domain 0 on uhci2 usbus2: 12Mbps Full Speed USB v1.0 ehci0: mem 0xfbeda000-0xfbeda3ff irq 18 at device 26.7 numa-domain 0 on pci0 usbus3: EHCI version 1.0 usbus3 numa-domain 0 on ehci0 usbus3: 480Mbps High Speed USB v2.0 uhci3: port 0xd480-0xd49f irq 23 at device 29.0 numa-domain 0 on pci0 uhci3: LegSup = 0x2f00 usbus4 numa-domain 0 on uhci3 usbus4: 12Mbps Full Speed USB v1.0 uhci4: port 0xd400-0xd41f irq 19 at device 29.1 numa-domain 0 on pci0 uhci4: LegSup = 0x2f00 usbus5 numa-domain 0 on uhci4 usbus5: 12Mbps Full Speed USB v1.0 uhci5: port 0xd080-0xd09f irq 18 at device 29.2 numa-domain 0 on pci0 uhci5: LegSup = 0x2f00 usbus6 numa-domain 0 on uhci5 usbus6: 12Mbps Full Speed USB v1.0 ehci1: mem 0xfbed8000-0xfbed83ff irq 23 at device 29.7 numa-domain 0 on pci0 usbus7: EHCI version 1.0 usbus7 numa-domain 0 on ehci1 usbus7: 480Mbps High Speed USB v2.0 pcib6: at device 30.0 numa-domain 0 on pci0 pci6: numa-domain 0 on pcib6 vgapci0: mem 0xf9000000-0xf9ffffff,0xfaffc000-0xfaffffff,0xfb000000-0xfb7fffff irq 18 at device 1.0 numa-domain 0 on pci6 vgapci0: Boot video device isab0: at device 31.0 numa-domain 0 on pci0 isa0: numa-domain 0 on isab0 ahci0: port 0xc480-0xc487,0xd000-0xd003,0xcc00-0xcc07,0xc880-0xc883,0xc800-0xc81f mem 0xfbed6000-0xfbed67ff irq 19 at device 31.2 numa-domain 0 on pci0 ahci0: AHCI v1.20 with 6 3Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahcich4: at channel 4 on ahci0 ahcich5: at channel 5 on ahci0 ahciem0: on ahci0 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] ppc0: cannot reserve I/O port range coretemp0: on cpu0 est0: on cpu0 coretemp1: on cpu1 est1: on cpu1 coretemp2: on cpu2 est2: on cpu2 coretemp3: on cpu3 est3: on cpu3 coretemp4: on cpu4 est4: on cpu4 coretemp5: on cpu5 est5: on cpu5 coretemp6: on cpu6 est6: on cpu6 coretemp7: on cpu7 est7: on cpu7 coretemp8: on cpu8 est8: on cpu8 coretemp9: on cpu9 est9: on cpu9 coretemp10: on cpu10 est10: on cpu10 coretemp11: on cpu11 est11: on cpu11 coretemp12: on cpu12 est12: on cpu12 coretemp13: on cpu13 est13: on cpu13 coretemp14: on cpu14 est14: on cpu14 coretemp15: on cpu15 est15: on cpu15 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec ugen7.1: at usbus7 ugen0.1: at usbus0 ugen2.1: at usbus2 ugen5.1: at usbus5 ugen4.1: at usbus4 ugen3.1: at usbus3 ugen6.1: at usbus6 ugen1.1: at usbus1 uhub0: on usbus7 uhub1: on usbus5 uhub2: on usbus1 uhub3: on usbus0 uhub4: on usbus3 uhub5: on usbus6 uhub6: on usbus4 uhub7: on usbus2 ses0 at ahciem0 bus 0 scbus6 target 0 lun 0 ses0: SEMB S-E-S 2.00 device cd0 at ahcich4 bus 0 scbus4 target 0 lun 0 ses0: SEMB SES Device cd0: Removable CD-ROM SCSI device cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes) cd0: 656MB (336256 2048 byte sectors) ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA8-ACS SATA 3.x device ada0: Serial Number 44E1K00HFK7A ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada0: Command Queueing enabled ada0: 4769307MB (1220942646 4096 byte sectors) ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ATA8-ACS SATA 3.x device ada1: Serial Number 44E1K00IFK7A ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada1: Command Queueing enabled ada1: 4769307MB (1220942646 4096 byte sectors) ada2 at ahcich2 bus 0 scbus2 target 0 lun 0 ada2: ATA8-ACS SATA 3.x device ada2: Serial Number LNEL132300KL120CGN ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 114473MB (234441648 512 byte sectors) ada2: quirks=0x1<4K> ada3 at ahcich3 bus 0 scbus3 target 0 lun 0 ada3: ATA8-ACS SATA 3.x device ada3: Serial Number LNEL126400MA120CGN ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada3: Command Queueing enabled ada3: 114473MB (234441648 512 byte sectors) ada3: quirks=0x1<4K> Trying to mount root from zfs:zroot/ROOT/default []... uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered uhub6: 2 ports with 2 removable, self powered uhub7: 2 ports with 2 removable, self powered uhub0: 6 ports with 6 removable, self powered uhub4: 6 ports with 6 removable, self powered ugen1.2: at usbus1 ukbd0 numa-domain 0 on uhub2 ukbd0: on usbus1 kbd2 at ukbd0 (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back (cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 (cd0:ahcich4:0:0:0): CAM status: SCSI Status Error (cd0:ahcich4:0:0:0): SCSI status: Check Condition (cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) (cd0:ahcich4:0:0:0): Error 5, Unretryable error (cd0:ahcich4:0:0:0): cddone: got error 0x5 back random: unblocking device. igb0: link state changed to UP ums0 numa-domain 0 on uhub2 ums0: on usbus1 pflog0: promiscuous mode enabled [dan@x8dtu:~] $
[dan@x8dtu:~] $ zfs list NAME USED AVAIL REFER MOUNTPOINT main_tank 870G 3.54T 96K /main_tank main_tank/data 783G 3.54T 88K /main_tank/data main_tank/data/dvl 755G 3.54T 755G /main_tank/data/dvl main_tank/data/freshports 28.5G 3.54T 88K /main_tank/data/freshports main_tank/data/freshports/backend 2.28G 3.54T 88K /main_tank/data/freshports/backend main_tank/data/freshports/backend/cache 288K 3.54T 96K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/cache main_tank/data/freshports/backend/cache/html 104K 3.54T 104K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/cache/html main_tank/data/freshports/backend/cache/spooling 88K 3.54T 88K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/cache/spooling main_tank/data/freshports/backend/queues 2.28G 3.54T 88K none main_tank/data/freshports/backend/queues/archive 2.28G 3.54T 2.28G /iocage/jails/x8dtu-ingress01/root/var/db/freshports/message-queues/archive main_tank/data/freshports/backend/queues/incoming 88K 3.54T 88K /iocage/jails/x8dtu-ingress01/root/var/db/ingress/message-queues/incoming main_tank/data/freshports/backend/queues/recent 3.46M 3.54T 3.46M /iocage/jails/x8dtu-ingress01/root/var/db/freshports/message-queues/recent main_tank/data/freshports/backend/queues/retry 188K 3.54T 188K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/message-queues/retry main_tank/data/freshports/ports-jail 24.2G 3.54T 172K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail main_tank/data/freshports/ports-jail/var 24.2G 3.54T 88K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var main_tank/data/freshports/ports-jail/var/db 24.2G 3.54T 88K /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var/db main_tank/data/freshports/ports-jail/var/db/repos 24.2G 3.54T 24.2G /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var/db/repos main_tank/data/freshports/website 2.01G 3.54T 88K none main_tank/data/freshports/website/cache 2.01G 3.54T 103M /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache main_tank/data/freshports/website/cache/daily 12.4M 3.54T 12.4M /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/daily main_tank/data/freshports/website/cache/news 112K 3.54T 112K /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/news main_tank/data/freshports/website/cache/pages 88K 3.54T 88K /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/pages main_tank/data/freshports/website/cache/ports 1.89G 3.54T 1.89G /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/ports main_tank/data/freshports/website/cache/spooling 120K 3.54T 120K /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/spooling main_tank/home 10.5G 3.54T 10.5G /usr/home main_tank/iocage 75.9G 3.54T 116K /iocage main_tank/iocage/download 503M 3.54T 96K /iocage/download main_tank/iocage/download/11.0-RELEASE 112M 3.54T 112M /iocage/download/11.0-RELEASE main_tank/iocage/download/11.1-RELEASE 119M 3.54T 119M /iocage/download/11.1-RELEASE main_tank/iocage/download/11.2-RELEASE 272M 3.54T 272M /iocage/download/11.2-RELEASE main_tank/iocage/images 96K 3.54T 96K /iocage/images main_tank/iocage/jails 73.8G 3.54T 104K /iocage/jails main_tank/iocage/jails/mailjail 322M 3.54T 92K /iocage/jails/mailjail main_tank/iocage/jails/mailjail/root 322M 3.54T 1.26G /iocage/jails/mailjail/root main_tank/iocage/jails/mx-ingress01 1.52G 3.54T 92K /iocage/jails/mx-ingress01 main_tank/iocage/jails/mx-ingress01/root 1.52G 3.54T 1.28G /iocage/jails/mx-ingress01/root main_tank/iocage/jails/x8dtu-ingress01 2.84G 3.54T 108K /iocage/jails/x8dtu-ingress01 main_tank/iocage/jails/x8dtu-ingress01/root 2.84G 3.54T 1.72G /iocage/jails/x8dtu-ingress01/root main_tank/iocage/jails/x8dtu-nginx01 3.55G 3.54T 108K /iocage/jails/x8dtu-nginx01 main_tank/iocage/jails/x8dtu-nginx01/root 3.55G 3.54T 1.98G /iocage/jails/x8dtu-nginx01/root main_tank/iocage/jails/x8dtu-pg01 35.5G 3.54T 92K /iocage/jails/x8dtu-pg01 main_tank/iocage/jails/x8dtu-pg01/root 35.5G 3.54T 28.3G /iocage/jails/x8dtu-pg01/root main_tank/iocage/jails/x8dtu-pg02.vpn.unixathome.org 30.1G 3.54T 92K /iocage/jails/x8dtu-pg02.vpn.unixathome.org main_tank/iocage/jails/x8dtu-pg02.vpn.unixathome.org/root 30.1G 3.54T 31.0G /iocage/jails/x8dtu-pg02.vpn.unixathome.org/root main_tank/iocage/log 332K 3.54T 156K /iocage/log main_tank/iocage/releases 1.59G 3.54T 96K /iocage/releases main_tank/iocage/releases/11.0-RELEASE 355M 3.54T 96K /iocage/releases/11.0-RELEASE main_tank/iocage/releases/11.0-RELEASE/root 355M 3.54T 355M /iocage/releases/11.0-RELEASE/root main_tank/iocage/releases/11.1-RELEASE 305M 3.54T 88K /iocage/releases/11.1-RELEASE main_tank/iocage/releases/11.1-RELEASE/root 305M 3.54T 302M /iocage/releases/11.1-RELEASE/root main_tank/iocage/releases/11.2-RELEASE 971M 3.54T 88K /iocage/releases/11.2-RELEASE main_tank/iocage/releases/11.2-RELEASE/root 971M 3.54T 971M /iocage/releases/11.2-RELEASE/root main_tank/iocage/templates 96K 3.54T 96K /iocage/templates main_tank/snapshots-for-backup 88K 3.54T 88K /main_tank/snapshots-for-backup zroot 29.0G 76.6G 96K /zroot zroot/ROOT 3.84G 76.6G 96K none zroot/ROOT/11.1-RELEASE 8K 76.6G 2.29G / zroot/ROOT/default 3.84G 76.6G 2.70G / zroot/TESTING 616K 76.6G 88K /zroot/TESTING zroot/TESTING/top 528K 76.6G 88K /zroot/TESTING/top zroot/TESTING/top/test1 88K 76.6G 88K /zroot/TESTING/top/test1 zroot/TESTING/top/test2 88K 76.6G 88K /zroot/TESTING/top/test2 zroot/TESTING/top/test3 88K 76.6G 88K /zroot/TESTING/top/test3 zroot/TESTING/top/test4 88K 76.6G 88K /zroot/TESTING/top/test4 zroot/TESTING/top/test5 88K 76.6G 88K /zroot/TESTING/top/test5 zroot/data 24.8G 76.6G 88K /zroot/data zroot/data/dan-pg 88K 76.6G 88K /usr/home/dan/pg zroot/data/freshports 3.01G 76.6G 88K none zroot/data/freshports/repo 3.01G 76.6G 88K none zroot/data/freshports/repo/PORTS-head 3.01G 76.6G 3.01G /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var/db/repos/PORTS-head zroot/data/ingress01-testing 675M 76.6G 675M /iocage/jails/x8dtu-ingress01/root/usr/home/dan/tmp-fast zroot/data/pg01-pg96 21.2G 76.6G 21.2G /iocage/jails/x8dtu-pg01/root/var/db/postgres/data96 zroot/tmp 208K 76.6G 112K /tmp zroot/usr 192K 76.6G 96K /usr zroot/usr/src 96K 76.6G 96K /usr/src zroot/var 165M 76.6G 96K /var zroot/var/audit 96K 76.6G 96K /var/audit zroot/var/crash 96K 76.6G 96K /var/crash zroot/var/log 164M 76.6G 163M /var/log zroot/var/mail 184K 76.6G 120K /var/mail zroot/var/tmp 932K 76.6G 724K /var/tmp [dan@x8dtu:~] $