Dec 052018
 

This is x8dtu (named after the SuperMicro motherboard). This is the new FreshPorts server.

In short:

  • FreeBSD 11.2 booting off a mirrored pair of zfsroot SSDs
  • 4.5TB of mirrored ZFS
  • 196612 MB of RAM (yeah, that’s 196GB of RAM)
  • SuperMicro X8TDU motherboard
  • Intel Xeon E5620 @ 2.40GHz (two of those, giving 16 CPUs)

NOTE: this post replaces an older version.

[dan@x8dtu:~] $ sudo camcontrol devlist
         at scbus0 target 0 lun 0 (ada0,pass0)
         at scbus1 target 0 lun 0 (ada1,pass1)
         at scbus2 target 0 lun 0 (ada2,pass2)
         at scbus3 target 0 lun 0 (ada3,pass3)
               at scbus4 target 0 lun 0 (cd0,pass4)
   at scbus6 target 0 lun 0 (ses0,pass5)
[dan@x8dtu:~] $ 
[dan@x8dtu:~] $ cat /etc/fstab
# Device		Mountpoint	FStype	Options		Dump	Pass#
/dev/ada2p2		none	swap	sw		0	0
/dev/ada3p2		none	swap	sw		0	0

fdescfs /dev/fd  fdescfs  rw  0  0


/main_tank/data/dvl/Maildir   /iocage/jails/mailjail/root/var/db/Maildir   nullfs  ro,nosuid,noexec  0   0
[dan@x8dtu:~] $ 
[dan@x8dtu:~] $ gpart show
=>         6  1220942635  ada0  GPT  (4.5T)
           6  1220280320     1  freebsd-zfs  (4.5T)
  1220280326      662315        - free -  (2.5G)

=>         6  1220942635  ada1  GPT  (4.5T)
           6  1220280320     1  freebsd-zfs  (4.5T)
  1220280326      662315        - free -  (2.5G)

=>       40  234441568  ada2  GPT  (112G)
         40       1024     1  freebsd-boot  (512K)
       1064        984        - free -  (492K)
       2048    4194304     2  freebsd-swap  (2.0G)
    4196352  230244352     3  freebsd-zfs  (110G)
  234440704        904        - free -  (452K)

=>       40  234441568  ada3  GPT  (112G)
         40       1024     1  freebsd-boot  (512K)
       1064        984        - free -  (492K)
       2048    4194304     2  freebsd-swap  (2.0G)
    4196352  230244352     3  freebsd-zfs  (110G)
  234440704        904        - free -  (452K)

[dan@x8dtu:~] $ 
[dan@x8dtu:~] $ zpool list
NAME        SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT
main_tank  4.53T   870G  3.68T        -         -    10%    18%  1.00x  ONLINE  -
zroot       109G  29.0G  80.0G        -         -    65%    26%  1.00x  ONLINE  -
[dan@x8dtu:~] $ 
[dan@x8dtu:~] $ zpool status
  pool: main_tank
 state: ONLINE
  scan: scrub repaired 0 in 4h0m with 0 errors on Fri Nov 30 07:11:27 2018
config:

	NAME        STATE     READ WRITE CKSUM
	main_tank   ONLINE       0     0     0
	  mirror-0  ONLINE       0     0     0
	    ada0p1  ONLINE       0     0     0
	    ada1p1  ONLINE       0     0     0

errors: No known data errors

  pool: zroot
 state: ONLINE
  scan: scrub repaired 0 in 0h3m with 0 errors on Fri Nov 30 03:14:39 2018
config:

	NAME        STATE     READ WRITE CKSUM
	zroot       ONLINE       0     0     0
	  mirror-0  ONLINE       0     0     0
	    ada2p3  ONLINE       0     0     0
	    ada3p3  ONLINE       0     0     0

errors: No known data errors
[dan@x8dtu:~] $ 
[dan@x8dtu:~] $ zpool get all zroot
NAME   PROPERTY                       VALUE                          SOURCE
zroot  size                           109G                           -
zroot  capacity                       26%                            -
zroot  altroot                        -                              default
zroot  health                         ONLINE                         -
zroot  guid                           3940978777956737756            default
zroot  version                        -                              default
zroot  bootfs                         zroot/ROOT/default             local
zroot  delegation                     on                             default
zroot  autoreplace                    off                            default
zroot  cachefile                      -                              default
zroot  failmode                       wait                           default
zroot  listsnapshots                  off                            default
zroot  autoexpand                     off                            default
zroot  dedupditto                     0                              default
zroot  dedupratio                     1.00x                          -
zroot  free                           80.0G                          -
zroot  allocated                      29.0G                          -
zroot  readonly                       off                            -
zroot  comment                        -                              default
zroot  expandsize                     -                              -
zroot  freeing                        0                              default
zroot  fragmentation                  65%                            -
zroot  leaked                         0                              default
zroot  bootsize                       -                              default
zroot  checkpoint                     -                              -
zroot  feature@async_destroy          enabled                        local
zroot  feature@empty_bpobj            active                         local
zroot  feature@lz4_compress           active                         local
zroot  feature@multi_vdev_crash_dump  enabled                        local
zroot  feature@spacemap_histogram     active                         local
zroot  feature@enabled_txg            active                         local
zroot  feature@hole_birth             active                         local
zroot  feature@extensible_dataset     enabled                        local
zroot  feature@embedded_data          active                         local
zroot  feature@bookmarks              enabled                        local
zroot  feature@filesystem_limits      enabled                        local
zroot  feature@large_blocks           enabled                        local
zroot  feature@sha512                 enabled                        local
zroot  feature@skein                  enabled                        local
zroot  feature@device_removal         enabled                        local
zroot  feature@obsolete_counts        enabled                        local
zroot  feature@zpool_checkpoint       enabled                        local
[dan@x8dtu:~] $
[dan@x8dtu:~] $ zpool get all main_tank
NAME       PROPERTY                       VALUE                          SOURCE
main_tank  size                           4.53T                          -
main_tank  capacity                       18%                            -
main_tank  altroot                        -                              default
main_tank  health                         ONLINE                         -
main_tank  guid                           376274468418206170             default
main_tank  version                        -                              default
main_tank  bootfs                         -                              default
main_tank  delegation                     on                             default
main_tank  autoreplace                    off                            default
main_tank  cachefile                      -                              default
main_tank  failmode                       wait                           default
main_tank  listsnapshots                  off                            default
main_tank  autoexpand                     off                            default
main_tank  dedupditto                     0                              default
main_tank  dedupratio                     1.00x                          -
main_tank  free                           3.68T                          -
main_tank  allocated                      870G                           -
main_tank  readonly                       off                            -
main_tank  comment                        -                              default
main_tank  expandsize                     -                              -
main_tank  freeing                        0                              default
main_tank  fragmentation                  10%                            -
main_tank  leaked                         0                              default
main_tank  bootsize                       -                              default
main_tank  checkpoint                     -                              -
main_tank  feature@async_destroy          enabled                        local
main_tank  feature@empty_bpobj            active                         local
main_tank  feature@lz4_compress           active                         local
main_tank  feature@multi_vdev_crash_dump  enabled                        local
main_tank  feature@spacemap_histogram     active                         local
main_tank  feature@enabled_txg            active                         local
main_tank  feature@hole_birth             active                         local
main_tank  feature@extensible_dataset     active                         local
main_tank  feature@embedded_data          active                         local
main_tank  feature@bookmarks              enabled                        local
main_tank  feature@filesystem_limits      enabled                        local
main_tank  feature@large_blocks           enabled                        local
main_tank  feature@sha512                 enabled                        local
main_tank  feature@skein                  active                         local
main_tank  feature@device_removal         enabled                        local
main_tank  feature@obsolete_counts        enabled                        local
main_tank  feature@zpool_checkpoint       enabled                        local
[dan@x8dtu:~] $ 
[dan@x8dtu:~] $ cat /var/run/dmesg.boot
Copyright (c) 1992-2018 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.2-RELEASE-p5 #0: Tue Nov 27 09:33:52 UTC 2018
    root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0)
VT(vga): resolution 640x480
CPU: Intel(R) Xeon(R) CPU           E5620  @ 2.40GHz (2400.13-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x206c2  Family=0x6  Model=0x2c  Stepping=2
  Features=0xbfebfbff
  Features2=0x29ee3ff
  AMD Features=0x2c100800
  AMD Features2=0x1
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
real memory  = 206162624512 (196612 MB)
avail memory = 200484589568 (191197 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <080312 APIC1521>
FreeBSD/SMP: Multiprocessor System Detected: 16 CPUs
FreeBSD/SMP: 2 package(s) x 4 core(s) x 2 hardware threads
Firmware Warning (ACPI): 32/64X length mismatch in FADT/Gpe0Block: 128/64 (20171214/tbfadt-748)
ioapic0: Changing APIC ID to 6
ioapic1: Changing APIC ID to 7
ioapic0  irqs 0-23 on motherboard
ioapic1  irqs 24-47 on motherboard
SMP: AP CPU #1 Launched!
SMP: AP CPU #10 Launched!
SMP: AP CPU #11 Launched!
SMP: AP CPU #14 Launched!
SMP: AP CPU #15 Launched!
SMP: AP CPU #9 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #13 Launched!
SMP: AP CPU #12 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #8 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #4 Launched!
Timecounter "TSC-low" frequency 1200067234 Hz quality 1000
random: entropy device external interface
kbd1 at kbdmux0
netmap: loaded module
module_register_init: MOD_LOAD (vesa, 0xffffffff80ff4580, 0) error 19
nexus0
vtvga0:  on motherboard
cryptosoft0:  on motherboard
acpi0:  on motherboard
acpi0: Power Button (fixed)
cpu0:  on acpi0
cpu1:  on acpi0
cpu2:  on acpi0
cpu3:  on acpi0
cpu4:  on acpi0
cpu5:  on acpi0
cpu6:  on acpi0
cpu7:  on acpi0
cpu8:  on acpi0
cpu9:  on acpi0
cpu10:  on acpi0
cpu11:  on acpi0
cpu12:  on acpi0
cpu13:  on acpi0
cpu14:  on acpi0
cpu15:  on acpi0
attimer0:  port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0:  port 0x70-0x71 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0:  iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 340
Event timer "HPET2" frequency 14318180 Hz quality 340
Event timer "HPET3" frequency 14318180 Hz quality 340
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0:  port 0xcf8-0xcff numa-domain 0 on acpi0
pcib0: _OSC returned error 0x10
pci0:  numa-domain 0 on pcib0
pcib1:  at device 1.0 numa-domain 0 on pci0
pci1:  numa-domain 0 on pcib1
igb0:  port 0xec00-0xec1f mem 0xfbde0000-0xfbdfffff,0xfbdc0000-0xfbddffff,0xfbdbc000-0xfbdbffff irq 28 at device 0.0 numa-domain 0 on pci1
igb0: Using MSIX interrupts with 9 vectors
igb0: Ethernet address: 00:25:90:92:2d:b8
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 to cpu 3
igb0: Bound queue 4 to cpu 4
igb0: Bound queue 5 to cpu 5
igb0: Bound queue 6 to cpu 6
igb0: Bound queue 7 to cpu 7
igb0: netmap queues/slots: TX 8/1024, RX 8/1024
igb1:  port 0xe880-0xe89f mem 0xfbd80000-0xfbd9ffff,0xfbd60000-0xfbd7ffff,0xfbd5c000-0xfbd5ffff irq 40 at device 0.1 numa-domain 0 on pci1
igb1: Using MSIX interrupts with 9 vectors
igb1: Ethernet address: 00:25:90:92:2d:b9
igb1: Bound queue 0 to cpu 8
igb1: Bound queue 1 to cpu 9
igb1: Bound queue 2 to cpu 10
igb1: Bound queue 3 to cpu 11
igb1: Bound queue 4 to cpu 12
igb1: Bound queue 5 to cpu 13
igb1: Bound queue 6 to cpu 14
igb1: Bound queue 7 to cpu 15
igb1: netmap queues/slots: TX 8/1024, RX 8/1024
pcib2:  at device 3.0 numa-domain 0 on pci0
pci2:  numa-domain 0 on pcib2
pcib3:  at device 5.0 numa-domain 0 on pci0
pci3:  numa-domain 0 on pcib3
pcib4:  at device 7.0 numa-domain 0 on pci0
pci4:  numa-domain 0 on pcib4
pcib5:  at device 9.0 numa-domain 0 on pci0
pci5:  numa-domain 0 on pcib5
pci0:  at device 20.0 (no driver attached)
pci0:  at device 20.1 (no driver attached)
pci0:  at device 20.2 (no driver attached)
pci0:  at device 20.3 (no driver attached)
uhci0:  port 0xdc00-0xdc1f irq 16 at device 26.0 numa-domain 0 on pci0
uhci0: LegSup = 0x2f00
usbus0 numa-domain 0 on uhci0
usbus0: 12Mbps Full Speed USB v1.0
uhci1:  port 0xd880-0xd89f irq 21 at device 26.1 numa-domain 0 on pci0
uhci1: LegSup = 0x2f00
usbus1 numa-domain 0 on uhci1
usbus1: 12Mbps Full Speed USB v1.0
uhci2:  port 0xd800-0xd81f irq 19 at device 26.2 numa-domain 0 on pci0
uhci2: LegSup = 0x2f00
usbus2 numa-domain 0 on uhci2
usbus2: 12Mbps Full Speed USB v1.0
ehci0:  mem 0xfbeda000-0xfbeda3ff irq 18 at device 26.7 numa-domain 0 on pci0
usbus3: EHCI version 1.0
usbus3 numa-domain 0 on ehci0
usbus3: 480Mbps High Speed USB v2.0
uhci3:  port 0xd480-0xd49f irq 23 at device 29.0 numa-domain 0 on pci0
uhci3: LegSup = 0x2f00
usbus4 numa-domain 0 on uhci3
usbus4: 12Mbps Full Speed USB v1.0
uhci4:  port 0xd400-0xd41f irq 19 at device 29.1 numa-domain 0 on pci0
uhci4: LegSup = 0x2f00
usbus5 numa-domain 0 on uhci4
usbus5: 12Mbps Full Speed USB v1.0
uhci5:  port 0xd080-0xd09f irq 18 at device 29.2 numa-domain 0 on pci0
uhci5: LegSup = 0x2f00
usbus6 numa-domain 0 on uhci5
usbus6: 12Mbps Full Speed USB v1.0
ehci1:  mem 0xfbed8000-0xfbed83ff irq 23 at device 29.7 numa-domain 0 on pci0
usbus7: EHCI version 1.0
usbus7 numa-domain 0 on ehci1
usbus7: 480Mbps High Speed USB v2.0
pcib6:  at device 30.0 numa-domain 0 on pci0
pci6:  numa-domain 0 on pcib6
vgapci0:  mem 0xf9000000-0xf9ffffff,0xfaffc000-0xfaffffff,0xfb000000-0xfb7fffff irq 18 at device 1.0 numa-domain 0 on pci6
vgapci0: Boot video device
isab0:  at device 31.0 numa-domain 0 on pci0
isa0:  numa-domain 0 on isab0
ahci0:  port 0xc480-0xc487,0xd000-0xd003,0xcc00-0xcc07,0xc880-0xc883,0xc800-0xc81f mem 0xfbed6000-0xfbed67ff irq 19 at device 31.2 numa-domain 0 on pci0
ahci0: AHCI v1.20 with 6 3Gbps ports, Port Multiplier not supported
ahcich0:  at channel 0 on ahci0
ahcich1:  at channel 1 on ahci0
ahcich2:  at channel 2 on ahci0
ahcich3:  at channel 3 on ahci0
ahcich4:  at channel 4 on ahci0
ahcich5:  at channel 5 on ahci0
ahciem0:  on ahci0
acpi_button0:  on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0:  at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0
atkbdc0:  at port 0x60,0x64 on isa0
atkbd0:  irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ppc0: cannot reserve I/O port range
coretemp0:  on cpu0
est0:  on cpu0
coretemp1:  on cpu1
est1:  on cpu1
coretemp2:  on cpu2
est2:  on cpu2
coretemp3:  on cpu3
est3:  on cpu3
coretemp4:  on cpu4
est4:  on cpu4
coretemp5:  on cpu5
est5:  on cpu5
coretemp6:  on cpu6
est6:  on cpu6
coretemp7:  on cpu7
est7:  on cpu7
coretemp8:  on cpu8
est8:  on cpu8
coretemp9:  on cpu9
est9:  on cpu9
coretemp10:  on cpu10
est10:  on cpu10
coretemp11:  on cpu11
est11:  on cpu11
coretemp12:  on cpu12
est12:  on cpu12
coretemp13:  on cpu13
est13:  on cpu13
coretemp14:  on cpu14
est14:  on cpu14
coretemp15:  on cpu15
est15:  on cpu15
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
ugen7.1:  at usbus7
ugen0.1:  at usbus0
ugen2.1:  at usbus2
ugen5.1:  at usbus5
ugen4.1:  at usbus4
ugen3.1:  at usbus3
ugen6.1:  at usbus6
ugen1.1:  at usbus1
uhub0:  on usbus7
uhub1:  on usbus5
uhub2:  on usbus1
uhub3:  on usbus0
uhub4:  on usbus3
uhub5:  on usbus6
uhub6:  on usbus4
uhub7:  on usbus2
ses0 at ahciem0 bus 0 scbus6 target 0 lun 0
ses0:  SEMB S-E-S 2.00 device
cd0 at ahcich4 bus 0 scbus4 target 0 lun 0
ses0: SEMB SES Device
cd0:  Removable CD-ROM SCSI device
cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes)
cd0: 656MB (336256 2048 byte sectors)
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0:  ATA8-ACS SATA 3.x device
ada0: Serial Number 44E1K00HFK7A
ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 4769307MB (1220942646 4096 byte sectors)
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1:  ATA8-ACS SATA 3.x device
ada1: Serial Number 44E1K00IFK7A
ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 4769307MB (1220942646 4096 byte sectors)
ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
ada2:  ATA8-ACS SATA 3.x device
ada2: Serial Number LNEL132300KL120CGN
ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 114473MB (234441648 512 byte sectors)
ada2: quirks=0x1<4K>
ada3 at ahcich3 bus 0 scbus3 target 0 lun 0
ada3:  ATA8-ACS SATA 3.x device
ada3: Serial Number LNEL126400MA120CGN
ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 114473MB (234441648 512 byte sectors)
ada3: quirks=0x1<4K>
Trying to mount root from zfs:zroot/ROOT/default []...
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
uhub5: 2 ports with 2 removable, self powered
uhub6: 2 ports with 2 removable, self powered
uhub7: 2 ports with 2 removable, self powered
uhub0: 6 ports with 6 removable, self powered
uhub4: 6 ports with 6 removable, self powered
ugen1.2:  at usbus1
ukbd0 numa-domain 0 on uhub2
ukbd0:  on usbus1
kbd2 at ukbd0
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7e 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
(cd0:ahcich4:0:0:0): READ(10). CDB: 28 00 00 05 21 7f 00 00 01 00 
(cd0:ahcich4:0:0:0): CAM status: SCSI Status Error
(cd0:ahcich4:0:0:0): SCSI status: Check Condition
(cd0:ahcich4:0:0:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error)
(cd0:ahcich4:0:0:0): Error 5, Unretryable error
(cd0:ahcich4:0:0:0): cddone: got error 0x5 back
random: unblocking device.
igb0: link state changed to UP
ums0 numa-domain 0 on uhub2
ums0:  on usbus1
pflog0: promiscuous mode enabled
[dan@x8dtu:~] $ 
[dan@x8dtu:~] $ zfs list
NAME                                                        USED  AVAIL  REFER  MOUNTPOINT
main_tank                                                   870G  3.54T    96K  /main_tank
main_tank/data                                              783G  3.54T    88K  /main_tank/data
main_tank/data/dvl                                          755G  3.54T   755G  /main_tank/data/dvl
main_tank/data/freshports                                  28.5G  3.54T    88K  /main_tank/data/freshports
main_tank/data/freshports/backend                          2.28G  3.54T    88K  /main_tank/data/freshports/backend
main_tank/data/freshports/backend/cache                     288K  3.54T    96K  /iocage/jails/x8dtu-ingress01/root/var/db/freshports/cache
main_tank/data/freshports/backend/cache/html                104K  3.54T   104K  /iocage/jails/x8dtu-ingress01/root/var/db/freshports/cache/html
main_tank/data/freshports/backend/cache/spooling             88K  3.54T    88K  /iocage/jails/x8dtu-ingress01/root/var/db/freshports/cache/spooling
main_tank/data/freshports/backend/queues                   2.28G  3.54T    88K  none
main_tank/data/freshports/backend/queues/archive           2.28G  3.54T  2.28G  /iocage/jails/x8dtu-ingress01/root/var/db/freshports/message-queues/archive
main_tank/data/freshports/backend/queues/incoming            88K  3.54T    88K  /iocage/jails/x8dtu-ingress01/root/var/db/ingress/message-queues/incoming
main_tank/data/freshports/backend/queues/recent            3.46M  3.54T  3.46M  /iocage/jails/x8dtu-ingress01/root/var/db/freshports/message-queues/recent
main_tank/data/freshports/backend/queues/retry              188K  3.54T   188K  /iocage/jails/x8dtu-ingress01/root/var/db/freshports/message-queues/retry
main_tank/data/freshports/ports-jail                       24.2G  3.54T   172K  /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail
main_tank/data/freshports/ports-jail/var                   24.2G  3.54T    88K  /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var
main_tank/data/freshports/ports-jail/var/db                24.2G  3.54T    88K  /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var/db
main_tank/data/freshports/ports-jail/var/db/repos          24.2G  3.54T  24.2G  /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var/db/repos
main_tank/data/freshports/website                          2.01G  3.54T    88K  none
main_tank/data/freshports/website/cache                    2.01G  3.54T   103M  /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache
main_tank/data/freshports/website/cache/daily              12.4M  3.54T  12.4M  /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/daily
main_tank/data/freshports/website/cache/news                112K  3.54T   112K  /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/news
main_tank/data/freshports/website/cache/pages                88K  3.54T    88K  /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/pages
main_tank/data/freshports/website/cache/ports              1.89G  3.54T  1.89G  /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/ports
main_tank/data/freshports/website/cache/spooling            120K  3.54T   120K  /iocage/jails/x8dtu-nginx01/root/var/db/freshports/cache/spooling
main_tank/home                                             10.5G  3.54T  10.5G  /usr/home
main_tank/iocage                                           75.9G  3.54T   116K  /iocage
main_tank/iocage/download                                   503M  3.54T    96K  /iocage/download
main_tank/iocage/download/11.0-RELEASE                      112M  3.54T   112M  /iocage/download/11.0-RELEASE
main_tank/iocage/download/11.1-RELEASE                      119M  3.54T   119M  /iocage/download/11.1-RELEASE
main_tank/iocage/download/11.2-RELEASE                      272M  3.54T   272M  /iocage/download/11.2-RELEASE
main_tank/iocage/images                                      96K  3.54T    96K  /iocage/images
main_tank/iocage/jails                                     73.8G  3.54T   104K  /iocage/jails
main_tank/iocage/jails/mailjail                             322M  3.54T    92K  /iocage/jails/mailjail
main_tank/iocage/jails/mailjail/root                        322M  3.54T  1.26G  /iocage/jails/mailjail/root
main_tank/iocage/jails/mx-ingress01                        1.52G  3.54T    92K  /iocage/jails/mx-ingress01
main_tank/iocage/jails/mx-ingress01/root                   1.52G  3.54T  1.28G  /iocage/jails/mx-ingress01/root
main_tank/iocage/jails/x8dtu-ingress01                     2.84G  3.54T   108K  /iocage/jails/x8dtu-ingress01
main_tank/iocage/jails/x8dtu-ingress01/root                2.84G  3.54T  1.72G  /iocage/jails/x8dtu-ingress01/root
main_tank/iocage/jails/x8dtu-nginx01                       3.55G  3.54T   108K  /iocage/jails/x8dtu-nginx01
main_tank/iocage/jails/x8dtu-nginx01/root                  3.55G  3.54T  1.98G  /iocage/jails/x8dtu-nginx01/root
main_tank/iocage/jails/x8dtu-pg01                          35.5G  3.54T    92K  /iocage/jails/x8dtu-pg01
main_tank/iocage/jails/x8dtu-pg01/root                     35.5G  3.54T  28.3G  /iocage/jails/x8dtu-pg01/root
main_tank/iocage/jails/x8dtu-pg02.vpn.unixathome.org       30.1G  3.54T    92K  /iocage/jails/x8dtu-pg02.vpn.unixathome.org
main_tank/iocage/jails/x8dtu-pg02.vpn.unixathome.org/root  30.1G  3.54T  31.0G  /iocage/jails/x8dtu-pg02.vpn.unixathome.org/root
main_tank/iocage/log                                        332K  3.54T   156K  /iocage/log
main_tank/iocage/releases                                  1.59G  3.54T    96K  /iocage/releases
main_tank/iocage/releases/11.0-RELEASE                      355M  3.54T    96K  /iocage/releases/11.0-RELEASE
main_tank/iocage/releases/11.0-RELEASE/root                 355M  3.54T   355M  /iocage/releases/11.0-RELEASE/root
main_tank/iocage/releases/11.1-RELEASE                      305M  3.54T    88K  /iocage/releases/11.1-RELEASE
main_tank/iocage/releases/11.1-RELEASE/root                 305M  3.54T   302M  /iocage/releases/11.1-RELEASE/root
main_tank/iocage/releases/11.2-RELEASE                      971M  3.54T    88K  /iocage/releases/11.2-RELEASE
main_tank/iocage/releases/11.2-RELEASE/root                 971M  3.54T   971M  /iocage/releases/11.2-RELEASE/root
main_tank/iocage/templates                                   96K  3.54T    96K  /iocage/templates
main_tank/snapshots-for-backup                               88K  3.54T    88K  /main_tank/snapshots-for-backup
zroot                                                      29.0G  76.6G    96K  /zroot
zroot/ROOT                                                 3.84G  76.6G    96K  none
zroot/ROOT/11.1-RELEASE                                       8K  76.6G  2.29G  /
zroot/ROOT/default                                         3.84G  76.6G  2.70G  /
zroot/TESTING                                               616K  76.6G    88K  /zroot/TESTING
zroot/TESTING/top                                           528K  76.6G    88K  /zroot/TESTING/top
zroot/TESTING/top/test1                                      88K  76.6G    88K  /zroot/TESTING/top/test1
zroot/TESTING/top/test2                                      88K  76.6G    88K  /zroot/TESTING/top/test2
zroot/TESTING/top/test3                                      88K  76.6G    88K  /zroot/TESTING/top/test3
zroot/TESTING/top/test4                                      88K  76.6G    88K  /zroot/TESTING/top/test4
zroot/TESTING/top/test5                                      88K  76.6G    88K  /zroot/TESTING/top/test5
zroot/data                                                 24.8G  76.6G    88K  /zroot/data
zroot/data/dan-pg                                            88K  76.6G    88K  /usr/home/dan/pg
zroot/data/freshports                                      3.01G  76.6G    88K  none
zroot/data/freshports/repo                                 3.01G  76.6G    88K  none
zroot/data/freshports/repo/PORTS-head                      3.01G  76.6G  3.01G  /iocage/jails/x8dtu-ingress01/root/var/db/freshports/ports-jail/var/db/repos/PORTS-head
zroot/data/ingress01-testing                                675M  76.6G   675M  /iocage/jails/x8dtu-ingress01/root/usr/home/dan/tmp-fast
zroot/data/pg01-pg96                                       21.2G  76.6G  21.2G  /iocage/jails/x8dtu-pg01/root/var/db/postgres/data96
zroot/tmp                                                   208K  76.6G   112K  /tmp
zroot/usr                                                   192K  76.6G    96K  /usr
zroot/usr/src                                                96K  76.6G    96K  /usr/src
zroot/var                                                   165M  76.6G    96K  /var
zroot/var/audit                                              96K  76.6G    96K  /var/audit
zroot/var/crash                                              96K  76.6G    96K  /var/crash
zroot/var/log                                               164M  76.6G   163M  /var/log
zroot/var/mail                                              184K  76.6G   120K  /var/mail
zroot/var/tmp                                               932K  76.6G   724K  /var/tmp
[dan@x8dtu:~] $ 
 
Website Pin Facebook Twitter Myspace Friendfeed Technorati del.icio.us Digg Google StumbleUpon Premium Responsive