Nov 132019
 

For reference, the previous post on this server is still available.

This server was upgraded on Feb 2 2019. Only the storage persisted. Everything else was upgraded.

The hardware

  • M/B – Supermicro X9DRE-TF+
  • RAM – 128GB composed of 8x 16GB DDR3 1600Mhz 21300 ECC/REG
  • CPU – 2x E5-2620v2 – Intel Six Core 2.10Ghz Xeon 15MB cache 7.2 GT/s QPI (80W)
  • chassis – SC846E16-R1200B
  • SAS9300-8i card connects the backplane of the chassis with the M/B
  • HDD – 6x Toshiba 5TB drives (see below for details)
  • SDD – 2x Samsung SSD 860 EVO 250GB RVT02B6Q (for the operating system) and 2x SanDisk SDSSDRC032G 3.0.0 (for ZFS SLOG)
  • NVMe – 2x MyDigitalSSD BPX Pro 80mm 240GB

gpart

You might ask: why do da1..da6 have 4GB free at the start? This system once booted from the system zpool. Now it boots from the zroot pool. That 4GB was previously used by the boot and swap partitions, since removed.

[dan@slocum:~] $ gpart show
=>       40  468862048  nvd0  GPT  (224G)
         40  468862048     1  freebsd-zfs  (224G)

=>       40  468862048  nvd1  GPT  (224G)
         40  468862048     1  freebsd-zfs  (224G)

=>       40  488397088  ada0  GPT  (233G)
         40       1024     1  freebsd-boot  (512K)
       1064   41943040     2  freebsd-swap  (20G)
   41944104  446453024     3  freebsd-zfs  (213G)

=>       40  488397088  ada1  GPT  (233G)
         40       1024     1  freebsd-boot  (512K)
       1064   41943040     2  freebsd-swap  (20G)
   41944104  446453024     3  freebsd-zfs  (213G)

=>      34  62533229  diskid/DISK-133887400683  GPT  (30G)
        34         6                            - free -  (3.0K)
        40  16777216                         1  freebsd-zfs  (8.0G)
  16777256      2008                            - free -  (1.0M)
  16779264  20971520                         2  freebsd-zfs  (10G)
  37750784  20971520                         3  freebsd-zfs  (10G)
  58722304   3810959                            - free -  (1.8G)

=>      34  62533229  diskid/DISK-134106400102  GPT  (30G)
        34         6                            - free -  (3.0K)
        40  16777216                         1  freebsd-zfs  (8.0G)
  16777256      2008                            - free -  (1.0M)
  16779264  20971520                         2  freebsd-zfs  (10G)
  37750784  20971520                         3  freebsd-zfs  (10G)
  58722304   3810959                            - free -  (1.8G)

=>        40  9767541088  da1  GPT  (4.5T)
          40     8392664       - free -  (4.0G)
     8392704  9758048256    3  freebsd-zfs  (4.5T)
  9766440960     1100168       - free -  (537M)

=>        40  9767541088  da2  GPT  (4.5T)
          40     8392664       - free -  (4.0G)
     8392704  9758048256    3  freebsd-zfs  (4.5T)
  9766440960     1100168       - free -  (537M)

=>        40  9767541088  da3  GPT  (4.5T)
          40     8392664       - free -  (4.0G)
     8392704  9758048256    3  freebsd-zfs  (4.5T)
  9766440960     1100168       - free -  (537M)

=>        40  9767541088  da4  GPT  (4.5T)
          40     8392664       - free -  (4.0G)
     8392704  9758048256    3  freebsd-zfs  (4.5T)
  9766440960     1100168       - free -  (537M)

=>        34  9767541101  da5  GPT  (4.5T)
          34     8390622       - free -  (4.0G)
     8390656  9758048256    3  freebsd-zfs  (4.5T)
  9766438912     1102223       - free -  (538M)

=>        40  9767541088  da6  GPT  (4.5T)
          40     8392664       - free -  (4.0G)
     8392704  9758048256    3  freebsd-zfs  (4.5T)
  9766440960     1100168       - free -  (537M)

=>        40  9767541088  da8  GPT  (4.5T)
          40     8392664       - free -  (4.0G)
     8392704  9758048256    3  freebsd-zfs  (4.5T)
  9766440960     1100168       - free -  (537M)

=>        34  9767541101  da9  GPT  (4.5T)
          34           6       - free -  (3.0K)
          40  9766000000    1  freebsd-zfs  (4.5T)
  9766000040     1541095       - free -  (752M)

=>       40  976773088  diskid/DISK-S2RANX0J441094Z%20%20%20%20%20  GPT  (466G)
         40       2008                                              - free -  (1.0M)
       2048  838860800                                           1  freebsd-boot  (400G)
  838862848  137910280                                              - free -  (66G)

=>       40  976773088  diskid/DISK-S2RANX0J433600X%20%20%20%20%20  GPT  (466G)
         40       2008                                              - free -  (1.0M)
       2048  838860800                                           1  freebsd-boot  (400G)
  838862848  137910280                                              - free -  (66G)

=>        40  9767541088  diskid/DISK-653EK93XFS9A  GPT  (4.5T)
          40     8392664                            - free -  (4.0G)
     8392704  9758048256                         3  freebsd-zfs  (4.5T)
  9766440960     1100168                            - free -  (537M)

=>        34  9767541101  diskid/DISK-653DK7WAFS9A  GPT  (4.5T)
          34           6                            - free -  (3.0K)
          40  9766000000                         1  freebsd-zfs  (4.5T)
  9766000040     1541095                            - free -  (752M)

[dan@slocum:~] $ 

zpool list

[dan@slocum:~] $ zpool list
NAME            SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT
dev-ingress01  9.94G  12.1M  9.93G        -         -    52%     0%  1.00x  ONLINE  -
jester         9.94G  9.28M  9.93G        -         -    27%     0%  1.00x  ONLINE  -
nvd             222G  93.6G   128G        -         -    45%    42%  1.00x  ONLINE  -
system         27.2T  2.57T  24.7T        -         -    24%     9%  1.00x  ONLINE  -
tank_fast       398G  48.3G   350G        -         -    48%    12%  1.00x  ONLINE  -
zroot           212G  47.6G   164G        -         -     5%    22%  1.00x  ONLINE  -
[dan@slocum:~] $ 

zpool status

[dan@slocum:~] $ zpool list
NAME            SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT
dev-ingress01  9.94G  12.1M  9.93G        -         -    52%     0%  1.00x  ONLINE  -
jester         9.94G  9.28M  9.93G        -         -    27%     0%  1.00x  ONLINE  -
nvd             222G  93.6G   128G        -         -    45%    42%  1.00x  ONLINE  -
system         27.2T  2.57T  24.7T        -         -    24%     9%  1.00x  ONLINE  -
tank_fast       398G  48.3G   350G        -         -    48%    12%  1.00x  ONLINE  -
zroot           212G  47.6G   164G        -         -     5%    22%  1.00x  ONLINE  -
[dan@slocum:~] $ zpool status
  pool: dev-ingress01
 state: ONLINE
  scan: scrub repaired 0 in 0 days 00:00:02 with 0 errors on Sun Nov 10 04:28:17 2019
config:

	NAME                            STATE     READ WRITE CKSUM
	dev-ingress01                   ONLINE       0     0     0
	  mirror-0                      ONLINE       0     0     0
	    diskid/DISK-134106400102p3  ONLINE       0     0     0
	    diskid/DISK-133887400683p3  ONLINE       0     0     0

errors: No known data errors

  pool: jester
 state: ONLINE
  scan: scrub repaired 0 in 0 days 00:00:01 with 0 errors on Sun Nov 10 04:28:17 2019
config:

	NAME                            STATE     READ WRITE CKSUM
	jester                          ONLINE       0     0     0
	  mirror-0                      ONLINE       0     0     0
	    diskid/DISK-134106400102p2  ONLINE       0     0     0
	    diskid/DISK-133887400683p2  ONLINE       0     0     0

errors: No known data errors

  pool: nvd
 state: ONLINE
  scan: scrub repaired 0 in 0 days 00:08:32 with 0 errors on Tue Nov 12 04:26:54 2019
config:

	NAME        STATE     READ WRITE CKSUM
	nvd         ONLINE       0     0     0
	  mirror-0  ONLINE       0     0     0
	    nvd0p1  ONLINE       0     0     0
	    nvd1p1  ONLINE       0     0     0

errors: No known data errors

  pool: system
 state: ONLINE
  scan: scrub repaired 0 in 0 days 05:16:35 with 0 errors on Tue Nov 12 09:35:45 2019
config:

	NAME                  STATE     READ WRITE CKSUM
	system                ONLINE       0     0     0
	  raidz2-0            ONLINE       0     0     0
	    da3p3             ONLINE       0     0     0
	    da1p3             ONLINE       0     0     0
	    da6p3             ONLINE       0     0     0
	    gpt/57NGK1Z9F57D  ONLINE       0     0     0
	    da2p3             ONLINE       0     0     0
	    da5p3             ONLINE       0     0     0

errors: No known data errors

  pool: tank_fast
 state: ONLINE
  scan: scrub repaired 0 in 0 days 00:04:26 with 0 errors on Sun Nov 10 04:33:26 2019
config:

	NAME                                              STATE     READ WRITE CKSUM
	tank_fast                                         ONLINE       0     0     0
	  mirror-0                                        ONLINE       0     0     0
	    diskid/DISK-S2RANX0J441094Z%20%20%20%20%20p1  ONLINE       0     0     0
	    diskid/DISK-S2RANX0J433600X%20%20%20%20%20p1  ONLINE       0     0     0

errors: No known data errors

  pool: zroot
 state: ONLINE
  scan: scrub repaired 0 in 0 days 00:02:12 with 0 errors on Mon Nov 11 03:55:42 2019
config:

	NAME                     STATE     READ WRITE CKSUM
	zroot                    ONLINE       0     0     0
	  mirror-0               ONLINE       0     0     0
	    gpt/S3YHNX0KB03468A  ONLINE       0     0     0
	    gpt/S3YHNX0KB03577K  ONLINE       0     0     0

errors: No known data errors
[dan@slocum:~] $ 

zfs list

The filesystems, well, some of them:

[dan@slocum:~] $ zfs list
NAME                                                                USED  AVAIL  REFER  MOUNTPOINT
dev-ingress01                                                      10.5M  9.62G    23K  /dev-ingress01
jester                                                             7.95M  9.62G    23K  /jester
nvd                                                                93.7G   121G    23K  /nvd
nvd/freshports                                                     93.6G   121G    23K  /nvd/freshports
nvd/freshports/dev                                                 33.5G   121G    23K  /iocage/jails/dev-ingress01/root/var/db/freshports
nvd/freshports/dev/cache                                           3.19M   121G    23K  /iocage/jails/dev-ingress01/root/var/db/freshports/cache
nvd/freshports/dev/cache/html                                      2.20M   121G   322K  /iocage/jails/dev-ingress01/root/var/db/freshports/cache/html
nvd/freshports/dev/cache/spooling                                   985K   121G    25K  /iocage/jails/dev-ingress01/root/var/db/freshports/cache/spooling
nvd/freshports/dev/ingress                                         1.85M   121G    23K  /iocage/jails/dev-ingress01/root/var/db/ingress
nvd/freshports/dev/ingress/message-queues                          1.83M   121G   158K  /iocage/jails/dev-ingress01/root/var/db/ingress/message-queues
nvd/freshports/dev/message-queues                                  13.7G   121G  13.7G  /iocage/jails/dev-ingress01/root/var/db/freshports/message-queues
nvd/freshports/dev/ports-jail                                      19.8G   121G    23K  /iocage/jails/dev-ingress01/root/var/db/freshports/ports-jail
nvd/freshports/dev/ports-jail/var                                  19.8G   121G    23K  /iocage/jails/dev-ingress01/root/var/db/freshports/ports-jail/var
nvd/freshports/dev/ports-jail/var/db                               19.8G   121G    23K  /iocage/jails/dev-ingress01/root/var/db/freshports/ports-jail/var/db
nvd/freshports/dev/ports-jail/var/db/repos                         19.8G   121G  13.3G  /iocage/jails/dev-ingress01/root/var/db/freshports/ports-jail/var/db/repos
nvd/freshports/stage                                               28.3G   121G    23K  /iocage/jails/stage-ingress01/root/var/db/freshports
nvd/freshports/stage/cache                                         3.12M   121G    23K  /iocage/jails/stage-ingress01/root/var/db/freshports/cache
nvd/freshports/stage/cache/html                                    2.25M   121G   318K  /iocage/jails/stage-ingress01/root/var/db/freshports/cache/html
nvd/freshports/stage/cache/spooling                                 864K   121G    24K  /iocage/jails/stage-ingress01/root/var/db/freshports/cache/spooling
nvd/freshports/stage/ingress                                       1.61M   121G    23K  /iocage/jails/stage-ingress01/root/var/db/ingress
nvd/freshports/stage/ingress/message-queues                        1.59M   121G  33.5K  /iocage/jails/stage-ingress01/root/var/db/ingress/message-queues
nvd/freshports/stage/message-queues                                9.92G   121G  9.91G  /iocage/jails/stage-ingress01/root/var/db/freshports/message-queues
nvd/freshports/stage/ports-jail                                    18.3G   121G    23K  /iocage/jails/stage-ingress01/root/var/db/freshports/ports-jail
nvd/freshports/stage/ports-jail/var                                18.3G   121G    23K  /iocage/jails/stage-ingress01/root/var/db/freshports/ports-jail/var
nvd/freshports/stage/ports-jail/var/db                             18.3G   121G    23K  /iocage/jails/stage-ingress01/root/var/db/freshports/ports-jail/var/db
nvd/freshports/stage/ports-jail/var/db/repos                       18.3G   121G  12.4G  /iocage/jails/stage-ingress01/root/var/db/freshports/ports-jail/var/db/repos
nvd/freshports/test                                                31.9G   121G    23K  /iocage/jails/test-ingress01/root/var/db/freshports
nvd/freshports/test/cache                                          2.69M   121G    23K  /iocage/jails/test-ingress01/root/var/db/freshports/cache
nvd/freshports/test/cache/html                                     1.71M   121G   326K  /iocage/jails/test-ingress01/root/var/db/freshports/cache/html
nvd/freshports/test/cache/spooling                                  980K   121G    25K  /iocage/jails/test-ingress01/root/var/db/freshports/cache/spooling
nvd/freshports/test/ingress                                        1.66M   121G    23K  /iocage/jails/test-ingress01/root/var/db/ingress
nvd/freshports/test/ingress/message-queues                         1.64M   121G  33.5K  /iocage/jails/test-ingress01/root/var/db/ingress/message-queues
nvd/freshports/test/message-queues                                 13.5G   121G  13.5G  /iocage/jails/test-ingress01/root/var/db/freshports/message-queues
nvd/freshports/test/ports-jail                                     18.4G   121G    23K  /iocage/jails/test-ingress01/root/var/db/freshports/ports-jail
nvd/freshports/test/ports-jail/var                                 18.4G   121G    23K  /iocage/jails/test-ingress01/root/var/db/freshports/ports-jail/var
nvd/freshports/test/ports-jail/var/db                              18.4G   121G    23K  /iocage/jails/test-ingress01/root/var/db/freshports/ports-jail/var/db
nvd/freshports/test/ports-jail/var/db/repos                        18.4G   121G  12.4G  /iocage/jails/test-ingress01/root/var/db/freshports/ports-jail/var/db/repos
system                                                             1.71T  15.9T   288K  /
system/backups                                                      607K  15.9T   304K  /backups
system/backups/knew                                                 288K  15.9T   288K  /backups/knew
system/bacula                                                      1.03M  15.9T   176K  /iocage/jails/bacula-sd-03/root/usr/local/bacula
system/bacula/volumes                                               703K  15.9T   176K  /iocage/jails/bacula-sd-03/root/usr/local/bacula/volumes
system/bacula/volumes/DiffFile-03                                   176K  15.9T   176K  /iocage/jails/bacula-sd-03/root/usr/local/bacula/volumes/DiffFile-03
system/bacula/volumes/FullFile-03                                   176K  15.9T   176K  /iocage/jails/bacula-sd-03/root/usr/local/bacula/volumes/FullFile-03
system/bacula/volumes/IncrFile-03                                   176K  15.9T   176K  /iocage/jails/bacula-sd-03/root/usr/local/bacula/volumes/IncrFile-03
system/bacula/working                                               176K  15.9T   176K  /iocage/jails/bacula-sd-03/root/usr/local/bacula/working
system/data                                                        1.05T  15.9T   895K  /data
system/data/certs-renewals                                         26.1M  15.9T   192K  none
system/data/certs-renewals/certs                                   17.5M  15.9T  9.69M  /iocage/jails/certs/root/var/db/acme/certs
system/data/certs-renewals/certs-for-rsync                         8.37M  15.9T  4.39M  /iocage/jails/certs/root/var/db/certs-for-rsync
system/data/copies                                                  352K  15.9T   176K  none
system/data/copies/dan                                              176K  15.9T   176K  none
system/data/homes                                                   662G  15.9T   288K  /usr/home
system/data/homes/dan                                               662G  15.9T  28.0G  /usr/home/dan
system/data/homes/dan/mailjail                                     5.49G  15.9T   304K  /usr/home/dan/mailjail
system/data/homes/dan/mailjail/DansMaildir                         5.49G  15.9T  5.49G  /usr/home/dan/mailjail/DansMaildir
system/data/mysql-slocum                                           4.83G  15.9T   192K  none
system/data/mysql-slocum/mysql                                     4.82G  15.9T  1.06G  /var/db/mysql
system/data/mysql-slocum/mysql_secure                               336K  15.9T   192K  /var/db/mysql_secure
system/data/mysql-slocum/mysql_tmpdir                               591K  15.9T   192K  /var/db/mysql_tmpdir
system/data/root                                                   28.6M  15.9T  28.3M  /root
system/data/syncthing                                              59.2G  15.9T  7.56G  /iocage/jails/fileserver/root/usr/local/syncthing
system/data/video                                                   346G  15.9T   346G  /data/video
system/iocage                                                       670G  15.9T   208K  /iocage
system/iocage/download                                              359M  15.9T   176K  /iocage/download
system/iocage/download/12.0-RELEASE                                 358M  15.9T   358M  /iocage/download/12.0-RELEASE
system/iocage/images                                                176K  15.9T   176K  /iocage/images
system/iocage/jails                                                 666G  15.9T   208K  /iocage/jails
system/iocage/jails/bacula                                         18.2G  15.9T   192K  /iocage/jails/bacula
system/iocage/jails/bacula-sd-03                                   2.28G  15.9T   184K  /iocage/jails/bacula-sd-03
system/iocage/jails/bacula-sd-03/root                              2.28G  15.9T  2.25G  /iocage/jails/bacula-sd-03/root
system/iocage/jails/bacula/root                                    18.2G  15.9T  17.3G  /iocage/jails/bacula/root
system/iocage/jails/besser                                         70.8G  15.9T   192K  /iocage/jails/besser
system/iocage/jails/besser/root                                    70.8G  15.9T  18.3G  /iocage/jails/besser/root
system/iocage/jails/certs                                          3.75G  15.9T   192K  /iocage/jails/certs
system/iocage/jails/certs-rsync                                    3.27G  15.9T   192K  /iocage/jails/certs-rsync
system/iocage/jails/certs-rsync/root                               3.27G  15.9T  1.70G  /iocage/jails/certs-rsync/root
system/iocage/jails/certs/root                                     3.75G  15.9T  2.01G  /iocage/jails/certs/root
system/iocage/jails/cliff2                                         3.85G  15.9T   192K  /iocage/jails/cliff2
system/iocage/jails/cliff2/root                                    3.85G  15.9T  2.25G  /iocage/jails/cliff2/root
system/iocage/jails/dev-ingress01                                  6.60G  15.9T   200K  /iocage/jails/dev-ingress01
system/iocage/jails/dev-ingress01/root                             6.60G  15.9T  3.47G  /iocage/jails/dev-ingress01/root
system/iocage/jails/dev-nginx01                                    4.41G  15.9T   200K  /iocage/jails/dev-nginx01
system/iocage/jails/dev-nginx01/root                               4.41G  15.9T  2.56G  /iocage/jails/dev-nginx01/root
system/iocage/jails/dns-hidden-master                              4.12G  15.9T   192K  /iocage/jails/dns-hidden-master
system/iocage/jails/dns-hidden-master/root                         4.11G  15.9T  2.12G  /iocage/jails/dns-hidden-master/root
system/iocage/jails/fileserver                                      292G  15.9T   192K  /iocage/jails/fileserver
system/iocage/jails/fileserver/root                                 292G  15.9T   290G  /iocage/jails/fileserver/root
system/iocage/jails/git-dev                                        2.80G  15.9T   192K  /iocage/jails/git-dev
system/iocage/jails/git-dev/root                                   2.80G  15.9T  2.68G  /iocage/jails/git-dev/root
system/iocage/jails/local-freebsd-repo                             9.33G  15.9T   192K  /iocage/jails/local-freebsd-repo
system/iocage/jails/local-freebsd-repo/root                        9.33G  15.9T  7.75G  /iocage/jails/local-freebsd-repo/root
system/iocage/jails/mailjailcopy                                   4.48G  15.9T   192K  /iocage/jails/mailjailcopy
system/iocage/jails/mailjailcopy/root                              4.48G  15.9T  2.87G  /iocage/jails/mailjailcopy/root
system/iocage/jails/mydev                                          11.4G  15.9T   192K  /iocage/jails/mydev
system/iocage/jails/mydev/root                                     11.4G  15.9T  9.66G  /iocage/jails/mydev/root
system/iocage/jails/mysql01                                        5.46G  15.9T   192K  /iocage/jails/mysql01
system/iocage/jails/mysql01/root                                   5.46G  15.9T  2.51G  /iocage/jails/mysql01/root
system/iocage/jails/nsnotify                                       3.47G  15.9T   192K  /iocage/jails/nsnotify
system/iocage/jails/nsnotify/root                                  3.47G  15.9T  1.84G  /iocage/jails/nsnotify/root
system/iocage/jails/pg01                                            110G  15.9T   192K  /iocage/jails/pg01
system/iocage/jails/pg01/root                                       110G  15.9T  44.4G  /iocage/jails/pg01/root
system/iocage/jails/samdrucker                                     2.35G  15.9T   184K  /iocage/jails/samdrucker
system/iocage/jails/samdrucker/root                                2.35G  15.9T  2.31G  /iocage/jails/samdrucker/root
system/iocage/jails/sandbox                                        4.31G  15.9T   192K  /iocage/jails/sandbox
system/iocage/jails/sandbox/root                                   4.31G  15.9T  2.75G  /iocage/jails/sandbox/root
system/iocage/jails/serpico                                        5.13G  15.9T   192K  /iocage/jails/serpico
system/iocage/jails/serpico/root                                   5.13G  15.9T  3.04G  /iocage/jails/serpico/root
system/iocage/jails/stage-ingress01                                13.6G  15.9T   200K  /iocage/jails/stage-ingress01
system/iocage/jails/stage-ingress01/root                           13.6G  15.9T  11.2G  /iocage/jails/stage-ingress01/root
system/iocage/jails/stage-nginx01                                  4.08G  15.9T   200K  /iocage/jails/stage-nginx01
system/iocage/jails/stage-nginx01/root                             4.08G  15.9T  2.06G  /iocage/jails/stage-nginx01/root
system/iocage/jails/svn                                            12.7G  15.9T   192K  /iocage/jails/svn
system/iocage/jails/svn/root                                       12.7G  15.9T  10.9G  /iocage/jails/svn/root
system/iocage/jails/talos                                          3.44G  15.9T   192K  /iocage/jails/talos
system/iocage/jails/talos/root                                     3.44G  15.9T  2.02G  /iocage/jails/talos/root
system/iocage/jails/test-ingress01                                 4.65G  15.9T   200K  /iocage/jails/test-ingress01
system/iocage/jails/test-ingress01/root                            4.65G  15.9T  2.23G  /iocage/jails/test-ingress01/root
system/iocage/jails/test-nginx01                                   4.33G  15.9T   200K  /iocage/jails/test-nginx01
system/iocage/jails/test-nginx01/root                              4.33G  15.9T  2.54G  /iocage/jails/test-nginx01/root
system/iocage/jails/testing                                        6.42G  15.9T   192K  /iocage/jails/testing
system/iocage/jails/testing/root                                   6.42G  15.9T  4.83G  /iocage/jails/testing/root
system/iocage/jails/unifi01                                        25.3G  15.9T   192K  /iocage/jails/unifi01
system/iocage/jails/unifi01/root                                   25.3G  15.9T  18.0G  /iocage/jails/unifi01/root
system/iocage/jails/webserver                                      24.5G  15.9T   192K  /iocage/jails/webserver
system/iocage/jails/webserver/root                                 24.5G  15.9T  22.3G  /iocage/jails/webserver/root
system/iocage/log                                                   448K  15.9T   448K  /iocage/log
system/iocage/releases                                             3.31G  15.9T   176K  /iocage/releases
system/iocage/releases/11.2-RELEASE                                1.44G  15.9T   176K  /iocage/releases/11.2-RELEASE
system/iocage/releases/11.2-RELEASE/root                           1.44G  15.9T  1.44G  /iocage/releases/11.2-RELEASE/root
system/iocage/releases/12.0-RELEASE                                1.87G  15.9T   176K  /iocage/releases/12.0-RELEASE
system/iocage/releases/12.0-RELEASE/root                           1.87G  15.9T  1.87G  /iocage/releases/12.0-RELEASE/root
system/iocage/templates                                             176K  15.9T   176K  /iocage/templates
system/jails                                                        176K  15.9T   176K  /jails
tank_fast                                                          48.3G   337G  14.1G  /tank_fast
tank_fast/ROOT                                                      194M   337G    88K  none
tank_fast/ROOT/default                                              194M   337G   194M  none
tank_fast/dev-ingress01                                            10.4G   337G  10.4G  /usr/jails/dev-ingress01/var/db/freshports/ports-jail/var/db/repos
tank_fast/freshports                                               4.90G   337G    88K  none
tank_fast/freshports/dev-git                                       4.90G   337G    88K  /home/dan/freshports-git
tank_fast/freshports/dev-git/cache                                  264K   337G    88K  /home/dan/freshports-git/cache
tank_fast/freshports/dev-git/cache/html                              88K   337G    88K  /home/dan/freshports-git/cache/html
tank_fast/freshports/dev-git/cache/spooling                          88K   337G    88K  /home/dan/freshports-git/cache/spooling
tank_fast/freshports/dev-git/ingress                                176K   337G    88K  /home/dan/freshports-git/ingress
tank_fast/freshports/dev-git/ingress/message-queues                  88K   337G    88K  /home/dan/freshports-git/ingress/message-queues
tank_fast/freshports/dev-git/ports-jail                            2.46G   337G   160K  /iocage/jails/git-dev/root/var/db/freshports/ports-jail
tank_fast/freshports/dev-git/ports-jail/var                        2.46G   337G    88K  /iocage/jails/git-dev/root/var/db/freshports/ports-jail/var
tank_fast/freshports/dev-git/ports-jail/var/db                     2.46G   337G    88K  /iocage/jails/git-dev/root/var/db/freshports/ports-jail/var/db
tank_fast/freshports/dev-git/ports-jail/var/db/repos               2.46G   337G    88K  /iocage/jails/git-dev/root/var/db/freshports/ports-jail/var/db/repos
tank_fast/freshports/dev-git/ports-jail/var/db/repos/PORTS-2019Q3    88K   337G    88K  /iocage/jails/git-dev/root/var/db/freshports/ports-jail/var/db/repos/PORTS-2019Q3
tank_fast/freshports/dev-git/ports-jail/var/db/repos/PORTS-head    2.46G   337G  2.46G  /iocage/jails/git-dev/root/var/db/freshports/ports-jail/var/db/repos/PORTS-head
tank_fast/freshports/dev-git/src                                   2.43G   337G  2.43G  /home/dan/freshports-git/src
tank_fast/pg01-logs                                                 808K  1023M   808K  /usr/jails/pg01/var/log
tank_fast/pg01-postgres                                             176M   337G   176M  /usr/jails/pg01/var/db/postgres
tank_fast/stage-ingress01                                          9.08G   337G  9.08G  /usr/jails/stage-ingress01/var/db/freshports/ports-jail/var/db/repos
tank_fast/test-ingress01                                           9.06G   337G  9.06G  /usr/jails/test-ingress01/var/db/freshports/ports-jail/var/db/repos
tank_fast/top-level                                                 368K   337G    88K  /tank_fast/top-level
tank_fast/top-level/child1                                          192K   337G    96K  /tank_fast/top-level/child1
tank_fast/top-level/child1/desc1                                     96K   337G    96K  /tank_fast/top-level/child1/desc1
tank_fast/top-level/child2                                           88K   337G    88K  /tank_fast/top-level/child2
zroot                                                              47.5G   158G  4.88G  /zroot
zroot/bootenv                                                      42.6G   158G    34K  legacy
zroot/bootenv/default                                              42.6G   158G   444M  /
zroot/bootenv/default/tmp                                          11.1M   158G  1.01M  /tmp
zroot/bootenv/default/usr                                          6.24G   158G  1.62G  /usr
zroot/bootenv/default/usr/local                                    3.25G   158G  1.10G  /usr/local
zroot/bootenv/default/usr/obj                                        82K   158G    68K  /usr/obj
zroot/bootenv/default/usr/src                                       863M   158G    23K  /usr/src
zroot/bootenv/default/var                                          11.3G   158G  5.01G  /var
zroot/bootenv/default/var/audit                                      36K   158G    23K  /var/audit
zroot/bootenv/default/var/empty                                      23K   158G    23K  /var/empty
zroot/bootenv/default/var/log                                      1.32G   158G  1.17G  /var/log
zroot/bootenv/default/var/tmp                                      1.63M   158G  1.19M  /var/tmp
[dan@slocum:~] $ 

dmesg

And dmesg:

[dan@slocum:~] $ cat /var/run/dmesg.boot 
---<<BOOT>>---
Copyright (c) 1992-2018 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.0-RELEASE-p10 GENERIC amd64
FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1)
VT(vga): resolution 640x480
CPU: Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz (2100.04-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x306e4  Family=0x6  Model=0x3e  Stepping=4
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7fbee3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  Structured Extended Features=0x281<FSGSBASE,SMEP,ERMS>
  XSAVE Features=0x1<XSAVEOPT>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
  TSC: P-state invariant, performance statistics
real memory  = 137438953472 (131072 MB)
avail memory = 133814599680 (127615 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: < >
FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs
FreeBSD/SMP: 2 package(s) x 6 core(s) x 2 hardware threads
random: unblocking device.
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
Launching APs: 13 16 5 1 2 12 3 4 14 18 6 10 17 7 22 15 8 20 19 23 11 21 9
Timecounter "TSC" frequency 2100042484 Hz quality 1000
random: entropy device external interface
netmap: loaded module
[ath_hal] loaded
module_register_init: MOD_LOAD (vesa, 0xffffffff810f9a00, 0) error 19
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
kbd1 at kbdmux0
nexus0
vtvga0: <VT VGA driver> on motherboard
cryptosoft0: <software crypto> on motherboard
acpi0: <SUPERM SMCI--MB> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> numa-domain 0 on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 340
Event timer "HPET2" frequency 14318180 Hz quality 340
Event timer "HPET3" frequency 14318180 Hz quality 340
Event timer "HPET4" frequency 14318180 Hz quality 340
Event timer "HPET5" frequency 14318180 Hz quality 340
Event timer "HPET6" frequency 14318180 Hz quality 340
Event timer "HPET7" frequency 14318180 Hz quality 340
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0
pci0: <ACPI PCI bus> numa-domain 0 on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 27 at device 1.0 numa-domain 0 on pci0
pci1: <ACPI PCI bus> numa-domain 0 on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 33 at device 2.0 numa-domain 0 on pci0
pci2: <ACPI PCI bus> numa-domain 0 on pcib2
nvme0: <Generic NVMe Device> mem 0xdfe00000-0xdfe03fff irq 32 at device 0.0 numa-domain 0 on pci2
pcib3: <ACPI PCI-PCI bridge> irq 33 at device 2.2 numa-domain 0 on pci0
pci3: <ACPI PCI bus> numa-domain 0 on pcib3
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0x8020-0x803f mem 0xde200000-0xde3fffff,0xde404000-0xde407fff irq 34 at device 0.0 numa-domain 0 on pci3
ix0: using 2048 tx descriptors and 2048 rx descriptors
ix0: msix_init qsets capped at 16
ix0: pxm cpus: 6 queue msgs: 63 admincnt: 1
ix0: using 6 rx queues 6 tx queues 
ix0: Using MSIX interrupts with 7 vectors
ix0: allocated for 6 queues
ix0: allocated for 6 rx queues
ix0: Ethernet address: 00:25:90:fa:0f:10
ix0: PCI Express Bus: Speed 5.0GT/s Width x8
ix0: netmap queues/slots: TX 6/2048, RX 6/2048
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0x8000-0x801f mem 0xde000000-0xde1fffff,0xde400000-0xde403fff irq 37 at device 0.1 numa-domain 0 on pci3
ix1: using 2048 tx descriptors and 2048 rx descriptors
ix1: msix_init qsets capped at 16
ix1: pxm cpus: 6 queue msgs: 63 admincnt: 1
ix1: using 6 rx queues 6 tx queues 
ix1: Using MSIX interrupts with 7 vectors
ix1: allocated for 6 queues
ix1: allocated for 6 rx queues
ix1: Ethernet address: 00:25:90:fa:0f:11
ix1: PCI Express Bus: Speed 5.0GT/s Width x8
ix1: netmap queues/slots: TX 6/2048, RX 6/2048
pcib4: <ACPI PCI-PCI bridge> irq 41 at device 3.0 numa-domain 0 on pci0
pci4: <ACPI PCI bus> numa-domain 0 on pcib4
nvme1: <Generic NVMe Device> mem 0xdfd00000-0xdfd03fff irq 40 at device 0.0 numa-domain 0 on pci4
pcib5: <ACPI PCI-PCI bridge> irq 41 at device 3.2 numa-domain 0 on pci0
pci5: <ACPI PCI bus> numa-domain 0 on pcib5
pcib6: <ACPI PCI-PCI bridge> irq 16 at device 17.0 numa-domain 0 on pci0
pci6: <ACPI PCI bus> numa-domain 0 on pcib6
pci0: <simple comms> at device 22.0 (no driver attached)
pci0: <simple comms> at device 22.1 (no driver attached)
ehci0: <Intel Patsburg USB 2.0 controller> mem 0xdff23000-0xdff233ff irq 16 at device 26.0 numa-domain 0 on pci0
usbus0: EHCI version 1.0
usbus0 numa-domain 0 on ehci0
usbus0: 480Mbps High Speed USB v2.0
ehci1: <Intel Patsburg USB 2.0 controller> mem 0xdff22000-0xdff223ff irq 23 at device 29.0 numa-domain 0 on pci0
usbus1: EHCI version 1.0
usbus1 numa-domain 0 on ehci1
usbus1: 480Mbps High Speed USB v2.0
pcib7: <ACPI PCI-PCI bridge> at device 30.0 numa-domain 0 on pci0
pci7: <ACPI PCI bus> numa-domain 0 on pcib7
vgapci0: <VGA-compatible display> mem 0xdd000000-0xddffffff,0xdf800000-0xdf803fff,0xdf000000-0xdf7fffff irq 16 at device 1.0 numa-domain 0 on pci7
vgapci0: Boot video device
isab0: <PCI-ISA bridge> at device 31.0 numa-domain 0 on pci0
isa0: <ISA bus> numa-domain 0 on isab0
ahci0: <Intel Patsburg AHCI SATA controller> port 0x9050-0x9057,0x9040-0x9043,0x9030-0x9037,0x9020-0x9023,0x9000-0x901f mem 0xdff21000-0xdff217ff irq 18 at device 31.2 numa-domain 0 on pci0
ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
pcib8: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pci8: <ACPI PCI bus> numa-domain 0 on pcib8
pci8: <dasp, performance counters> at device 14.1 (no driver attached)
pci8: <dasp, performance counters> at device 19.1 (no driver attached)
pci8: <dasp, performance counters> at device 19.5 (no driver attached)
pcib9: <ACPI Host-PCI bridge> numa-domain 1 on acpi0
pci9: <ACPI PCI bus> numa-domain 1 on pcib9
pcib10: <ACPI PCI-PCI bridge> irq 51 at device 1.0 numa-domain 1 on pci9
pci10: <ACPI PCI bus> numa-domain 1 on pcib10
ix2: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0xf000-0xf01f mem 0xfbe40000-0xfbe5ffff,0xfbe00000-0xfbe3ffff,0xfbe60000-0xfbe63fff irq 50 at device 0.0 numa-domain 1 on pci10
ix2: using 2048 tx descriptors and 2048 rx descriptors
ix2: msix_init qsets capped at 16
ix2: pxm cpus: 6 queue msgs: 17 admincnt: 1
ix2: using 6 rx queues 6 tx queues 
ix2: Using MSIX interrupts with 7 vectors
ix2: allocated for 6 queues
ix2: allocated for 6 rx queues
ix2: Ethernet address: 00:1b:21:39:a9:c5
ix2: PCI Express Bus: Speed 2.5GT/s Width x8
ix2: netmap queues/slots: TX 6/2048, RX 6/2048
pcib11: <ACPI PCI-PCI bridge> irq 57 at device 2.0 numa-domain 1 on pci9
pci11: <ACPI PCI bus> numa-domain 1 on pcib11
pcib12: <ACPI PCI-PCI bridge> irq 65 at device 3.0 numa-domain 1 on pci9
pci12: <ACPI PCI bus> numa-domain 1 on pcib12
mpr0: <Avago Technologies (LSI) SAS3008> port 0xe000-0xe0ff mem 0xfbd00000-0xfbd0ffff irq 64 at device 0.0 numa-domain 1 on pci12
mpr0: Firmware: 05.00.00.00, Driver: 18.03.00.00-fbsd
mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray>
pcib13: <ACPI Host-PCI bridge> numa-domain 1 on acpi0
pci13: <ACPI PCI bus> numa-domain 1 on pcib13
pci13: <dasp, performance counters> at device 14.1 (no driver attached)
pci13: <dasp, performance counters> at device 19.1 (no driver attached)
pci13: <dasp, performance counters> at device 19.5 (no driver attached)
acpi_button0: <Power Button> on acpi0
acpi_syscontainer0: <System Container> on acpi0
acpi_syscontainer1: <System Container> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc87ff,0xc8800-0xc97ff pnpid ORM0000 on isa0
coretemp0: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu0
est0: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu0
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
ugen1.1: <Intel EHCI root HUB> at usbus1
ugen0.1: <Intel EHCI root HUB> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
nvd0: <BPXP> NVMe namespace
nvd0: 228936MB (468862128 512 byte sectors)
nvd1: <BPXP> NVMe namespace
nvd1: 228936MB (468862128 512 byte sectors)
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
mpr0: Error reading device 0xb SATA PASSTHRU; iocstatus= 0x47
ugen1.2: <vendor 0x8087 product 0x0024> at usbus1
uhub2 numa-domain 0 on uhub0
uhub2: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus1
ugen0.2: <vendor 0x8087 product 0x0024> at usbus0
uhub3 numa-domain 0 on uhub1
uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus0
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x000a> enclosureHandle<0x0002> slot 0
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x000b> enclosureHandle<0x0002> slot 1
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x000c> enclosureHandle<0x0002> slot 6
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x000d> enclosureHandle<0x0002> slot 7
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x000e> enclosureHandle<0x0002> slot 11
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x000f> enclosureHandle<0x0002> slot 12
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x0010> enclosureHandle<0x0002> slot 13
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x0011> enclosureHandle<0x0002> slot 18
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x0012> enclosureHandle<0x0002> slot 19
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x0013> enclosureHandle<0x0002> slot 21
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x0014> enclosureHandle<0x0002> slot 22
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <81<SataDev>,End Device> <6.0Gbps> handle<0x0015> enclosureHandle<0x0002> slot 23
mpr0: At enclosure level 0 and connector name (    )
mpr0: Found device <4451<SmpInit,SspInit,SspTarg,SepDev>,End Device> <6.0Gbps> handle<0x0016> enclosureHandle<0x0002> slot 24
mpr0: At enclosure level 0 and connector name (    )
uhub3: 6 ports with 6 removable, self powered
uhub2: 8 ports with 8 removable, self powered
ugen0.3: <Winbond Electronics Corp Hermon USB hidmouse Device> at usbus0
ukbd0 numa-domain 0 on uhub3
ukbd0: <Winbond Electronics Corp Hermon USB hidmouse Device, class 0/0, rev 1.10/0.01, addr 3> on usbus0
kbd2 at ukbd0
ugen1.3: <ATEN UC-10KM V1.3.124> at usbus1
ukbd1 numa-domain 0 on uhub2
ukbd1: <HID Keyboard> on usbus1
kbd3 at ukbd1
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <Samsung SSD 860 EVO 250GB RVT02B6Q> ACS-4 ATA SATA 3.x device
ada0: Serial Number S3YHNX0KB03468A
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada0: Command Queueing enabled
ada0: 238475MB (488397168 512 byte sectors)
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <Samsung SSD 860 EVO 250GB RVT02B6Q> ACS-4 ATA SATA 3.x device
ada1: Serial Number S3YHNX0KB03577K
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada1: Command Queueing enabled
ada1: 238475MB (488397168 512 byte sectors)
ada2 at ahcich4 bus 0 scbus4 target 0 lun 0
ada2: <SanDisk SDSSDRC032G 3.0.0> ACS-2 ATA SATA 3.x device
ada2: Serial Number 133887400683
ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 512bytes)
ada2: Command Queueing enabled
ada2: 30533MB (62533296 512 byte sectors)
GEOM_MIRRORada3 at ahcich5 bus 0 scbus5 target 0 lun 0
ada3: <SanDisk SDSSDRC032G 3.0.0> ACS-2 ATA SATA 3.x device
ada3: Serial Number 134106400102
ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 512bytes)
ada3: Command Queueing enabled
ada3: 30533MB (62533296 512 byte sectors)
: Device mirror/swap launched (2/2).
ses0 at ahciem0 bus 0 scbus6 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
da0 at mpr0 bus 0 scbus7 target 8 lun 0
da0: <ATA Samsung SSD 850 2B6Q> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number S2RANX0J441094Z     
da0: 600.000MB/s transfers
da0: Command Queueing enabled
da0: 476940MB (976773168 512 byte sectors)
da0: quirks=0x8<4K>
da7 at mpr0 bus 0 scbus7 target 26 lun 0
da7: <ATA Samsung SSD 850 2B6Q> Fixed Direct Access SPC-4 SCSI device
da7: Serial Number S2RANX0J433600X     
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 476940MB (976773168 512 byte sectors)
da7: quirks=0x8<4K>
da4 at mpr0 bus 0 scbus7 target 19 lun 0
da4: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da4: Serial Number 57NGK1Z9F57D
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 4769307MB (9767541168 512 byte sectors)
da10 at mpr0 bus 0 scbus7 target 30 lun 0
da10: <ATA TOSHIBA HDWE150 FP1R> Fixed Direct Access SPC-4 SCSI device
da10: Serial Number 989UK04ZFB9G
da10: 600.000MB/s transfers
da10: Command Queueing enabled
da10: 4769307MB (9767541168 512 byte sectors)
da6 at mpr0 bus 0 scbus7 target 21 lun 0
da6: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da6: Serial Number 652FK58FFS9A
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 4769307MB (9767541168 512 byte sectors)
da8 at mpr0 bus 0 scbus7 target 27 lun 0
da8: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da8: Serial Number 653EK93XFS9A
da8: 600.000MB/s transfers
da8: Command Queueing enabled
da8: 4769307MB (9767541168 512 byte sectors)
da9 at mpr0 bus 0 scbus7 target 29 lun 0
da9: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da9: Serial Number 653DK7WAFS9A
da9: 600.000MB/s transfers
da9: Command Queueing enabled
da9: 4769307MB (9767541168 512 byte sectors)
da11 at mpr0 bus 0 scbus7 target 31 lun 0
da11: <ATA TOSHIBA HDWE150 FP1R> Fixed Direct Access SPC-4 SCSI device
da11: Serial Number 988DK097FB9G
da11: 600.000MB/s transfers
da11: Command Queueing enabled
da11: 4769307MB (9767541168 512 byte sectors)
da5 at mpr0 bus 0 scbus7 target 20 lun 0
da5: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da5: Serial Number 653DK7WBFS9A
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 4769307MB (9767541168 512 byte sectors)
da3 at mpr0 bus 0 scbus7 target 15 lun 0
da3: <ATA TOSHIBA MD04ACA5 FP2A> Fixed Direct Access SPC-4 SCSI device
da3: Serial Number 653BK12IFS9A
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 4769307MB (9767541168 512 byte sectors)
da2 at mpr0 bus 0 scbus7 target 14 lun 0
da2: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da2: Serial Number 4725K6ECF57D
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 4769307MB (9767541168 512 byte sectors)
da1 at mpr0 bus 0 scbus7 target 9 lun 0
da1: <ATA TOSHIBA HDWE150 FP2A> Fixed Direct Access SPC-4 SCSI device
da1: Serial Number 4725K6DVF57D
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 4769307MB (9767541168 512 byte sectors)
ses1 at mpr0 bus 0 scbus7 target 32 lun 0
ses1: <LSI SAS2X36 0e12> Fixed Enclosure Services SPC-3 SCSI device
ses1: Serial Number 
ses1: 600.000MB/s transfers
ses1: Command Queueing enabled
ses1: SCSI-3 ENC Device
ses1: da0,pass5: Element descriptor: 'Slot 01'
ses1: da0,pass5: SAS Device Slot Element: 1 Phys at Slot 0
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a10c
ses1: da1,pass6: Element descriptor: 'Slot 02'
ses1: da1,pass6: SAS Device Slot Element: 1 Phys at Slot 1
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a10d
ses1: da2,pass7: Element descriptor: 'Slot 07'
ses1: da2,pass7: SAS Device Slot Element: 1 Phys at Slot 6
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a112
ses1: da3,pass8: Element descriptor: 'Slot 08'
ses1: da3,pass8: SAS Device Slot Element: 1 Phys at Slot 7
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a113
ses1: da4,pass9: Element descriptor: 'Slot 12'
ses1: da4,pass9: SAS Device Slot Element: 1 Phys at Slot 11
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a117
ses1: da5,pass10: Element descriptor: 'Slot 13'
ses1: da5,pass10: SAS Device Slot Element: 1 Phys at Slot 12
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a118
ses1: da6,pass11: Element descriptor: 'Slot 14'
ses1: da6,pass11: SAS Device Slot Element: 1 Phys at Slot 13
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a119
ses1: da7,pass12: Element descriptor: 'Slot 19'
ses1: da7,pass12: SAS Device Slot Element: 1 Phys at Slot 18
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a11e
ses1: da8,pass13: Element descriptor: 'Slot 20'
ses1: da8,pass13: SAS Device Slot Element: 1 Phys at Slot 19
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a11f
ses1: da9,pass14: Element descriptor: 'Slot 22'
ses1: da9,pass14: SAS Device Slot Element: 1 Phys at Slot 21
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a121
ses1: da10,pass15: Element descriptor: 'Slot 23'
ses1: da10,pass15: SAS Device Slot Element: 1 Phys at Slot 22
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a122
ses1: da11,pass16: Element descriptor: 'Slot 24'
ses1: da11,pass16: SAS Device Slot Element: 1 Phys at Slot 23
ses1:  phy 0: SATA device
ses1:  phy 0: parent 500304801f07a13f addr 500304801f07a123
Trying to mount root from zfs:zroot/bootenv/default []...
lo0: link state changed to UP
ix2: link state changed to UP
ioat0: <IVB IOAT Ch0> mem 0xdff1c000-0xdff1ffff irq 31 at device 4.0 numa-domain 0 on pci0
ioat0: Capabilities: 2f7<PQ,Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat1: <IVB IOAT Ch1> mem 0xdff18000-0xdff1bfff irq 39 at device 4.1 numa-domain 0 on pci0
ioat1: Capabilities: 2f7<PQ,Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat2: <IVB IOAT Ch2> mem 0xdff14000-0xdff17fff irq 31 at device 4.2 numa-domain 0 on pci0
ioat2: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat3: <IVB IOAT Ch3> mem 0xdff10000-0xdff13fff irq 39 at device 4.3 numa-domain 0 on pci0
ioat3: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat4: <IVB IOAT Ch4> mem 0xdff0c000-0xdff0ffff irq 31 at device 4.4 numa-domain 0 on pci0
ioat4: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat5: <IVB IOAT Ch5> mem 0xdff08000-0xdff0bfff irq 39 at device 4.5 numa-domain 0 on pci0
ioat5: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat6: <IVB IOAT Ch6> mem 0xdff04000-0xdff07fff irq 31 at device 4.6 numa-domain 0 on pci0
ioat6: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat7: <IVB IOAT Ch7> mem 0xdff00000-0xdff03fff irq 39 at device 4.7 numa-domain 0 on pci0
ioat7: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat8: <IVB IOAT Ch0> mem 0xfbf1c000-0xfbf1ffff irq 55 at device 4.0 numa-domain 1 on pci9
ioat8: Capabilities: 2f7<PQ,Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat9: <IVB IOAT Ch1> mem 0xfbf18000-0xfbf1bfff irq 63 at device 4.1 numa-domain 1 on pci9
ioat9: Capabilities: 2f7<PQ,Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat10: <IVB IOAT Ch2> mem 0xfbf14000-0xfbf17fff irq 55 at device 4.2 numa-domain 1 on pci9
ioat10: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat11: <IVB IOAT Ch3> mem 0xfbf10000-0xfbf13fff irq 63 at device 4.3 numa-domain 1 on pci9
ioat11: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat12: <IVB IOAT Ch4> mem 0xfbf0c000-0xfbf0ffff irq 55 at device 4.4 numa-domain 1 on pci9
ioat12: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat13: <IVB IOAT Ch5> mem 0xfbf08000-0xfbf0bfff irq 63 at device 4.5 numa-domain 1 on pci9
ioat13: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat14: <IVB IOAT Ch6> mem 0xfbf04000-0xfbf07fff irq 55 at device 4.6 numa-domain 1 on pci9
ioat14: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat15: <IVB IOAT Ch7> mem 0xfbf00000-0xfbf03fff irq 63 at device 4.7 numa-domain 1 on pci9
ioat15: Capabilities: f7<Extended_APIC_ID,Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ums0 numa-domain 0 on uhub3
ums0: <Winbond Electronics Corp Hermon USB hidmouse Device, class 0/0, rev 1.10/0.01, addr 3> on usbus0
ums1 numa-domain 0 on uhub2
ums0: 3 buttons and [Z] coordinates ID=0
ums1: <HID Mouse> on usbus1
ums1: 5 buttons and [XYZ] coordinates ID=0
pflog0: promiscuous mode enabled
[dan@slocum:~] $ 
Website Pin Facebook Twitter Myspace Friendfeed Technorati del.icio.us Digg Google StumbleUpon Premium Responsive