Dec 252014
 

For future reference, this is the slocum server, which I use for various jails and services.

This data was gathered adding increasing the RAM from 16GB to 32GB and adding two SSD to the previous configuration. This is my first ZFS system with more than one pool.

Merry Christmas

$ gpart show
=>        34  5860533101  ada2  GPT  (2.7T)
          34          94     1  freebsd-boot  (47k)
         128     4194304     2  freebsd-swap  (2.0G)
     4194432  5851054080     3  freebsd-zfs  (2.7T)
  5855248512     5284623        - free -  (2.5G)

=>        34  5860533101  ada3  GPT  (2.7T)
          34          94     1  freebsd-boot  (47k)
         128     4194304     2  freebsd-swap  (2.0G)
     4194432  5851054080     3  freebsd-zfs  (2.7T)
  5855248512     5284623        - free -  (2.5G)

=>        34  5860533101  ada4  GPT  (2.7T)
          34          94     1  freebsd-boot  (47k)
         128     4194304     2  freebsd-swap  (2.0G)
     4194432  5851054080     3  freebsd-zfs  (2.7T)
  5855248512     5284623        - free -  (2.5G)

=>        34  5860533101  ada5  GPT  (2.7T)
          34          94     1  freebsd-boot  (47k)
         128     4194304     2  freebsd-swap  (2.0G)
     4194432  5851054080     3  freebsd-zfs  (2.7T)
  5855248512     5284623        - free -  (2.5G)

=>        34  5860533101  ada6  GPT  (2.7T)
          34          94     1  freebsd-boot  (47k)
         128     4194304     2  freebsd-swap  (2.0G)
     4194432  5851054080     3  freebsd-zfs  (2.7T)
  5855248512     5284623        - free -  (2.5G)

=>        34  5860533101  ada7  GPT  (2.7T)
          34          94     1  freebsd-boot  (47k)
         128     4194304     2  freebsd-swap  (2.0G)
     4194432  5851054080     3  freebsd-zfs  (2.7T)
  5855248512     5284623        - free -  (2.5G)

=>      34  62533229  ada0  GPT  (29G)
        34  62533229     1  freebsd-zfs  (29G)

=>      34  62533229  ada1  GPT  (29G)
        34  62533229     1  freebsd-zfs  (29G)

$
# zpool status
  pool: ssd
 state: ONLINE
  scan: none requested
config:

	NAME          STATE     READ WRITE CKSUM
	ssd           ONLINE       0     0     0
	  mirror-0    ONLINE       0     0     0
	    gpt/ssd0  ONLINE       0     0     0
	    gpt/ssd1  ONLINE       0     0     0

errors: No known data errors

  pool: system
 state: ONLINE
  scan: scrub in progress since Thu Dec 25 04:16:06 2014
        3.34T scanned out of 5.14T at 85.5M/s, 6h8m to go
        0 repaired, 64.89% done
config:

	NAME           STATE     READ WRITE CKSUM
	system         ONLINE       0     0     0
	  raidz2-0     ONLINE       0     0     0
	    gpt/disk0  ONLINE       0     0     0
	    gpt/disk1  ONLINE       0     0     0
	    gpt/disk2  ONLINE       0     0     0
	    gpt/disk3  ONLINE       0     0     0
	    gpt/disk4  ONLINE       0     0     0
	    gpt/disk5  ONLINE       0     0     0

errors: No known data errors
$

The filesystems, well, some of them:

[dan@slocum:~] $ zfs list
NAME                                       USED  AVAIL  REFER  MOUNTPOINT
ssd                                        130K  29.3G    31K  /ssd
system                                    4.50T  6.15T   288K  /
system/backups                             639K  6.15T   304K  /backups
system/backups/knew                        288K  6.15T   288K  /backups/knew
system/poudriere                          31.1G  6.15T   336K  /usr/local/poudriere
system/poudriere/data                     15.5G  6.15T  2.28G  /usr/local/poudriere/data
system/poudriere/data/cache                831M  6.15T   585M  /usr/local/poudriere/data/cache
system/poudriere/data/packages            10.1G  6.15T  4.38G  /usr/local/poudriere/data/packages
system/poudriere/jails                    7.00G  6.15T   448K  /usr/local/poudriere/jails
system/poudriere/jails/92amd64            1.64G  6.15T  1.64G  /usr/local/poudriere/jails/92amd64
system/poudriere/jails/92i386             1.49G  6.15T  1.49G  /usr/local/poudriere/jails/92i386
system/poudriere/jails/93amd64            1.17G  6.15T  1.13G  /usr/local/poudriere/jails/93amd64
system/poudriere/jails/93i386             1.11G  6.15T  1.08G  /usr/local/poudriere/jails/93i386
system/poudriere/jails/bacula164           288K  6.15T   288K  /usr/local/poudriere/jails/bacula164
system/poudriere/jails/bacula165           288K  6.15T   288K  /usr/local/poudriere/jails/bacula165
system/poudriere/jails/bacula167           288K  6.15T   288K  /usr/local/poudriere/jails/bacula167
system/poudriere/jails/bacula168           288K  6.15T   288K  /usr/local/poudriere/jails/bacula168
system/poudriere/jails/bacula169           288K  6.15T   288K  /usr/local/poudriere/jails/bacula169
system/poudriere/jails/bsdcan             1.58G  6.15T  1.58G  /usr/local/poudriere/jails/bsdcan
system/poudriere/ports                    8.62G  6.15T   320K  /usr/local/poudriere/ports
system/poudriere/ports/default            5.77G  6.15T  1.93G  /usr/local/poudriere/ports/default
system/poudriere/ports/testing            2.85G  6.15T  1.89G  /usr/local/poudriere/ports/testing
system/root                               29.1M  6.15T  27.9M  /root
system/rootfs                             7.02G  6.15T  3.75G  legacy
system/tmp                                 545M  6.15T   531M  /tmp
system/usr                                4.46T  6.15T   288K  /usr
system/usr/home                           1.75T  6.15T   288K  /usr/home
system/usr/home/dan                       1.75T  6.15T   649G  /usr/home/dan
system/usr/local/pgsql                     862G  6.15T   480G  /usr/local/pgsql
system/usr/obj                             127M  6.15T   408K  /usr/obj
system/usr/ports                          6.96G  6.15T  1.90G  /usr/ports
system/usr/ports/distfiles                3.66G  6.15T  3.66G  /usr/ports/distfiles
system/usr/src                            2.01G  6.15T   818M  /usr/src
system/var                                43.5M  6.15T   288K  /var
system/var/audit                           368K  6.15T   320K  /var/audit
system/var/empty                           288K  6.15T   288K  /var/empty
system/var/log                            40.2M  6.15T  7.41M  /var/log
system/var/tmp                            2.40M  6.15T  1.57M  /var/tmp

And dmesg:

Copyright (c) 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.3-RELEASE-p5 #0: Mon Nov  3 22:38:58 UTC 2014
    root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64
gcc version 4.2.1 20070831 patched [FreeBSD]
CPU: Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz (3300.10-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x306a9  Family = 0x6  Model = 0x3a  Stepping = 9
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  Standard Extended Features=0x281<GSFSBASE,SMEP,ENHMOVSB>
  TSC: P-state invariant, performance statistics
real memory  = 34368126976 (32776 MB)
avail memory = 33130627072 (31595 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <SUPERM SMCI--MB>
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
 cpu4 (AP): APIC ID:  4
 cpu5 (AP): APIC ID:  5
 cpu6 (AP): APIC ID:  6
 cpu7 (AP): APIC ID:  7
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
acpi0: <SUPERM SMCI--MB> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 67, 1 (4) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xdfc04000-0xdfc043ff irq 16 at device 26.0 on pci0
usbus0: EHCI version 1.0
usbus0 on ehci0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci1: <ACPI PCI bus> on pcib1
ahci0: <Marvell 88SE912x AHCI SATA controller> port 0xe090-0xe097,0xe080-0xe083,0xe070-0xe077,0xe060-0xe063,0xe050-0xe05f mem 0xdfb21000-0xdfb217ff irq 16 at device 0.0 on pci1
ahci0: AHCI v1.00 with 2 6Gbps ports, Port Multiplier supported with FBS
ahci0: quirks=0x140<EDGEIS,NOBSYRES>
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
atapci0: <Marvell 88SE912x UDMA133 controller> port 0xe040-0xe047,0xe030-0xe033,0xe020-0xe027,0xe010-0xe013,0xe000-0xe00f mem 0xdfb20000-0xdfb2000f irq 17 at device 0.1 on pci1
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0
pci2: <ACPI PCI bus> on pcib2
em0: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0xd000-0xd01f mem 0xdfa00000-0xdfa1ffff,0xdfa20000-0xdfa23fff irq 16 at device 0.0 on pci2
em0: Using MSIX interrupts with 3 vectors
em0: Ethernet address: 00:25:90:a4:cd:d4
pcib3: <ACPI PCI-PCI bridge> irq 18 at device 28.6 on pci0
pci3: <ACPI PCI bus> on pcib3
em1: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0xc000-0xc01f mem 0xdf900000-0xdf91ffff,0xdf920000-0xdf923fff irq 18 at device 0.0 on pci3
em1: Using MSIX interrupts with 3 vectors
em1: Ethernet address: 00:25:90:a4:cd:d5
ehci1: <EHCI (generic) USB 2.0 controller> mem 0xdfc03000-0xdfc033ff irq 23 at device 29.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci1
pcib4: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci4: <ACPI PCI bus> on pcib4
vgapci0: <VGA-compatible display> mem 0xde000000-0xdeffffff,0xdf800000-0xdf803fff,0xdf000000-0xdf7fffff irq 23 at device 3.0 on pci4
vgapci0: Boot video device
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci1: <Intel Cougar Point AHCI SATA controller> port 0xf050-0xf057,0xf040-0xf043,0xf030-0xf037,0xf020-0xf023,0xf000-0xf01f mem 0xdfc02000-0xdfc027ff irq 19 at device 31.2 on pci0
ahci1: AHCI v1.30 with 6 3Gbps ports, Port Multiplier not supported
ahcich2: <AHCI channel> at channel 0 on ahci1
ahcich3: <AHCI channel> at channel 1 on ahci1
ahcich4: <AHCI channel> at channel 2 on ahci1
ahcich5: <AHCI channel> at channel 3 on ahci1
ahcich6: <AHCI channel> at channel 4 on ahci1
ahcich7: <AHCI channel> at channel 5 on ahci1
acpi_button0: <Power Button> on acpi0
acpi_tz0: <Thermal Zone> on acpi0
acpi_tz1: <Thermal Zone> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart2: <16550 or compatible> port 0x3e8-0x3ef irq 10 on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcafff,0xcb000-0xcbfff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ppc0: cannot reserve I/O port range
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
est4: <Enhanced SpeedStep Frequency Control> on cpu4
p4tcc4: <CPU Frequency Thermal Control> on cpu4
est5: <Enhanced SpeedStep Frequency Control> on cpu5
p4tcc5: <CPU Frequency Thermal Control> on cpu5
est6: <Enhanced SpeedStep Frequency Control> on cpu6
p4tcc6: <CPU Frequency Thermal Control> on cpu6
est7: <Enhanced SpeedStep Frequency Control> on cpu7
p4tcc7: <CPU Frequency Thermal Control> on cpu7
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
usbus0: 480Mbps High Speed USB v2.0
usbus1: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <SanDisk SDSSDRC032G 3.0.0> ATA-9 SATA 3.x device
ada0: Serial Number 134106400102
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada0: Command Queueing enabled
ada0: 30533MB (62533296 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad4
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <SanDisk SDSSDRC032G 3.0.0> ATA-9 SATA 3.x device
ada1: Serial Number 133887400683
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada1: Command Queueing enabled
ada1: 30533MB (62533296 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad6
ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
ada2: <TOSHIBA DT01ACA300 MX6OABB0> ATA-8 SATA 3.x device
ada2: Serial Number 13Q8U8XYS
ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada2: Previously was known as ad8
ada3 at ahcich3 bus 0 scbus3 target 0 lun 0
ada3: <Hitachi HDS723030BLE640 MX6OAAB0> ATA-8 SATA 3.x device
ada3: Serial Number MSM9215Q0BDB5Y
ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada3: Previously was known as ad10
ada4 at ahcich4 bus 0 scbus4 target 0 lun 0
ada4: <Hitachi HDS723030BLE640 MX6OAAB0> ATA-8 SATA 3.x device
ada4: Serial Number MSM9215Q0B2WVX
ada4: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada4: Command Queueing enabled
ada4: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada4: Previously was known as ad12
ada5 at ahcich5 bus 0 scbus5 target 0 lun 0
ada5: <Hitachi HDS723030BLE640 MX6OAAB0> ATA-8 SATA 3.x device
ada5: Serial Number MSM9215Q0BEESY
ada5: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada5: Command Queueing enabled
ada5: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada5: Previously was known as ad14
ada6 at ahcich6 bus 0 scbus6 target 0 lun 0
ada6: <Hitachi HDS723030BLE640 MX6OAAB0> ATA-8 SATA 3.x device
ada6: Serial Number MSM9215Q0BEEUY
ada6: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada6: Command Queueing enabled
ada6: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada6: Previously was known as ad16
ada7 at ahcich7 bus 0 scbus7 target 0 lun 0
ada7: <Hitachi HDS723030BLE640 MX6OAAB0> ATA-8 SATA 3.x device
ada7: Serial Number MSM9215Q0B3EPX
ada7: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada7: Command Queueing enabled
ada7: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada7: Previously was known as ad18
SMP: AP CPU #1 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #2 Launched!
Timecounter "TSC-low" frequency 1650049390 Hz quality 1000
GEOM_MIRROR: Device mirror/swap launched (6/6).
Root mount waiting for: usbus1 usbus0
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
Root mount waiting for: usbus1 usbus0
ugen1.2: <vendor 0x8087> at usbus1
uhub2: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus1
ugen0.2: <vendor 0x8087> at usbus0
uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus0
Root mount waiting for: usbus1 usbus0
uhub2: 6 ports with 6 removable, self powered
uhub3: 6 ports with 6 removable, self powered
ugen0.3: <Winbond Electronics Corp> at usbus0
ugen1.3: <American Power Conversion> at usbus1
ums0: <Winbond Electronics Corp Hermon USB hidmouse Device, class 0/0, rev 1.10/0.01, addr 3> on usbus0
ums0: 3 buttons and [Z] coordinates ID=0
uhid0: <American Power Conversion Smart-UPS 1500 FWUPS 08.8  ID18, class 0/0, rev 2.00/1.06, addr 3> on usbus1
ukbd0: <Winbond Electronics Corp Hermon USB hidmouse Device, class 0/0, rev 1.10/0.01, addr 3> on usbus0
kbd2 at ukbd0
Root mount waiting for: usbus1
Root mount waiting for: usbus1
Root mount waiting for: usbus1
Root mount waiting for: usbus1
uhid0: no report descriptor
device_attach: uhid0 attach returned 12
Trying to mount root from zfs:system/rootfs [rw,noatime]...
GEOM_ELI: Device mirror/swap.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: software
Website Pin Facebook Twitter Myspace Friendfeed Technorati del.icio.us Digg Google StumbleUpon Premium Responsive