For future reference, this is the knew server. It runs a few jails, including Bacula regression testing services.
The filesytems:
[dan@knew:~] $ zfs list NAME USED AVAIL REFER MOUNTPOINT system 14.0T 6.24T 329K / system/backups-by-snapshot 10.6G 6.24T 384K /usr/home/ansel/snapshots system/backups-by-snapshot/mailjail 10.6G 6.24T 9.37G /usr/home/ansel/snapshots/mailjail system/backups-by-snapshot/mounted 329K 6.24T 329K /usr/home/ansel/snapshots/mounted system/backups-by-snapshot/testing 329K 6.24T 329K /usr/home/ansel/snapshots/testing system/root 1.58M 6.24T 567K /root system/rootfs 4.67G 6.24T 3.01G legacy system/tmp 7.79G 6.24T 7.69G /tmp system/usr 14.0T 6.24T 329K /usr system/usr/home 196G 6.24T 329K /usr/home system/usr/home/dan 196G 6.24T 18.1G /usr/home/dan system/usr/home/dan/pgsql 329K 6.24T 329K /usr/home/dan/pgsql system/usr/jails 2.70T 6.24T 35.6M /usr/jails system/usr/jails/ansible 2.21G 6.24T 1001M /usr/jails/ansible system/usr/jails/ansible-slave 942M 6.24T 282M /usr/jails/ansible-slave system/usr/jails/basejail 2.17G 6.24T 2.12G /usr/jails/basejail system/usr/jails/cliff 1.57G 6.24T 765M /usr/jails/cliff system/usr/jails/crey 1.42G 6.24T 689M /usr/jails/crey system/usr/jails/dbclone 754G 6.24T 13.5G /usr/jails/dbclone system/usr/jails/dbclone.backups 1.83T 6.24T 416G /usr/jails/dbclone/usr/home/dan/backups system/usr/jails/empty 2.65G 6.24T 1.19G /usr/jails/empty system/usr/jails/ezjail_archives 370M 6.24T 370M /usr/jails/ezjail_archives system/usr/jails/hodor 629M 6.24T 333M /usr/jails/hodor system/usr/jails/metrics2 31.6G 6.24T 16.9G /usr/jails/metrics2 system/usr/jails/minion2 505M 6.24T 318M /usr/jails/minion2 system/usr/jails/mtatest 748M 6.24T 360M /usr/jails/mtatest system/usr/jails/mysql51 6.95G 6.24T 1.27G /usr/jails/mysql51 system/usr/jails/mysql55 9.44G 6.24T 1.46G /usr/jails/mysql55 system/usr/jails/mysql56 10.7G 6.24T 972M /usr/jails/mysql56 system/usr/jails/newjail 10.9M 6.24T 6.36M /usr/jails/newjail system/usr/jails/pg84 9.68G 6.24T 1.34G /usr/jails/pg84 system/usr/jails/pg90 12.0G 6.24T 1.53G /usr/jails/pg90 system/usr/jails/pg91 11.0G 6.24T 1.39G /usr/jails/pg91 system/usr/jails/pg92 11.1G 6.24T 1.54G /usr/jails/pg92 system/usr/jails/pg93 11.5G 6.24T 1.68G /usr/jails/pg93 system/usr/jails/pg94 11.1G 6.24T 889M /usr/jails/pg94 system/usr/jails/snapshots 899M 6.24T 326M /usr/jails/snapshots system/usr/jails/toiler 1.61G 6.24T 625M /usr/jails/toiler system/usr/local 11.1T 6.24T 556M /usr/local system/usr/local/bacula 11.1T 6.24T 9.72T /usr/jails/crey/usr/local/bacula system/usr/local/pgsql 384K 6.24T 329K /usr/local/pgsql system/usr/obj 567K 6.24T 512K /usr/obj system/usr/ports 1.92G 6.24T 1.80G /usr/ports system/usr/ports/distfiles 126M 6.24T 126M /usr/ports/distfiles system/usr/src 910M 6.24T 910M /usr/src system/var 160M 6.24T 329K /var system/var/audit 366K 6.24T 366K /var/audit system/var/empty 329K 6.24T 329K /var/empty system/var/log 152M 6.24T 2.38M /var/log system/var/tmp 6.55M 6.24T 494K /var/tmp [dan@knew:~] $
$ gpart show
=> 34 5860533101 ada0 GPT (2.7T)
34 94 1 freebsd-boot (47k)
128 16777216 2 freebsd-swap (8.0G)
16777344 5838471168 3 freebsd-zfs (2.7T)
5855248512 5284623 - free - (2.5G)
=> 34 5860533101 ada1 GPT (2.7T)
34 94 1 freebsd-boot (47k)
128 16777216 2 freebsd-swap (8.0G)
16777344 5838471168 3 freebsd-zfs (2.7T)
5855248512 5284623 - free - (2.5G)
=> 34 5860533101 da0 GPT (2.7T)
34 94 1 freebsd-boot (47k)
128 16777216 2 freebsd-swap (8.0G)
16777344 5838471168 3 freebsd-zfs (2.7T)
5855248512 5284623 - free - (2.5G)
=> 34 5860533101 da1 GPT (2.7T)
34 94 1 freebsd-boot (47k)
128 16777216 2 freebsd-swap (8.0G)
16777344 5838471168 3 freebsd-zfs (2.7T)
5855248512 5284623 - free - (2.5G)
=> 34 5860533101 da2 GPT (2.7T)
34 94 1 freebsd-boot (47k)
128 16777216 2 freebsd-swap (8.0G)
16777344 5838471168 3 freebsd-zfs (2.7T)
5855248512 5284623 - free - (2.5G)
=> 34 5860533101 da3 GPT (2.7T)
34 94 1 freebsd-boot (47k)
128 16777216 2 freebsd-swap (8.0G)
16777344 5838471168 3 freebsd-zfs (2.7T)
5855248512 5284623 - free - (2.5G)
=> 34 5860533101 da4 GPT (2.7T)
34 94 1 freebsd-boot (47k)
128 16777216 2 freebsd-swap (8.0G)
16777344 5838471168 3 freebsd-zfs (2.7T)
5855248512 5284623 - free - (2.5G)
=> 34 5860533101 da5 GPT (2.7T)
34 94 1 freebsd-boot (47k)
128 16777216 2 freebsd-swap (8.0G)
16777344 5838471168 3 freebsd-zfs (2.7T)
5855248512 5284623 - free - (2.5G)
=> 34 5860533101 da6 GPT (2.7T)
34 94 1 freebsd-boot (47k)
128 16777216 2 freebsd-swap (8.0G)
16777344 5838471168 3 freebsd-zfs (2.7T)
5855248512 5284623 - free - (2.5G)
=> 34 5860533101 da7 GPT (2.7T)
34 94 1 freebsd-boot (47k)
128 16777216 2 freebsd-swap (8.0G)
16777344 5838471168 3 freebsd-zfs (2.7T)
5855248512 5284623 - free - (2.5G)
$
$ zpool status pool: system state: ONLINE scan: scrub repaired 0 in 15h22m with 0 errors on Sat Aug 17 18:30:45 2013 config: NAME STATE READ WRITE CKSUM system ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 gpt/disk0 ONLINE 0 0 0 gpt/disk1 ONLINE 0 0 0 gpt/disk2 ONLINE 0 0 0 gpt/disk3 ONLINE 0 0 0 gpt/disk4 ONLINE 0 0 0 gpt/disk5 ONLINE 0 0 0 gpt/disk6 ONLINE 0 0 0 gpt/disk7 ONLINE 0 0 0 gpt/disk8 ONLINE 0 0 0 gpt/disk9 ONLINE 0 0 0 errors: No known data errors $
Copyright (c) 1992-2012 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.1-RELEASE-p4 #0: Mon Jun 17 11:42:37 UTC 2013
root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64
can't re-use a leaf (geom_label)!
can't re-use a leaf (geom_part_gpt)!
module_register: module g_label already exists!
Module g_label failed to register: 17
module_register: module g_part_gpt already exists!
Module g_part_gpt failed to register: 17
CPU: AMD Opteron(tm) Processor 6128 (2000.04-MHz K8-class CPU)
Origin = "AuthenticAMD" Id = 0x100f91 Family = 10 Model = 9 Stepping = 1
Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
Features2=0x802009<SSE3,MON,CX16,POPCNT>
AMD Features=0xee500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM,3DNow!+,3DNow!>
AMD Features2=0x837ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT,NodeId>
TSC: P-state invariant
real memory = 34359738368 (32768 MB)
avail memory = 33154031616 (31618 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <083112 APIC1535>
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 8 core(s)
cpu0 (BSP): APIC ID: 16
cpu1 (AP): APIC ID: 17
cpu2 (AP): APIC ID: 18
cpu3 (AP): APIC ID: 19
cpu4 (AP): APIC ID: 20
cpu5 (AP): APIC ID: 21
cpu6 (AP): APIC ID: 22
cpu7 (AP): APIC ID: 23
ioapic0 <Version 2.1> irqs 0-23 on motherboard
ioapic1 <Version 2.1> irqs 24-55 on motherboard
kbd1 at kbdmux0
GEOM_PART: scheme GPT is already registered!
cryptosoft0: <software crypto> on motherboard
acpi0: <SMCI > on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of fec00000, 1000 (3) failed
acpi0: reservation of fee00000, 1000 (3) failed
acpi0: reservation of ffb80000, 80000 (3) failed
acpi0: reservation of fec10000, 20 (3) failed
acpi0: reservation of ffe50000, e060 (3) failed
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, dff00000 (3) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 52 at device 4.0 on pci0
pci1: <ACPI PCI bus> on pcib1
mps0: <LSI SAS2008> port 0xb000-0xb0ff mem 0xfdc3c000-0xfdc3ffff,0xfdc40000-0xfdc7ffff irq 44 at device 0.0 on pci1
mps0: Firmware: 15.00.00.00, Driver: 14.00.00.01-fbsd
mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
pcib2: <ACPI PCI-PCI bridge> irq 53 at device 9.0 on pci0
pci2: <ACPI PCI bus> on pcib2
em0: <Intel(R) PRO/1000 Network Connection 7.3.2> port 0xc800-0xc81f mem 0xfdde0000-0xfddfffff,0xfdddc000-0xfdddffff irq 48 at device 0.0 on pci2
em0: Using MSIX interrupts with 3 vectors
em0: Ethernet address: 00:25:90:82:21:5a
pcib3: <ACPI PCI-PCI bridge> irq 54 at device 10.0 on pci0
pci3: <ACPI PCI bus> on pcib3
em1: <Intel(R) PRO/1000 Network Connection 7.3.2> port 0xd800-0xd81f mem 0xfdee0000-0xfdefffff,0xfdedc000-0xfdedffff irq 47 at device 0.0 on pci3
em1: Using MSIX interrupts with 3 vectors
em1: Ethernet address: 00:25:90:82:21:5b
ahci0: <ATI IXP700 AHCI SATA controller> port 0xa000-0xa007,0x9000-0x9003,0x8000-0x8007,0x7000-0x7003,0x6000-0x600f mem 0xfdbffc00-0xfdbfffff irq 22 at device 17.0 on pci0
ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ohci0: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfdbfd000-0xfdbfdfff irq 16 at device 18.0 on pci0
usbus0 on ohci0
ohci1: <OHCI (generic) USB controller> mem 0xfdbfe000-0xfdbfefff irq 16 at device 18.1 on pci0
usbus1 on ohci1
ehci0: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfdbff800-0xfdbff8ff irq 17 at device 18.2 on pci0
usbus2: EHCI version 1.0
usbus2 on ehci0
ohci2: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfdbf7000-0xfdbf7fff irq 18 at device 19.0 on pci0
usbus3 on ohci2
ohci3: <OHCI (generic) USB controller> mem 0xfdbfc000-0xfdbfcfff irq 18 at device 19.1 on pci0
usbus4 on ohci3
ehci1: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfdbff400-0xfdbff4ff irq 19 at device 19.2 on pci0
usbus5: EHCI version 1.0
usbus5 on ehci1
pci0: <serial bus, SMBus> at device 20.0 (no driver attached)
atapci0: <ATI IXP700/800 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
ata1: <ATA channel> at channel 1 on atapci0
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
pcib4: <ACPI PCI-PCI bridge> at device 20.4 on pci0
pci4: <ACPI PCI bus> on pcib4
sym0: <875> port 0xe000-0xe0ff mem 0xfebeec00-0xfebeecff,0xfebef000-0xfebeffff irq 21 at device 3.0 on pci4
sym0: Symbios NVRAM, ID 7, Fast-20, SE, parity checking
sym0: open drain IRQ line driver, using on-chip SRAM
sym0: using LOAD/STORE-based firmware.
vgapci0: <VGA-compatible display> mem 0xfc000000-0xfcffffff,0xfdffc000-0xfdffffff,0xfe000000-0xfe7fffff irq 20 at device 4.0 on pci4
ohci4: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfdbf6000-0xfdbf6fff irq 18 at device 20.5 on pci0
usbus6 on ohci4
acpi_button0: <Power Button> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xce000-0xce7ff,0xce800-0xcf7ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ppc0: cannot reserve I/O port range
ctl: CAM Target Layer loaded
acpi_throttle0: <ACPI CPU Throttling> on cpu0
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
ZFS filesystem version 5
ZFS storage pool version 28
Timecounters tick every 1.000 msec
The GEOM class LABEL is already loaded.
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 480Mbps High Speed USB v2.0
usbus3: 12Mbps Full Speed USB v1.0
usbus4: 12Mbps Full Speed USB v1.0
usbus5: 480Mbps High Speed USB v2.0
usbus6: 12Mbps Full Speed USB v1.0
ugen0.1: <ATI> at usbus0
uhub0: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <ATI> at usbus1
uhub1: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen2.1: <ATI> at usbus2
uhub2: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
ugen3.1: <ATI> at usbus3
uhub3: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
ugen4.1: <ATI> at usbus4
uhub4: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
ugen5.1: <ATI> at usbus5
uhub5: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus5
ugen6.1: <ATI> at usbus6
uhub6: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus6
uhub6: 2 ports with 2 removable, self powered
uhub0: 3 ports with 3 removable, self powered
uhub1: 3 ports with 3 removable, self powered
uhub3: 3 ports with 3 removable, self powered
uhub4: 3 ports with 3 removable, self powered
(noperiph:sym0:0:-1:-1): SCSI BUS reset delivered.
uhub2: 6 ports with 6 removable, self powered
uhub5: 6 ports with 6 removable, self powered
ada0 at ata0 bus 0 scbus5 target 0 lun 0
ada0: <TOSHIBA DT01ACA300 MX6OABB0> ATA-8 SATA 3.x device
ada0: 150.000MB/s transfers (SATA, UDMA6, PIO 8192bytes)
ada0: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad0
ada1 at ata0 bus 0 scbus5 target 1 lun 0
ada1: <TOSHIBA DT01ACA300 MX6OABB0> ATA-8 SATA 3.x device
ada1: 150.000MB/s transfers (SATA, UDMA6, PIO 8192bytes)
ada1: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad1
da0 at mps0 bus 0 scbus0 target 2 lun 0
da0: <ATA TOSHIBA DT01ACA3 ABB0> Fixed Direct Access SCSI-6 device
da0: 600.000MB/s transfers
da0: Command Queueing enabled
da0: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
da1 at mps0 bus 0 scbus0 target 10 lun 0
da1: <ATA TOSHIBA DT01ACA3 ABB0> Fixed Direct Access SCSI-6 device
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
da2 at mps0 bus 0 scbus0 target 11 lun 0
da2: <ATA TOSHIBA DT01ACA3 ABB0> Fixed Direct Access SCSI-6 device
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
da3 at mps0 bus 0 scbus0 target 12 lun 0
da3: <ATA TOSHIBA DT01ACA3 ABB0> Fixed Direct Access SCSI-6 device
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
da6 at mps0 bus 0 scbus0 target 16 lun 0
da6: <ATA TOSHIBA DT01ACA3 ABB0> Fixed Direct Access SCSI-6 device
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
da4 at mps0 bus 0 scbus0 target 13 lun 0
da4: <ATA TOSHIBA DT01ACA3 ABB0> Fixed Direct Access SCSI-6 device
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
da5 at mps0 bus 0 scbus0 target 14 lun 0
da5: <ATA TOSHIBA DT01ACA3 ABB0> Fixed Direct Access SCSI-6 device
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
da7 at mps0 bus 0 scbus0 target 17 lun 0
da7: <ATA TOSHIBA DT01ACA3 ABB0> Fixed Direct Access SCSI-6 device
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
ch0 at sym0 bus 0 scbus7 target 6 lun 0
ch0: <OVERLAND LXB 0524> Removable Changer SCSI-2 device
ch0: 20.000MB/s transfers (10.000MHz, offset 15, 16bit)
ch0: 15 slots, 1 drive, 1 picker, 0 portals
sa0 at sym0 bus 0 scbus7 target 4 lun 0
sa0: <QUANTUM DLT8000 0250> Removable Sequential Access SCSI-2 device
sa0: 20.000MB/s transfers (10.000MHz, offset 15, 16bit)
SMP: AP CPU #4 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #7 Launched!
Timecounter "TSC-low" frequency 15625313 Hz quality 800
GEOM_MIRROR: Force device swap start due to timeout.
GEOM_MIRROR: Device mirror/swap launched (1/8).
Trying to mount root from zfs:system/rootfs []...
GEOM_ELI: Device mirror/swap.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI: Crypto: software
