I use a ZFS array for backups. The data is first copied to this array, and later copied to tape. This post contains some information which might be useful should I need to replace one of the drives in the array. We have 10 HDD in this system. Two are used in a gmirror for the base OS: ada8 ada9 Seven are active in an array: ada0 ada2 ada3 ada4 ada5 ada6 ada07 […]
ZFS details – just in case Read More »
I’m about to double the RAM in my ZFS system. It will go from 4GB to 8GB. Right now, I have: real memory = 4294967296 (4096 MB) avail memory = 4100382720 (3910 MB) I’m not interested in any big extensive benchmarks. I just want something simple. Hence: $ cd /storage/bonnie/ [dan@kraken:/storage/bonnie] $ ls -l total 0 [dan@kraken:/storage/bonnie] $ bonnie++ Writing a byte at a time…done Writing intelligently…done Rewriting…done Reading a byte at a
ZFS benchmarking ideas Read More »
Here I go, removing an old ZFS dataset that is no longer required. But first, some stats (which have been edited to remove non-zfs output): [dan@kraken:~] $ df -h Filesystem Size Used Avail Capacity Mounted on storage 1.4T 15G 1.4T 1% /storage storage/bacula.DO.NOT.USE 5.8T 4.4T 1.4T 76% /storage/bacula.DO.NOT.USE storage/compressed 1.4T 49K 1.4T 0% /storage/compressed storage/compressed/bacula 4.4T 3.0T 1.4T 68% /storage/compressed/bacula storage/compressed/home 1.4T 2.7G 1.4T 0% /storage/compressed/home storage/pgsql 1.4T 5.5G 1.4T 0% /storage/pgsql And
For the record, I was doing a copy within a system recently: # time zfs send storage/bacula@transfer | mbuffer | zfs receive storage/compressed/bacula-buffer in @ 0.0 kB/s, out @ 0.0 kB/s, 4394 GB total, buffer 100% fullll summary: 4394 GByte in 35 h 11 min 35.5 MB/s real 2111m18.302s user 11m44.831s sys 258m59.151s I was copying my Bacula Volumes from non-compressed ZFS to compressed ZFS. # zfs list NAME USED AVAIL REFER MOUNTPOINT
zfs send | zfs receive Read More »
I am impressed…. my gmirror array continued to work even after the drives were renamed from da20 and da24 to ada0 and ada1. This happened when I tried out the ahci(4) for my SATA drives. It’s the type of thing I’m striving for soon in my ZFS array. All this started when I wanted to find out about making my ZFS array more resilient. See http://docs.freebsd.org/cgi/getmsg.cgi?fetch=663685+0+current/freebsd-stable (which is the top level post of
ZFS & gmirror & drive renumbering Read More »
From this morning’s log after a weekend power failure: Mar 15 09:15:45 subie kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad8 finished. Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: UNREF FILE I=35 OWNER=root MODE=100400 Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: SIZE=151568652480 MTIME=Mar 13 16:03 2010 (CLEARED) Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: UNREF FILE I=15356429 OWNER=dan MODE=100644 Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: SIZE=216159 MTIME=Mar 13 15:35 2010 (CLEARED) Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f:
power failure and gmirror Read More »
I thought I’d run some simple tests, based on a tuning thread I found: # dd if=/dev/urandom of=./file1 bs=1m count=1024 1024+0 records in 1024+0 records out 1073741824 bytes transferred in 14.283206 secs (75175127 bytes/sec) And while the above was running: # zpool iostat 5 capacity operations bandwidth pool used avail read write read write ———- —– —– —– —– —– —– storage 1.25G 9.06T 0 3 95 402K storage 1.25G 9.06T 0 0
ZFS – some initial testing Read More »
Tonight’s goals: Install a second HDD get gmirror running install the remaining 5x2TB HDD add the two RAID cards After adding in the second HDD for the OS, dmesg shows this: ad4: 76319MB <seagate ST380815AS 4.AAB> at ata2-master UDMA100 SATA 3Gb/s acd0: DVDR <tsstcorp CDDVDW SH-S223C/SB01> at ata3-master UDMA100 SATA 1.5Gb/s ad8: 152587MB <wdc WD1600AAJS-75M0A0 02.03E02> at ata4-master UDMA100 SATA 3Gb/s The following shows me I’m booting from ad4, so ad8 must be
mirroring the hard drive Read More »
Interesting posts here on ZFS tuning, espcially posts #34 and #35. Post #37 has an interesting perl solution.
I’m thinking about creating a storage box. One with a lot of disk space. It will be used for backups and stuff. I will continue to backup to tape as well. I’m considering this case, which has 8xSATA hot-swap bays: http://www.newegg.com/Product/Product.aspx?Item=N82E16811192058 If I was buying a RAID card, I’d buy this one: http://www.newegg.com/Product/Product.aspx?Item=N82E16816131002&Tpk=areca%201120 But I may go with ZFS instead of hardware RAID.