I’m sitting in the The Warden – FreeBSD and Linux Jail Management talk at EuroBSDCon 2012. He has mentioned two things, so far, that give me ideas. Evil ideas. Put each jail in a different ZFS data set – this may be useful for my jails running Bacula regression testing Schedule cron jobs to do snapshots on a regular basis – useful for snapshots, which I’m not really using at all And he’s […]
Idea from Kris Moore – PC-BSD Read More »
Last night, I found that I had a number of unused ZFS snapshots. I decided to destroy some of them. The first destroy locked up the system. Nagios reported everything was dead. I remotely power cycled the system. After it came back, I noticed that a scrub was in progress. This had not been initiated because of the power cycle. The scrub was a weekly automatic operation which started some hours before my
Destroying some unneeded ZFS snapshots Read More »
OK, let’s compare the two snapshots, one taken today, the other taken on Monday. [dan@ngaio:/usr] $ sudo du -c -d 1 . Password: 4 ./.snap 62760 ./bin 37520 ./include 93068 ./lib 184 ./libdata 35384 ./libexec 75109696 ./local 37708 ./sbin 102480 ./share 1103840 ./src 250268 ./compat 376 ./games 4 ./obj 71082728 ./home 3584112 ./ports 4 ./tmp 18287800 ./websites 4 ./bacula-restores 1335104 ./FreshPorts 21599028 ./samba_mounts 58065982 ./jails 250788058 . 250788058 total [dan@ngaio:/usr] $ [dan@ngaio:/usr] $
I use a ZFS array for backups. The data is first copied to this array, and later copied to tape. This post contains some information which might be useful should I need to replace one of the drives in the array. We have 10 HDD in this system. Two are used in a gmirror for the base OS: ada8 ada9 Seven are active in an array: ada0 ada2 ada3 ada4 ada5 ada6 ada07
ZFS details – just in case Read More »
I’m about to double the RAM in my ZFS system. It will go from 4GB to 8GB. Right now, I have: real memory = 4294967296 (4096 MB) avail memory = 4100382720 (3910 MB) I’m not interested in any big extensive benchmarks. I just want something simple. Hence: $ cd /storage/bonnie/ [dan@kraken:/storage/bonnie] $ ls -l total 0 [dan@kraken:/storage/bonnie] $ bonnie++ Writing a byte at a time…done Writing intelligently…done Rewriting…done Reading a byte at a
ZFS benchmarking ideas Read More »
Here I go, removing an old ZFS dataset that is no longer required. But first, some stats (which have been edited to remove non-zfs output): [dan@kraken:~] $ df -h Filesystem Size Used Avail Capacity Mounted on storage 1.4T 15G 1.4T 1% /storage storage/bacula.DO.NOT.USE 5.8T 4.4T 1.4T 76% /storage/bacula.DO.NOT.USE storage/compressed 1.4T 49K 1.4T 0% /storage/compressed storage/compressed/bacula 4.4T 3.0T 1.4T 68% /storage/compressed/bacula storage/compressed/home 1.4T 2.7G 1.4T 0% /storage/compressed/home storage/pgsql 1.4T 5.5G 1.4T 0% /storage/pgsql And
For the record, I was doing a copy within a system recently: # time zfs send storage/bacula@transfer | mbuffer | zfs receive storage/compressed/bacula-buffer in @ 0.0 kB/s, out @ 0.0 kB/s, 4394 GB total, buffer 100% fullll summary: 4394 GByte in 35 h 11 min 35.5 MB/s real 2111m18.302s user 11m44.831s sys 258m59.151s I was copying my Bacula Volumes from non-compressed ZFS to compressed ZFS. # zfs list NAME USED AVAIL REFER MOUNTPOINT
zfs send | zfs receive Read More »
I am impressed…. my gmirror array continued to work even after the drives were renamed from da20 and da24 to ada0 and ada1. This happened when I tried out the ahci(4) for my SATA drives. It’s the type of thing I’m striving for soon in my ZFS array. All this started when I wanted to find out about making my ZFS array more resilient. See http://docs.freebsd.org/cgi/getmsg.cgi?fetch=663685+0+current/freebsd-stable (which is the top level post of
ZFS & gmirror & drive renumbering Read More »
From this morning’s log after a weekend power failure: Mar 15 09:15:45 subie kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad8 finished. Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: UNREF FILE I=35 OWNER=root MODE=100400 Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: SIZE=151568652480 MTIME=Mar 13 16:03 2010 (CLEARED) Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: UNREF FILE I=15356429 OWNER=dan MODE=100644 Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: SIZE=216159 MTIME=Mar 13 15:35 2010 (CLEARED) Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f:
power failure and gmirror Read More »
I thought I’d run some simple tests, based on a tuning thread I found: # dd if=/dev/urandom of=./file1 bs=1m count=1024 1024+0 records in 1024+0 records out 1073741824 bytes transferred in 14.283206 secs (75175127 bytes/sec) And while the above was running: # zpool iostat 5 capacity operations bandwidth pool used avail read write read write ———- —– —– —– —– —– —– storage 1.25G 9.06T 0 3 95 402K storage 1.25G 9.06T 0 0
ZFS – some initial testing Read More »