ZFS

Destroying some unneeded ZFS snapshots

Leave a Comment / FreeBSD, Open Source, ZFS / By /

Last night, I found that I had a number of unused ZFS snapshots. I decided to destroy some of them. The first destroy locked up the system. Nagios reported everything was dead. I remotely power cycled the system. After it came back, I noticed that a scrub was in progress. This had not been initiated because of the power cycle. The scrub was a weekly automatic operation which started some hours before my […]

Destroying some unneeded ZFS snapshots Read More »

OK, let’s compare

Leave a Comment / ZFS / By /

OK, let’s compare the two snapshots, one taken today, the other taken on Monday. [dan@ngaio:/usr] $ sudo du -c -d 1 . Password: 4 ./.snap 62760 ./bin 37520 ./include 93068 ./lib 184 ./libdata 35384 ./libexec 75109696 ./local 37708 ./sbin 102480 ./share 1103840 ./src 250268 ./compat 376 ./games 4 ./obj 71082728 ./home 3584112 ./ports 4 ./tmp 18287800 ./websites 4 ./bacula-restores 1335104 ./FreshPorts 21599028 ./samba_mounts 58065982 ./jails 250788058 . 250788058 total [dan@ngaio:/usr] $ [dan@ngaio:/usr] $

OK, let’s compare Read More »

ZFS details – just in case

Leave a Comment / FreeBSD, Open Source, ZFS / By /

I use a ZFS array for backups. The data is first copied to this array, and later copied to tape. This post contains some information which might be useful should I need to replace one of the drives in the array. We have 10 HDD in this system. Two are used in a gmirror for the base OS: ada8 ada9 Seven are active in an array: ada0 ada2 ada3 ada4 ada5 ada6 ada07

ZFS details – just in case Read More »

ZFS benchmarking ideas

Leave a Comment / hardware, ZFS / By /

I’m about to double the RAM in my ZFS system. It will go from 4GB to 8GB. Right now, I have: real memory = 4294967296 (4096 MB) avail memory = 4100382720 (3910 MB) I’m not interested in any big extensive benchmarks. I just want something simple. Hence: $ cd /storage/bonnie/ [dan@kraken:/storage/bonnie] $ ls -l total 0 [dan@kraken:/storage/bonnie] $ bonnie++ Writing a byte at a time…done Writing intelligently…done Rewriting…done Reading a byte at a

ZFS benchmarking ideas Read More »

zfs destroy

Leave a Comment / ZFS / By /

Here I go, removing an old ZFS dataset that is no longer required. But first, some stats (which have been edited to remove non-zfs output): [dan@kraken:~] $ df -h Filesystem Size Used Avail Capacity Mounted on storage 1.4T 15G 1.4T 1% /storage storage/bacula.DO.NOT.USE 5.8T 4.4T 1.4T 76% /storage/bacula.DO.NOT.USE storage/compressed 1.4T 49K 1.4T 0% /storage/compressed storage/compressed/bacula 4.4T 3.0T 1.4T 68% /storage/compressed/bacula storage/compressed/home 1.4T 2.7G 1.4T 0% /storage/compressed/home storage/pgsql 1.4T 5.5G 1.4T 0% /storage/pgsql And

zfs destroy Read More »

zfs send | zfs receive

1 Comment / ZFS / By /

For the record, I was doing a copy within a system recently: # time zfs send storage/bacula@transfer | mbuffer | zfs receive storage/compressed/bacula-buffer in @ 0.0 kB/s, out @ 0.0 kB/s, 4394 GB total, buffer 100% fullll summary: 4394 GByte in 35 h 11 min 35.5 MB/s real 2111m18.302s user 11m44.831s sys 258m59.151s I was copying my Bacula Volumes from non-compressed ZFS to compressed ZFS. # zfs list NAME USED AVAIL REFER MOUNTPOINT

zfs send | zfs receive Read More »

ZFS & gmirror & drive renumbering

2 Comments / FreeBSD, General, Open Source, ZFS / By / / , ,

I am impressed…. my gmirror array continued to work even after the drives were renamed from da20 and da24 to ada0 and ada1. This happened when I tried out the ahci(4) for my SATA drives. It’s the type of thing I’m striving for soon in my ZFS array. All this started when I wanted to find out about making my ZFS array more resilient. See http://docs.freebsd.org/cgi/getmsg.cgi?fetch=663685+0+current/freebsd-stable (which is the top level post of

ZFS & gmirror & drive renumbering Read More »

power failure and gmirror

Leave a Comment / FreeBSD, Open Source, ZFS / By /

From this morning’s log after a weekend power failure: Mar 15 09:15:45 subie kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad8 finished. Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: UNREF FILE I=35 OWNER=root MODE=100400 Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: SIZE=151568652480 MTIME=Mar 13 16:03 2010 (CLEARED) Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: UNREF FILE I=15356429 OWNER=dan MODE=100644 Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f: SIZE=216159 MTIME=Mar 13 15:35 2010 (CLEARED) Mar 15 09:20:58 subie fsck: /dev/mirror/gm0s1f:

power failure and gmirror Read More »

ZFS – some initial testing

1 Comment / FreeBSD, hardware, Open Source, ZFS / By / /

I thought I’d run some simple tests, based on a tuning thread I found: # dd if=/dev/urandom of=./file1 bs=1m count=1024 1024+0 records in 1024+0 records out 1073741824 bytes transferred in 14.283206 secs (75175127 bytes/sec) And while the above was running: # zpool iostat 5 capacity operations bandwidth pool used avail read write read write ———- —– —– —– —– —– —– storage 1.25G 9.06T 0 3 95 402K storage 1.25G 9.06T 0 0

ZFS – some initial testing Read More »

mirroring the hard drive

2 Comments / FreeBSD, hardware, Open Source, ZFS / By / /

Tonight’s goals: Install a second HDD get gmirror running install the remaining 5x2TB HDD add the two RAID cards After adding in the second HDD for the OS, dmesg shows this: ad4: 76319MB <seagate ST380815AS 4.AAB> at ata2-master UDMA100 SATA 3Gb/s acd0: DVDR <tsstcorp CDDVDW SH-S223C/SB01> at ata3-master UDMA100 SATA 1.5Gb/s ad8: 152587MB <wdc WD1600AAJS-75M0A0 02.03E02> at ata4-master UDMA100 SATA 3Gb/s The following shows me I’m booting from ad4, so ad8 must be

mirroring the hard drive Read More »

Scroll to Top