Last week, while at EuroBSDCon in Malta, I noticed that one of my servers had the wrong time. It was Bacula who told me, through this message in one of the backup jobs: 28-Sep 21:59 nyi-fd JobId 144899: DIR and FD clocks differ by -5 seconds, FD automatically compensating Fixing the time I connected to all my systems, and ran date(1). One system was by 2 seconds, and another was off by 5 […]
different times despite running ntpd Read More »
My ZFS system hits a high load average every week during its scrub. Here is what top looks like after I pressed i and then S: last pid: 42049; load averages: 3.78, 3.26, 3.42 up 18+13:47:14 11:43:01 220 processes: 3 running, 216 sleeping, 1 waiting CPU: 7.5% user, 0.0% nice, 12.8% system, 1.2% interrupt, 78.5% idle Mem: 765M Active, 236M Inact, 8667M Wired, 17M Cache, 3284M Buf, 22G Free Swap: 8192M Total, 2404K
ZFS system hits high load during scrub Read More »
I’m in the process of setting up a new gateway/firewall. The new hardware will be faster and have more space. At present, the old firewall is also providing DHCP and DNS services. I want to move those off the gateway and onto another server. Why? I want the gateway to run only services that are related to gateway/firewall services. That keeps things simple. At present, the new firewall has just 43 packages installed.
Creating a FreeBSD jail to run DHCP and DNS Read More »
For future reference, this is the knew server. It runs a few jails, including Bacula regression testing services. The filesytems:
Today I created the new gateway machine. It is a ZFS-only system with 3x3TB drives in a mirror configuration. The hardware was my old ZFS workhorse, now replaced by something with more storage. I had a moment of panic, thinking this server had just one NIC, but I was wrong. em0 will be the local 1G LAN. re0 will have to be my upstream connection. That’s pretty sad, given it’s only a 10Mb
The new gateway configuration Read More »
After the zfs send, I had system/foo/bar, but I really just wanted system/bar. How do I fix that? mv(1) was my first guess. I was wrong. What I wanted was zfs(8) rename. Let me explain. After doing my: zfs send storage/compressed/bacula@2013.07.22:06:33 | mbuffer | ssh -t dan@10.5.0.20 ‘zfs receive system/usr/local/bacula/FromKraken’ I quite, correctly, wound up with system/usr/local/bacula/FromKraken, not the system/usr/local/bacula which I wanted. Here’s how I fixed that, but first, I took snapshots,
Moving zfs datasets / filesystems around Read More »
Today it finished. That ZFS send I started on Monday finally finished. Recap The original command was: # zfs send storage/compressed/bacula@2013.07.22:06:33 | mbuffer | ssh -t dan@10.5.0.20 ‘zfs receive system/usr/local/bacula/FromKraken’ That’s was the initial send of the filesystem. But more data has been added to it. So I take another snapshot, and send that: Send what’s accumulated since previous send # zfs snapshot storage/compressed/bacula@2013.07.25:08:20 And now I send the incremental stream: # zfs
zfs send | zfs receive; finally finished Read More »
Earlier today, I started a zfs send | zfs receive between the old file server and the new file server. It won’t finish until early morning tomorrow. [root@kraken ~]# zfs send storage/compressed/bacula@2013.07.22:06:33 | mbuffer | ssh -t dan@10.5.0.20 ‘zfs receive system/usr/local/bacula/FromKraken’ Pseudo-terminal will not be allocated because stdin is not a terminal. in @ 54.9 MB/s, out @ 54.9 MB/s, 47.6 GB total, buffer 100% full Why mbuffer? Because it shows me some
zfs send from old file server Read More »
My gateway is dying. My file server is getting full. Over the past few weeks, I’ve been dealing with aging infrastructure. My development server started acting up and was showing signs of age. This aging desktop box contained 80GB HDD, which means it’s probably 6 or 7 years old. That’s getting on in age. It’s been replaced by a much gruntier server. After completeing that work, I have to consider my gateway, which
Gateway getting old; File server getting full Read More »
I attended a few of the talks at PGCon 2013 last month. One talk, for which I took several notes and made a few choice tweets. The main one I’m following up on is using the -Fc option on pg_dump. It was during Magnus Haganders’ talk on PostgreSQL Backup Strategies that I posted that tweet. In the two weeks since that talk, I managed to do some testing. Let’s have a look at
Using compression with PostgreSQL’s pg_dump Read More »