I wrote this nearly a year ago, but did not publish it then. Tonight I found this query running, so I tried an explain analyse on it: That’s 10 seconds. Add an index: bacula=# create index media_lastwritten_idx on media(lastwritten); CREATE INDEX Run the query again: Forgive my math, but that’s over 10,000 times faster now.
Bacula: indexing on media.lastwritten Read More »
I use FreeBSD Jails. I use them a lot. I have jails for websites. I have jails for regression testing, mail servers, OpenVPN servers, etc. I like jails for many reasons. One of which is being able to create a new jail which is pretty much identical to another jail, except for a few things. In this case, I wanted to create a new jail to do regression testing for Bacula, the best
Using ezjail-admin archive to create a new jail, almost like an existing jail Read More »
A few weeks ago, I moved some Bacula Volumes from one Storage Daemon to another. In fact, I was decommissioning the old bacula-sd and creating a new one. I copied all the Volumes over. Backups have been running smoothly ever since. However. Today I tried a restore. It failed. Without any useful diagnostic information. Here is what I have: After thinking for a while, I started to wonder if this was a database
Moving Bacula Volumes from one Storage to Another Read More »
Following up on last weeks comparison of 10 disks vs 8 disks on raidz2, it was suggested by Marie Helene that I try more HDD on the m/b. I’m here to report just that. I’ve put 5 HDD on the SUPERMICRO MBD-X8SIL-O Micro ATX Server m/b and five on the LSI SATA/SAS 9211-8i 6Gb/s. Here are the pg_restore times: 18m28.511s 18m32.359s 18m30.077s An average of 18m 30s. This is the slowest of all
raidz2: 10 disks – half and half Read More »
Yesterday, I mentioned I wanted to compare raidz2 when using 10 disks versus using 8 disks. Along the way, I noticed that my ZFS-setup script needed a change to cope with mixed devices. Once I got past that hurdle, I started adding packages and setting up the system for some very simple tests. The test My test of preference is loading a database, and then dumping it. Each pg_restore was done into a
raidz2: 10 disks vs 8 disks Read More »
The traditional thoughts on ZFS are to have arrays which are a power-of-2 when it comes to number of disks. That means 2, 4, 8, etc. But for raidz1, that would be 3, 5, 9. For my choice of raidz2, it would be 4, 6, and 10. In the system I’m building up now, I have an 8-port LSI SATA/SAS 9211-8i 6Gb/s card. I can add two more HDD by attaching them to
ZFS: raidz2 with 8 or 10 disks? Read More »
I’ve been a fan of PostgreSQL since 2000 when I switched to it from MySQL. I wanted stored procedures and functions. I got that with PostgreSQL. I was used to having such features from my years working with other big databases such as DB2, Oracle, and Sybase. I’ve been moving towards using the custom format of pg_dump. In conjunction with that, I’ve been using pg_restore for testing those dumps. As part of my
pg_restore: [custom archiver] could not read from input file: end of file Read More »
I attended a few of the talks at PGCon 2013 last month. One talk, for which I took several notes and made a few choice tweets. The main one I’m following up on is using the -Fc option on pg_dump. It was during Magnus Haganders’ talk on PostgreSQL Backup Strategies that I posted that tweet. In the two weeks since that talk, I managed to do some testing. Let’s have a look at
Using compression with PostgreSQL’s pg_dump Read More »
Sometimes, you don’t want just anyone talking to your database. In fact, sometimes, you don’t want anyone accessing your database except very specific applications. In this case, I am setting up about 20 databases, each one dedicated to a specific use, and to be accessed only from one IP address each. In this post, I’ll talk about how I first set this up with pg_hba.conf, and then how I altered it to be
Restricting IP addresses to specific databases Read More »
One of the challenges of providing hands-on demonstrations is giving everyone their own sandbox to play in. I don’t want people to spend time on installing software. I want people to learn about the software in question, specifically Bacula. With this in mind, I’ve been building up a solution based on FreeBSD 9.1, ZFS, and jails. My solution is pretty nifty, but I don’t think it’s anything special. The key is simplicity. The
The Bacula Tutorial jail server Read More »