PostgreSQL

Moving Bacula Volumes from one Storage to Another

Leave a Comment / Bacula, FreeBSD, Open Source, PostgreSQL / By /

A few weeks ago, I moved some Bacula Volumes from one Storage Daemon to another. In fact, I was decommissioning the old bacula-sd and creating a new one. I copied all the Volumes over. Backups have been running smoothly ever since. However. Today I tried a restore. It failed. Without any useful diagnostic information. Here is what I have: After thinking for a while, I started to wonder if this was a database […]

Moving Bacula Volumes from one Storage to Another Read More »

raidz2: 10 disks – half and half

Leave a Comment / FreeBSD, Open Source, PostgreSQL, ZFS / By /

Following up on last weeks comparison of 10 disks vs 8 disks on raidz2, it was suggested by Marie Helene that I try more HDD on the m/b. I’m here to report just that. I’ve put 5 HDD on the SUPERMICRO MBD-X8SIL-O Micro ATX Server m/b and five on the LSI SATA/SAS 9211-8i 6Gb/s. Here are the pg_restore times: 18m28.511s 18m32.359s 18m30.077s An average of 18m 30s. This is the slowest of all

raidz2: 10 disks – half and half Read More »

raidz2: 10 disks vs 8 disks

Leave a Comment / FreeBSD, Open Source, PostgreSQL, ZFS / By /

Yesterday, I mentioned I wanted to compare raidz2 when using 10 disks versus using 8 disks. Along the way, I noticed that my ZFS-setup script needed a change to cope with mixed devices. Once I got past that hurdle, I started adding packages and setting up the system for some very simple tests. The test My test of preference is loading a database, and then dumping it. Each pg_restore was done into a

raidz2: 10 disks vs 8 disks Read More »

ZFS: raidz2 with 8 or 10 disks?

Leave a Comment / Disks, FreeBSD, FreshPorts, Performance, PostgreSQL, RAID, ZFS / By /

The traditional thoughts on ZFS are to have arrays which are a power-of-2 when it comes to number of disks. That means 2, 4, 8, etc. But for raidz1, that would be 3, 5, 9. For my choice of raidz2, it would be 4, 6, and 10. In the system I’m building up now, I have an 8-port LSI SATA/SAS 9211-8i 6Gb/s card. I can add two more HDD by attaching them to

ZFS: raidz2 with 8 or 10 disks? Read More »

pg_restore: [custom archiver] could not read from input file: end of file

3 Comments / PostgreSQL / By / /

I’ve been a fan of PostgreSQL since 2000 when I switched to it from MySQL. I wanted stored procedures and functions. I got that with PostgreSQL. I was used to having such features from my years working with other big databases such as DB2, Oracle, and Sybase. I’ve been moving towards using the custom format of pg_dump. In conjunction with that, I’ve been using pg_restore for testing those dumps. As part of my

pg_restore: [custom archiver] could not read from input file: end of file Read More »

Using compression with PostgreSQL’s pg_dump

4 Comments / databases, Open Source, PostgreSQL / By / /

I attended a few of the talks at PGCon 2013 last month. One talk, for which I took several notes and made a few choice tweets. The main one I’m following up on is using the -Fc option on pg_dump. It was during Magnus Haganders’ talk on PostgreSQL Backup Strategies that I posted that tweet. In the two weeks since that talk, I managed to do some testing. Let’s have a look at

Using compression with PostgreSQL’s pg_dump Read More »

Restricting IP addresses to specific databases

1 Comment / Open Source, PostgreSQL / By / /

Sometimes, you don’t want just anyone talking to your database. In fact, sometimes, you don’t want anyone accessing your database except very specific applications. In this case, I am setting up about 20 databases, each one dedicated to a specific use, and to be accessed only from one IP address each. In this post, I’ll talk about how I first set this up with pg_hba.conf, and then how I altered it to be

Restricting IP addresses to specific databases Read More »

The Bacula Tutorial jail server

Leave a Comment / Backups, Bacula, BSDCan, Conventions, DHCP, Disks, File Systems, FreeBSD, Jails, NAT, Operating Systems, pf, PostgreSQL, ssh, ZFS / By /

One of the challenges of providing hands-on demonstrations is giving everyone their own sandbox to play in. I don’t want people to spend time on installing software. I want people to learn about the software in question, specifically Bacula. With this in mind, I’ve been building up a solution based on FreeBSD 9.1, ZFS, and jails. My solution is pretty nifty, but I don’t think it’s anything special. The key is simplicity. The

The Bacula Tutorial jail server Read More »

Deleting old Bacula Volumes

6 Comments / Backups, Bacula, FreeBSD, Open Source, PostgreSQL, ZFS / By /

From time to time, my Bacula – space and time website shows some old jobs that need to be copied to tape. Stuff from 100 days or more. There’s no reason to copy stuff that old to tape. It’s already been copied to tape. So why does it appear? Last night I swapped some tapes in the tape library. This morning they would have been used and recycled. I’ll bet that those tapes

Deleting old Bacula Volumes Read More »

Scroll to Top