I use a ZFS array for backups. The data is first copied to this array, and later copied to tape. This post contains some information which might be useful should I need to replace one of the drives in the array.
We have 10 HDD in this system.
Two are used in a gmirror for the base OS:
- ada8
- ada9
Seven are active in an array:
- ada0
- ada2
- ada3
- ada4
- ada5
- ada6
- ada07
One is spare:
- ada1
There is another spare HDD, but it is not installed because of lack of space.
The zpool
# zpool status pool: storage state: ONLINE scrub: scrub completed after 6h7m with 0 errors on Tue May 24 09:13:12 2011 config: NAME STATE READ WRITE CKSUM storage ONLINE 0 0 0 raidz2 ONLINE 0 0 0 gpt/disk01-live ONLINE 0 0 0 gpt/disk02-live ONLINE 0 0 0 gpt/disk03-live ONLINE 0 0 0 gpt/disk04-live ONLINE 0 0 0 gpt/disk05-live ONLINE 0 0 0 gpt/disk06-live ONLINE 0 0 0 gpt/disk07-live ONLINE 0 0 0 errors: No known data errors
The gpart
$ gpart list Geom name: ada0 modified: false state: OK fwheads: 16 fwsectors: 63 last: 3907029134 first: 34 entries: 128 scheme: GPT Providers: 1. Name: ada0p1 Mediasize: 2000188135936 (1.8T) Sectorsize: 512 Mode: r1w1e2 rawuuid: 3ec562f0-99d6-11df-83c1-001b2151ab2d rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: disk06-live length: 2000188135936 offset: 1048576 type: freebsd-zfs index: 1 end: 3906619500 start: 2048 Consumers: 1. Name: ada0 Mediasize: 2000398934016 (1.8T) Sectorsize: 512 Mode: r1w1e3 Geom name: ada2 modified: false state: OK fwheads: 16 fwsectors: 63 last: 3907029134 first: 34 entries: 128 scheme: GPT Providers: 1. Name: ada2p1 Mediasize: 2000188135936 (1.8T) Sectorsize: 512 Mode: r1w1e2 rawuuid: 4bc24c69-9cab-11df-83c1-001b2151ab2d rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: disk01-live length: 2000188135936 offset: 1048576 type: freebsd-zfs index: 1 end: 3906619500 start: 2048 Consumers: 1. Name: ada2 Mediasize: 2000398934016 (1.8T) Sectorsize: 512 Mode: r1w1e3 Geom name: ada3 modified: false state: OK fwheads: 16 fwsectors: 63 last: 3907029134 first: 34 entries: 128 scheme: GPT Providers: 1. Name: ada3p1 Mediasize: 2000188135936 (1.8T) Sectorsize: 512 Mode: r1w1e2 rawuuid: c7729bb2-9d10-11df-83c1-001b2151ab2d rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: disk02-live length: 2000188135936 offset: 1048576 type: freebsd-zfs index: 1 end: 3906619500 start: 2048 Consumers: 1. Name: ada3 Mediasize: 2000398934016 (1.8T) Sectorsize: 512 Mode: r1w1e3 Geom name: ada4 modified: false state: OK fwheads: 16 fwsectors: 63 last: 3907029134 first: 34 entries: 128 scheme: GPT Providers: 1. Name: ada4p1 Mediasize: 2000188135936 (1.8T) Sectorsize: 512 Mode: r1w1e2 rawuuid: 20d23d98-9da5-11df-83c1-001b2151ab2d rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: disk03-live length: 2000188135936 offset: 1048576 type: freebsd-zfs index: 1 end: 3906619500 start: 2048 Consumers: 1. Name: ada4 Mediasize: 2000398934016 (1.8T) Sectorsize: 512 Mode: r1w1e3 Geom name: ada5 modified: false state: OK fwheads: 16 fwsectors: 63 last: 3907029134 first: 34 entries: 128 scheme: GPT Providers: 1. Name: ada5p1 Mediasize: 2000188135936 (1.8T) Sectorsize: 512 Mode: r1w1e2 rawuuid: 4ed25145-9dd7-11df-83c1-001b2151ab2d rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: disk04-live length: 2000188135936 offset: 1048576 type: freebsd-zfs index: 1 end: 3906619500 start: 2048 Consumers: 1. Name: ada5 Mediasize: 2000398934016 (1.8T) Sectorsize: 512 Mode: r1w1e3 Geom name: ada6 modified: false state: OK fwheads: 16 fwsectors: 63 last: 3907029134 first: 34 entries: 128 scheme: GPT Providers: 1. Name: ada6p1 Mediasize: 2000188135936 (1.8T) Sectorsize: 512 Mode: r1w1e2 rawuuid: 2c3c7d97-9e28-11df-83c1-001b2151ab2d rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: disk05-live length: 2000188135936 offset: 1048576 type: freebsd-zfs index: 1 end: 3906619500 start: 2048 Consumers: 1. Name: ada6 Mediasize: 2000398934016 (1.8T) Sectorsize: 512 Mode: r1w1e3 Geom name: ada7 modified: false state: OK fwheads: 16 fwsectors: 63 last: 3907029134 first: 34 entries: 128 scheme: GPT Providers: 1. Name: ada7p1 Mediasize: 2000188135936 (1.8T) Sectorsize: 512 Mode: r1w1e2 rawuuid: 4324754d-99d6-11df-83c1-001b2151ab2d rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: disk07-live length: 2000188135936 offset: 1048576 type: freebsd-zfs index: 1 end: 3906619500 start: 2048 Consumers: 1. Name: ada7 Mediasize: 2000398934016 (1.8T) Sectorsize: 512 Mode: r1w1e3 Geom name: mirror/gm0 modified: false state: OK fwheads: 255 fwsectors: 63 last: 156301424 first: 63 entries: 4 scheme: MBR Providers: 1. Name: mirror/gm0s1 Mediasize: 80026329600 (75G) Sectorsize: 512 Mode: r5w5e9 attrib: active rawtype: 165 length: 80026329600 offset: 32256 type: freebsd index: 1 end: 156301487 start: 63 Consumers: 1. Name: mirror/gm0 Mediasize: 80026361344 (75G) Sectorsize: 512 Mode: r5w5e14 Geom name: mirror/gm0s1 modified: false state: OK fwheads: 255 fwsectors: 63 last: 156301424 first: 0 entries: 8 scheme: BSD Providers: 1. Name: mirror/gm0s1a Mediasize: 1073741824 (1.0G) Sectorsize: 512 Mode: r1w1e1 rawtype: 7 length: 1073741824 offset: 0 type: freebsd-ufs index: 1 end: 2097151 start: 0 2. Name: mirror/gm0s1b Mediasize: 6442450944 (6.0G) Sectorsize: 512 Mode: r1w1e0 rawtype: 1 length: 6442450944 offset: 1073741824 type: freebsd-swap index: 2 end: 14680063 start: 2097152 3. Name: mirror/gm0s1d Mediasize: 4294967296 (4.0G) Sectorsize: 512 Mode: r1w1e1 rawtype: 7 length: 4294967296 offset: 7516192768 type: freebsd-ufs index: 4 end: 23068671 start: 14680064 4. Name: mirror/gm0s1e Mediasize: 4294967296 (4.0G) Sectorsize: 512 Mode: r1w1e1 rawtype: 7 length: 4294967296 offset: 11811160064 type: freebsd-ufs index: 5 end: 31457279 start: 23068672 5. Name: mirror/gm0s1f Mediasize: 63920202240 (60G) Sectorsize: 512 Mode: r1w1e1 rawtype: 7 length: 63920202240 offset: 16106127360 type: freebsd-ufs index: 6 end: 156301424 start: 31457280 Consumers: 1. Name: mirror/gm0s1 Mediasize: 80026329600 (75G) Sectorsize: 512 Mode: r5w5e9
camcontrol identify:
[dan@kraken:~/bacula] $ sudo camcontrol identify camcontrol: subcommand "identify" requires a valid device identifier [dan@kraken:~/bacula] $ sudo camcontrol identify ada0 pass0: <hitachi HDS722020ALA330 JKAOA28A> ATA-8 SATA 2.x device pass0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model Hitachi HDS722020ALA330 firmware revision JKAOA28A serial number JK1131YAHLJWLV WWN 5000cca221d68596 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 3907029168 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 media RPM 7200 Feature Support Enabled Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management yes no 0/0x00 automatic acoustic management yes no 254/0xFE 128/0x80 media status notification no no power-up in Standby yes no write-read-verify no no unload no no free-fall no no data set management (TRIM) no [dan@kraken:~/bacula] $ sudo camcontrol identify ada1 pass1: <hitachi HDS722020ALA330 JKAOA3MA> ATA-8 SATA 2.x device pass1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model Hitachi HDS722020ALA330 firmware revision JKAOA3MA serial number JK11A8B9J0671F WWN 5000cca222dc4662 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 3907029168 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 media RPM 7200 Feature Support Enabled Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management yes no 0/0x00 automatic acoustic management no no media status notification no no power-up in Standby yes no write-read-verify no no unload no no free-fall no no data set management (TRIM) no [dan@kraken:~/bacula] $ sudo camcontrol identify ada2 pass2: <hitachi HDS722020ALA330 JKAOA28A> ATA-8 SATA 2.x device pass2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model Hitachi HDS722020ALA330 firmware revision JKAOA28A serial number JK1130YAH531ST WWN 5000cca221d068d5 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 3907029168 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 media RPM 7200 Feature Support Enabled Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management yes no 0/0x00 automatic acoustic management yes no 254/0xFE 128/0x80 media status notification no no power-up in Standby yes no write-read-verify no no unload no no free-fall no no data set management (TRIM) no [dan@kraken:~/bacula] $ sudo camcontrol identify ada3 pass3: <hitachi HDS722020ALA330 JKAOA28A> ATA-8 SATA 2.x device pass3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model Hitachi HDS722020ALA330 firmware revision JKAOA28A serial number JK1131YAGGUVAV WWN 5000cca221c6be3b cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 3907029168 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 media RPM 7200 Feature Support Enabled Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management yes no 0/0x00 automatic acoustic management yes no 254/0xFE 128/0x80 media status notification no no power-up in Standby yes no write-read-verify no no unload no no free-fall no no data set management (TRIM) no [dan@kraken:~/bacula] $ sudo camcontrol identify ada4 pass4: <hitachi HDS722020ALA330 JKAOA28A> ATA-8 SATA 2.x device pass4: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model Hitachi HDS722020ALA330 firmware revision JKAOA28A serial number JK1130YAH5AYTT WWN 5000cca221d08681 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 3907029168 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 media RPM 7200 Feature Support Enabled Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management yes no 0/0x00 automatic acoustic management yes no 254/0xFE 128/0x80 media status notification no no power-up in Standby yes no write-read-verify no no unload no no free-fall no no data set management (TRIM) no [dan@kraken:~/bacula] $ sudo camcontrol identify ada5 pass5: <hitachi HDS722020ALA330 JKAOA28A> ATA-8 SATA 2.x device pass5: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model Hitachi HDS722020ALA330 firmware revision JKAOA28A serial number JK1130YAH324ST WWN 5000cca221cf7cb3 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 3907029168 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 media RPM 7200 Feature Support Enabled Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management yes no 0/0x00 automatic acoustic management yes no 254/0xFE 128/0x80 media status notification no no power-up in Standby yes no write-read-verify no no unload no no free-fall no no data set management (TRIM) no [dan@kraken:~/bacula] $ sudo camcontrol identify ada6 pass6: <hitachi HDS722020ALA330 JKAOA28A> ATA-8 SATA 2.x device pass6: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model Hitachi HDS722020ALA330 firmware revision JKAOA28A serial number JK1130YAH5NGRT WWN 5000cca221d0aa38 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 3907029168 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 media RPM 7200 Feature Support Enabled Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management yes no 0/0x00 automatic acoustic management yes no 254/0xFE 128/0x80 media status notification no no power-up in Standby yes no write-read-verify no no unload no no free-fall no no data set management (TRIM) no [dan@kraken:~/bacula] $ sudo camcontrol identify ada7 pass7: <hitachi HDS722020ALA330 JKAOA28A> ATA-8 SATA 2.x device pass7: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model Hitachi HDS722020ALA330 firmware revision JKAOA28A serial number JK1131YAHLRGWV WWN 5000cca221d69a92 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 3907029168 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 media RPM 7200 Feature Support Enabled Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management yes no 0/0x00 automatic acoustic management yes no 254/0xFE 128/0x80 media status notification no no power-up in Standby yes no write-read-verify no no unload no no free-fall no no data set management (TRIM) no [dan@kraken:~/bacula] $ sudo camcontrol identify ada8 pass8: <st380815as 4.AAB> ATA-7 SATA 2.x device pass8: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-7 SATA 2.x device model ST380815AS firmware revision 4.AAB serial number 9QZCXHK6 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 156301488 sectors LBA48 supported 156301488 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 Feature Support Enabled Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management no no automatic acoustic management no no media status notification no no power-up in Standby no no write-read-verify no no unload no no free-fall no no data set management (TRIM) no [dan@kraken:~/bacula] $ sudo camcontrol identify ada9 pass10: <wdc WD1600AAJS-75M0A0 02.03E02> ATA-8 SATA 2.x device pass10: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model WDC WD1600AAJS-75M0A0 firmware revision 02.03E02 serial number WD-WMAV3C034340 WWN 50014ee0573ed059 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 312500000 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 Feature Support Enabled Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management no no automatic acoustic management yes yes 128/0x80 128/0x80 media status notification no no power-up in Standby yes no write-read-verify no no unload no no free-fall no no data set management (TRIM) no
Lots of gpart stuff:
[dan@kraken:~/bacula] $ gpart show ada0 => 34 3907029101 ada0 GPT (1.8T) 34 2014 - free - (1.0M) 2048 3906617453 1 freebsd-zfs (1.8T) 3906619501 409634 - free - (200M) [dan@kraken:~/bacula] $ gpart show ada1 gpart: No such geom: ada1. [dan@kraken:~/bacula] $ gpart show ada0 => 34 3907029101 ada0 GPT (1.8T) 34 2014 - free - (1.0M) 2048 3906617453 1 freebsd-zfs (1.8T) 3906619501 409634 - free - (200M) [dan@kraken:~/bacula] $ gpart show ada1 gpart: No such geom: ada1. [dan@kraken:~/bacula] $ gpart show ada2 => 34 3907029101 ada2 GPT (1.8T) 34 2014 - free - (1.0M) 2048 3906617453 1 freebsd-zfs (1.8T) 3906619501 409634 - free - (200M) [dan@kraken:~/bacula] $ gpart show ada3 => 34 3907029101 ada3 GPT (1.8T) 34 2014 - free - (1.0M) 2048 3906617453 1 freebsd-zfs (1.8T) 3906619501 409634 - free - (200M) [dan@kraken:~/bacula] $ gpart show ada4 => 34 3907029101 ada4 GPT (1.8T) 34 2014 - free - (1.0M) 2048 3906617453 1 freebsd-zfs (1.8T) 3906619501 409634 - free - (200M) [dan@kraken:~/bacula] $ gpart show ada5 => 34 3907029101 ada5 GPT (1.8T) 34 2014 - free - (1.0M) 2048 3906617453 1 freebsd-zfs (1.8T) 3906619501 409634 - free - (200M) [dan@kraken:~/bacula] $ gpart show ada6 => 34 3907029101 ada6 GPT (1.8T) 34 2014 - free - (1.0M) 2048 3906617453 1 freebsd-zfs (1.8T) 3906619501 409634 - free - (200M) [dan@kraken:~/bacula] $ gpart show ada7 => 34 3907029101 ada7 GPT (1.8T) 34 2014 - free - (1.0M) 2048 3906617453 1 freebsd-zfs (1.8T) 3906619501 409634 - free - (200M) [dan@kraken:~/bacula] $ gpart show ada8 gpart: No such geom: ada8. [dan@kraken:~/bacula] $ gpart show ada9 gpart: No such geom: ada9. [dan@kraken:~/bacula] $ gpart show ada910 gpart: No such geom: ada910. [dan@kraken:~/bacula] $
gmirror:
$ gmirror list Geom name: gm0 State: COMPLETE Components: 2 Balance: round-robin Slice: 4096 Flags: NONE GenID: 0 SyncID: 9 ID: 3685004504 Providers: 1. Name: mirror/gm0 Mediasize: 80026361344 (75G) Sectorsize: 512 Mode: r5w5e14 Consumers: 1. Name: ada8 Mediasize: 80026361856 (75G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: DIRTY GenID: 0 SyncID: 9 ID: 3456884141 2. Name: ada9 Mediasize: 160000000000 (149G) Sectorsize: 512 Mode: r1w1e1 State: ACTIVE Priority: 0 Flags: DIRTY GenID: 0 SyncID: 9 ID: 880733105
