Maybe I need another zpool

I might need to create another zpool. Or perhaps move a drives/zpool from one host to another.

In this post:

  1. FreeBSD 13.1

Background

I am combining two hosts (slocum and r720-01) into one new host (r730-01). I have been moving jails from those hosts. I have an ansible playbook for creating new entries in /etc/jail.conf.d/.

I thought I had the space calculations done right. Now I think I’m wrong.I’m already at 73% on the 5.8TB pool:

[r730-01 dvl ~] % zpool list
NAME     SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
data01  5.81T  4.26T  1.56T        -         -     3%    73%  1.00x    ONLINE  -
data02  1.73T   360G  1.38T        -         -     0%    20%  1.00x    ONLINE  -
zroot    424G  2.14G   422G        -         -     0%     0%  1.00x    ONLINE  -
[r730-01 dvl ~] % 

I still have the FreshPorts development jails and the database server to migrate to this host:

[r720-01 dan ~] % zfs list | grep pg02
NAME                                           USED  AVAIL     REFER  MOUNTPOINT
data01/pg02                                    541G   873G       88K  none
data01/pg02/dan                                 96K   873G       96K  none
data01/pg02/postgres                           501G   873G      320G  /jails/pg02/var/db/postgres
data01/pg02/rsyncer                           39.9G   873G     6.65G  /jails/pg02/usr/home/rsyncer/backups
tank_fast/dan_pg02                            3.19G   571G       96K  /jails/pg02/root/DUMPING
tank_fast/jails/pg02                          21.6G   571G     7.80G  /jails/pg02

That’s about 560GB for for the database server.

Next, we have the FreshPorts websites/data:

[slocum dan ~] % zfs list | grep freshports
NAME                                                                    USED  AVAIL     REFER  MOUNTPOINT
nvd/freshports                                                          285G   616G       23K  none
nvd/freshports/dan                                                     38.9M   616G     38.9M  none
nvd/freshports/dev                                                     5.33G   616G       23K  /jails/dev-ingress01/var/db/freshports
nvd/freshports/dev-nginx01                                             40.0M   616G       24K  none
nvd/freshports/dev-nginx01/var                                         40.0M   616G       24K  none
nvd/freshports/dev-nginx01/var/db                                      40.0M   616G       24K  none
nvd/freshports/dev-nginx01/var/db/freshports                           39.9M   616G       24K  none
nvd/freshports/dev-nginx01/var/db/freshports/cache                     39.9M   616G       24K  /var/db/freshports/cache
nvd/freshports/dev-nginx01/var/db/freshports/cache/categories            48K   616G       33K  /var/db/freshports/cache/categories
nvd/freshports/dev-nginx01/var/db/freshports/cache/commits             28.2M   616G     28.2M  /var/db/freshports/cache/commits
nvd/freshports/dev-nginx01/var/db/freshports/cache/daily                523K   616G      508K  /var/db/freshports/cache/daily
nvd/freshports/dev-nginx01/var/db/freshports/cache/general               38K   616G       24K  /var/db/freshports/cache/general
nvd/freshports/dev-nginx01/var/db/freshports/cache/news                 299K   616G      284K  /var/db/freshports/cache/news
nvd/freshports/dev-nginx01/var/db/freshports/cache/packages              24K   616G       24K  /var/db/freshports/cache/packages
nvd/freshports/dev-nginx01/var/db/freshports/cache/pages                 38K   616G       24K  /var/db/freshports/cache/pages
nvd/freshports/dev-nginx01/var/db/freshports/cache/ports               10.7M   616G     10.6M  /var/db/freshports/cache/ports
nvd/freshports/dev-nginx01/var/db/freshports/cache/spooling              61K   616G       35K  /var/db/freshports/cache/spooling
nvd/freshports/dev/cache                                                138K   616G     35.5K  /jails/dev-ingress01/var/db/freshports/cache
nvd/freshports/dev/cache/html                                          74.5K   616G     74.5K  /jails/dev-ingress01/var/db/freshports/cache/html
nvd/freshports/dev/cache/spooling                                        28K   616G       28K  /jails/dev-ingress01/var/db/freshports/cache/spooling
nvd/freshports/dev/ingress                                             5.31G   616G       23K  /jails/dev-ingress01/var/db/ingress
nvd/freshports/dev/ingress/message-queues                              1.86M   616G     1.33M  /jails/dev-ingress01/var/db/ingress/message-queues
nvd/freshports/dev/ingress/repos                                       5.31G   616G     2.37G  /jails/dev-ingress01/var/db/ingress/repos
nvd/freshports/dev/ingress/repos/src                                   2.94G   616G     2.94G  /jails/dev-ingress01/var/db/ingress/repos/src
nvd/freshports/dev/message-queues                                      20.3M   616G     19.2M  /jails/dev-ingress01/var/db/freshports/message-queues
nvd/freshports/jailed                                                   266G   616G       24K  none
nvd/freshports/jailed/dev-ingress01                                    89.2G   616G       24K  none
nvd/freshports/jailed/dev-ingress01/jails                              88.8G   616G       24K  /jails
nvd/freshports/jailed/dev-ingress01/jails/freshports                   88.8G   616G     88.8G  /jails/freshports
nvd/freshports/jailed/dev-ingress01/mkjail                              340M   616G      340M  /var/db/mkjail
nvd/freshports/jailed/stage-ingress01                                  88.6G   616G       24K  none
nvd/freshports/jailed/stage-ingress01/jails                            88.2G   616G       24K  /jails
nvd/freshports/jailed/stage-ingress01/jails/freshports                 88.2G   616G     88.2G  /jails/freshports
nvd/freshports/jailed/stage-ingress01/mkjail                            340M   616G      340M  /var/db/mkjail
nvd/freshports/jailed/test-ingress01                                   88.6G   616G       24K  none
nvd/freshports/jailed/test-ingress01/jails                             88.3G   616G       24K  /jails
nvd/freshports/jailed/test-ingress01/jails/freshports                  88.3G   616G     88.3G  /jails/freshports
nvd/freshports/jailed/test-ingress01/mkjail                             340M   616G      340M  /var/db/mkjail
nvd/freshports/mobile-nginx01                                           462K   616G       24K  none
nvd/freshports/mobile-nginx01/var                                       438K   616G       24K  none
nvd/freshports/mobile-nginx01/var/db                                    414K   616G       24K  none
nvd/freshports/mobile-nginx01/var/db/freshports                         390K   616G       24K  none
nvd/freshports/mobile-nginx01/var/db/freshports/cache                   366K   616G       24K  /var/db/freshports/cache
nvd/freshports/mobile-nginx01/var/db/freshports/cache/categories         38K   616G       24K  /var/db/freshports/cache/categories
nvd/freshports/mobile-nginx01/var/db/freshports/cache/commits            38K   616G       24K  /var/db/freshports/cache/commits
nvd/freshports/mobile-nginx01/var/db/freshports/cache/daily              38K   616G       24K  /var/db/freshports/cache/daily
nvd/freshports/mobile-nginx01/var/db/freshports/cache/general            38K   616G       24K  /var/db/freshports/cache/general
nvd/freshports/mobile-nginx01/var/db/freshports/cache/news               38K   616G       24K  /var/db/freshports/cache/news
nvd/freshports/mobile-nginx01/var/db/freshports/cache/packages           38K   616G       24K  /var/db/freshports/cache/packages
nvd/freshports/mobile-nginx01/var/db/freshports/cache/pages              38K   616G       24K  /var/db/freshports/cache/pages
nvd/freshports/mobile-nginx01/var/db/freshports/cache/ports              38K   616G       24K  /var/db/freshports/cache/ports
nvd/freshports/mobile-nginx01/var/db/freshports/cache/spooling           38K   616G       24K  /var/db/freshports/cache/spooling
nvd/freshports/stage-ingress01                                         5.15G   616G       24K  none
nvd/freshports/stage-ingress01/var                                     5.15G   616G       24K  none
nvd/freshports/stage-ingress01/var/db                                  5.15G   616G       24K  none
nvd/freshports/stage-ingress01/var/db/freshports                       18.9M   616G       24K  /jails/stage-ingress01/var/db/freshports
nvd/freshports/stage-ingress01/var/db/freshports/cache                  156K   616G       24K  /jails/stage-ingress01/var/db/freshports/cache
nvd/freshports/stage-ingress01/var/db/freshports/cache/html            86.5K   616G     71.5K  /jails/stage-ingress01/var/db/freshports/cache/html
nvd/freshports/stage-ingress01/var/db/freshports/cache/spooling          46K   616G       46K  /jails/stage-ingress01/var/db/freshports/cache/spooling
nvd/freshports/stage-ingress01/var/db/freshports/message-queues        18.7M   616G     17.6M  /jails/stage-ingress01/var/db/freshports/message-queues
nvd/freshports/stage-ingress01/var/db/ingress                          5.13G   616G       24K  /jails/stage-ingress01/var/db/ingress
nvd/freshports/stage-ingress01/var/db/ingress/message-queues           1.45M   616G      960K  /jails/stage-ingress01/var/db/ingress/message-queues
nvd/freshports/stage-ingress01/var/db/ingress/repos                    5.13G   616G     5.12G  /jails/stage-ingress01/var/db/ingress/repos
nvd/freshports/stage-nginx01                                           39.0M   616G       24K  none
nvd/freshports/stage-nginx01/var                                       39.0M   616G       24K  none
nvd/freshports/stage-nginx01/var/db                                    38.9M   616G       24K  none
nvd/freshports/stage-nginx01/var/db/freshports                         38.9M   616G       24K  none
nvd/freshports/stage-nginx01/var/db/freshports/cache                   38.9M   616G       24K  /var/db/freshports/cache
nvd/freshports/stage-nginx01/var/db/freshports/cache/categories          43K   616G       28K  /var/db/freshports/cache/categories
nvd/freshports/stage-nginx01/var/db/freshports/cache/commits           34.4M   616G     34.4M  /var/db/freshports/cache/commits
nvd/freshports/stage-nginx01/var/db/freshports/cache/daily              528K   616G      512K  /var/db/freshports/cache/daily
nvd/freshports/stage-nginx01/var/db/freshports/cache/general             38K   616G       24K  /var/db/freshports/cache/general
nvd/freshports/stage-nginx01/var/db/freshports/cache/news               299K   616G      284K  /var/db/freshports/cache/news
nvd/freshports/stage-nginx01/var/db/freshports/cache/packages            24K   616G       24K  /var/db/freshports/cache/packages
nvd/freshports/stage-nginx01/var/db/freshports/cache/pages               38K   616G       24K  /var/db/freshports/cache/pages
nvd/freshports/stage-nginx01/var/db/freshports/cache/ports             3.47M   616G     3.46M  /var/db/freshports/cache/ports
nvd/freshports/stage-nginx01/var/db/freshports/cache/spooling            59K   616G       34K  /var/db/freshports/cache/spooling
nvd/freshports/test-ingress01                                          8.11G   616G       24K  none
nvd/freshports/test-ingress01/var                                      8.11G   616G       24K  none
nvd/freshports/test-ingress01/var/db                                   8.11G   616G       24K  none
nvd/freshports/test-ingress01/var/db/freshports                        10.2M   616G       24K  none
nvd/freshports/test-ingress01/var/db/freshports/cache                   146K   616G       24K  /jails/test-ingress01/var/db/freshports/cache
nvd/freshports/test-ingress01/var/db/freshports/cache/html             74.5K   616G     74.5K  /jails/test-ingress01/var/db/freshports/cache/html
nvd/freshports/test-ingress01/var/db/freshports/cache/spooling           47K   616G       47K  /jails/test-ingress01/var/db/freshports/cache/spooling
nvd/freshports/test-ingress01/var/db/freshports/message-queues         10.1M   616G     9.01M  /jails/test-ingress01/var/db/freshports/message-queues
nvd/freshports/test-ingress01/var/db/ingress                           8.10G   616G       24K  /jails/test-ingress01/var/db/ingress
nvd/freshports/test-ingress01/var/db/ingress/message-queues            1.47M   616G      961K  /jails/test-ingress01/var/db/ingress/message-queues
nvd/freshports/test-ingress01/var/db/ingress/repos                     8.10G   616G     5.20G  /jails/test-ingress01/var/db/ingress/repos
nvd/freshports/test-nginx01                                            36.2M   616G       24K  none
nvd/freshports/test-nginx01/var                                        36.1M   616G       24K  none
nvd/freshports/test-nginx01/var/db                                     36.1M   616G       24K  none
nvd/freshports/test-nginx01/var/db/freshports                          36.1M   616G       24K  none
nvd/freshports/test-nginx01/var/db/freshports/cache                    36.1M   616G       24K  /var/db/freshports/cache
nvd/freshports/test-nginx01/var/db/freshports/cache/categories           42K   616G       27K  /var/db/freshports/cache/categories
nvd/freshports/test-nginx01/var/db/freshports/cache/commits            31.8M   616G     31.8M  /var/db/freshports/cache/commits
nvd/freshports/test-nginx01/var/db/freshports/cache/daily               534K   616G      519K  /var/db/freshports/cache/daily
nvd/freshports/test-nginx01/var/db/freshports/cache/general              70K   616G       45K  /var/db/freshports/cache/general
nvd/freshports/test-nginx01/var/db/freshports/cache/news                299K   616G      284K  /var/db/freshports/cache/news
nvd/freshports/test-nginx01/var/db/freshports/cache/packages             24K   616G       24K  /var/db/freshports/cache/packages
nvd/freshports/test-nginx01/var/db/freshports/cache/pages                38K   616G       24K  /var/db/freshports/cache/pages
nvd/freshports/test-nginx01/var/db/freshports/cache/ports              3.23M   616G     3.22M  /var/db/freshports/cache/ports
nvd/freshports/test-nginx01/var/db/freshports/cache/spooling             59K   616G       34K  /var/db/freshports/cache/spooling
system/data/freshports-cache                                            927K  15.0T      176K  none
system/data/freshports-cache/dev-nginx01                                751K  15.0T      176K  none
system/data/freshports-cache/dev-nginx01/packages                       288K  15.0T      176K  /var/db/freshports/cache/packages
system/data/freshports-cache/dev-nginx01/ports                          288K  15.0T      176K  /var/db/freshports/cache/ports
system/data/jail_within_jail/jails/freshports                           620M  15.0T      620M  /jails/freshports
tank_fast/data/dev-ingress01/messages/archive                          13.5G   170G     13.5G  /jails/dev-ingress01/var/db/freshports/message-queues/archive
tank_fast/data/dev-ingress01/usr.local.libexec.freshports              2.23M   170G     2.23M  /jails/dev-ingress01/usr/local/libexec/freshports
tank_fast/data/dev-nginx01/usr/local/www/freshports                    42.0M   170G     41.7M  /jails/dev-nginx01/usr/local/www/freshports
tank_fast/data/dev-nginx01/usr/local/www/freshports-git-branch         15.6M   170G     15.6M  /jails/dev-nginx01/usr/local/www/freshports-git-branch
tank_fast/data/stage-ingress01/messages/archive                        11.4G   170G     11.4G  /jails/stage-ingress01/var/db/freshports/message-queues/archive
tank_fast/data/test-ingress01/messages/archive                         11.9G   170G     11.9G  /jails/test-ingress01/var/db/freshports/message-queues/archive
tank_fast/freshports                                                     88K   170G       88K  none

That’s roughly 320G.

For a total of about 880GB

That will take both of the existing zpools to pretty close to 80%. I need more space.

Filesystems on r730-01

This is what exists on the new host now:

[r730-01 dvl ~] % zfs list
NAME                                       USED  AVAIL     REFER  MOUNTPOINT
data01                                    3.03T  1005G      205K  none
data01/acme-certs                         30.2M  1005G      188K  none
data01/acme-certs/certs                   16.4M  1005G     13.6M  /jails/certs/var/db/acme/certs
data01/acme-certs/certs-for-rsync         13.6M  1005G     8.29M  /jails/certs/var/db/certs-for-rsync
data01/bacula                             1.97T  1005G      188K  /jails/bacula-sd-03/usr/local/bacula
data01/bacula/volumes                     1.97T  1005G      205K  /jails/bacula-sd-03/usr/local/bacula/volumes
data01/bacula/volumes/DiffFile-03          404G  1005G      404G  /jails/bacula-sd-03/usr/local/bacula/volumes/DiffFile-03
data01/bacula/volumes/FullFile-03         1.09T  1005G     1.04T  /jails/bacula-sd-03/usr/local/bacula/volumes/FullFile-03
data01/bacula/volumes/IncrFile-03          492G  1005G      492G  /jails/bacula-sd-03/usr/local/bacula/volumes/IncrFile-03
data01/bacula/working                      623K  1005G      247K  /jails/bacula-sd-03/usr/local/bacula/working
data01/certs-rsync                        7.01G  1005G     4.42G  none
data01/jail-testing                       1.85G  1005G      205K  none
data01/jail-testing/jails                  704M  1005G      222K  /jails
data01/jail-testing/jails/foo              704M  1005G      704M  /jails/foo
data01/jail-testing/mkjail                1.16G  1005G      205K  /jails/mkjail
data01/jail-testing/mkjail/12.2-RELEASE   1.16G  1005G     1.16G  /jails/mkjail/12.2-RELEASE
data01/jail_within_jail                    956M  1005G      205K  none
data01/jail_within_jail/jails              617M  1005G      205K  none
data01/jail_within_jail/jails/freshports   617M  1005G      617M  none
data01/jail_within_jail/mkjail             339M  1005G      339M  none
data01/librenms-rrd                       54.1G  1005G     4.50G  /jails/besser/var/db/librenms/rrd
data01/pg03                               27.8G  1005G      188K  none
data01/pg03/postgres                      27.8G  1005G     27.8G  /jails/pg03/var/db/postgres
data01/pg03/rsyncer                       1.89M  1005G      222K  /jails/pg03/usr/home/rsyncer/backups
data01/poudriere                           271G  1005G      239K  /usr/local/poudriere
data01/poudriere/ccache.13amd64            205K  1005G      205K  /usr/local/poudriere/ccache.13amd64
data01/poudriere/ccache.13i386             205K  1005G      205K  /usr/local/poudriere/ccache.13i386
data01/poudriere/ccache.amd64             6.08G  1005G     34.6M  /usr/local/poudriere/ccache.amd64
data01/poudriere/ccache.i386              9.27G  1005G     6.07G  /usr/local/poudriere/ccache.i386
data01/poudriere/data                     85.3G  1005G     18.2G  /usr/local/poudriere/data
data01/poudriere/data/cache                210M  1005G     71.2M  /usr/local/poudriere/data/cache
data01/poudriere/data/cronjob-logs        10.6M  1005G     2.89M  /usr/local/poudriere/data/cronjob-logs
data01/poudriere/data/packages            53.6G  1005G     24.4G  /usr/local/poudriere/data/packages
data01/poudriere/distfiles                67.8G  1005G     67.6G  /usr/ports/distfiles
data01/poudriere/distfiles.new            67.5G  1005G     67.5G  /usr/local/poudriere/distfiles.new
data01/poudriere/jails                    13.0G  1005G      239K  /usr/local/poudriere/jails
data01/poudriere/jails/114R               1.76G  1005G     1.76G  /usr/local/poudriere/jails/114R
data01/poudriere/jails/121amd64           2.00G  1005G     2.00G  /usr/local/poudriere/jails/121amd64
data01/poudriere/jails/121i386            1.73G  1005G     1.73G  /usr/local/poudriere/jails/121i386
data01/poudriere/jails/131amd64           2.04G  1005G     2.04G  /usr/local/poudriere/jails/131amd64
data01/poudriere/jails/131i386            1.72G  1005G     1.72G  /usr/local/poudriere/jails/131i386
data01/poudriere/jails/13amd64            2.04G  1005G     2.04G  /usr/local/poudriere/jails/13amd64
data01/poudriere/jails/13i386             1.72G  1005G     1.72G  /usr/local/poudriere/jails/13i386
data01/poudriere/ports                    22.0G  1005G      188K  /usr/local/poudriere/ports
data01/poudriere/ports/default            5.17G  1005G     3.09G  /usr/local/poudriere/ports/default
data01/poudriere/ports/main               2.55G  1005G     2.40G  /usr/local/poudriere/ports/main
data01/poudriere/ports/testing            14.2G  1005G     3.07G  /usr/local/poudriere/ports/testing
data01/poudriere/test                      478K  1005G      205K  /usr/local/poudriere/test
data01/repos                              8.09G  1005G      188K  none
data01/repos/gitea                         219M  1005G      196M  /jails/git/var/db/gitea
data01/repos/subversion                   7.88G  1005G     7.85G  /jails/svn/usr/local/svn/repos
data01/samba                               700G  1005G      222K  /jails/fileserver/usr/local/samba
data01/samba/dan                           260G  1005G      260G  /jails/fileserver/usr/local/samba/dan
data01/samba/public                       21.0G  1005G     21.0G  /jails/fileserver/usr/local/samba/public
data01/samba/transfer                     1.48G  1005G     1.48G  /jails/fileserver/usr/local/samba/transfer
data01/samba/video                         417G  1005G      417G  /data/video
data01/syncthing                          14.0G  1005G     13.1G  /jails/fileserver/usr/local/syncthing
data02                                     360G  1.33T       96K  none
data02/data                               1.65G  1.33T       96K  none
data02/data/mydev                         1.65G  1.33T     1.65G  none
data02/jails                               358G  1.33T      232K  /jails
data02/jails/bacula                       22.1G  1.33T     19.9G  /jails/bacula
data02/jails/bacula-sd-02                 7.93G  1.33T     5.30G  /jails/bacula-sd-02
data02/jails/bacula-sd-03                 7.68G  1.33T     5.41G  /jails/bacula-sd-03
data02/jails/besser                       21.5G  1.33T     18.1G  /jails/besser
data02/jails/certs                        4.03G  1.33T     3.97G  /jails/certs
data02/jails/certs-rsync                  3.60G  1.33T     3.55G  /jails/certs-rsync
data02/jails/cliff2                       6.67G  1.33T     4.56G  /jails/cliff2
data02/jails/dev-ingress01                5.49G  1.33T     5.49G  /jails/dev-ingress01
data02/jails/dev-nginx01                  4.40G  1.33T     4.39G  /jails/dev-nginx01
data02/jails/dev-pgeu                     12.5G  1.33T     5.81G  /jails/dev-pgeu
data02/jails/dns-hidden-master            7.17G  1.33T     4.76G  /jails/dns-hidden-master
data02/jails/fileserver                   9.67G  1.33T     7.09G  /jails/fileserver
data02/jails/git                          9.30G  1.33T     4.94G  /jails/git
data02/jails/jail-testing                 3.66G  1.33T     1.85G  /jails/jail-testing
data02/jails/jail_within_jail             1.93G  1.33T      789M  /jails/jail_within_jail
data02/jails/keycloak                     16.2G  1.33T     13.0G  /jails/keycloak
data02/jails/mobile-nginx01               4.37G  1.33T     4.37G  /jails/mobile-nginx01
data02/jails/mqtt01                       8.10G  1.33T     5.34G  /jails/mqtt01
data02/jails/mydev                        14.1G  1.33T     6.71G  /jails/mydev
data02/jails/mysql01                      4.72G  1.33T     4.57G  /jails/mysql01
data02/jails/nsnotify                     6.70G  1.33T     4.33G  /jails/nsnotify
data02/jails/pg01                         14.5G  1.33T     11.3G  /jails/pg01
data02/jails/pg02                         22.3G  1.33T     7.88G  /jails/pg02
data02/jails/pg03                         22.5G  1.33T     5.75G  /jails/pg03
data02/jails/pkg01                        19.4G  1.33T     10.9G  /jails/pkg01
data02/jails/samdrucker                   8.23G  1.33T     5.77G  /jails/samdrucker
data02/jails/serpico                      7.87G  1.33T     5.28G  /jails/serpico
data02/jails/stage-ingress01              2.34G  1.33T     2.34G  /jails/stage-ingress01
data02/jails/stage-nginx01                1.55G  1.33T     1.55G  /jails/stage-nginx01
data02/jails/svn                          5.53G  1.33T     5.46G  /jails/svn
data02/jails/talos                        5.18G  1.33T     3.71G  /jails/talos
data02/jails/test-ingress01               4.11G  1.33T     4.11G  /jails/test-ingress01
data02/jails/test-nginx01                 1.66G  1.33T     1.66G  /jails/test-nginx01
data02/jails/unifi01                      35.7G  1.33T     9.56G  /jails/unifi01
data02/jails/webserver                    21.3G  1.33T     18.0G  /jails/webserver
data02/jails/zm                           4.11G  1.33T     1.90G  /jails/zm
zroot                                     2.14G   409G       96K  /zroot
zroot/ROOT                                2.04G   409G       96K  none
zroot/ROOT/before-jailhosts                  8K   409G     1.46G  /
zroot/ROOT/before-samdrucker                 8K   409G     1.45G  /
zroot/ROOT/default                        2.04G   409G     1.74G  /
zroot/ROOT/without-anvil                   496K   409G     1.45G  /
zroot/tmp                                 8.86M   409G      600K  /tmp
zroot/usr                                 18.5M   409G       96K  /usr
zroot/usr/home                            18.2M   409G     6.32M  /usr/home
zroot/usr/ports                             96K   409G       96K  /usr/ports
zroot/usr/src                               96K   409G       96K  /usr/src
zroot/var                                 17.0M   409G       96K  /var
zroot/var/audit                             96K   409G       96K  /var/audit
zroot/var/crash                             96K   409G       96K  /var/crash
zroot/var/log                             14.0M   409G     1.48M  /var/log
zroot/var/mail                             608K   409G      168K  /var/mail
zroot/var/tmp                             2.07M   409G      412K  /var/tmp

I was trying to keep all jails in data01 and the data used by those jails in data01.

zpools in the old hosts

These are the zpools in slocum:

[slocum dan ~] % zpool list
NAME        SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
nvd         930G   285G   645G        -         -    19%    30%  1.00x    ONLINE  -
system     27.2T  4.51T  22.7T        -         -    24%    16%  1.00x    ONLINE  -
tank_fast   398G   216G   182G        -         -    55%    54%  1.00x    ONLINE  -
zroot       212G  33.3G   179G        -         -    25%    15%  1.00x    ONLINE  -
[slocum dan ~] % 

The system zpool is hard drives and I want to retire them from service (for reasons of noise, heat, and power).

These are the zpools in the other host r720-01:

[r720-01 dan ~] % zpool list
NAME        SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
data01     1.45T   571G   917G        -         -    62%    38%  1.00x    ONLINE  -
tank_fast   928G   328G   600G        -         -    51%    35%  1.00x    ONLINE  -
zroot      72.5G  36.3G  36.2G        -         -    53%    50%  1.00x    ONLINE  -

There is 1.45TB there, in the form of 8 x 500GB SSDs, in mirrored pairs. That still won’t give much free space.

[r720-01 dan ~] % zpool status data01
  pool: data01
 state: ONLINE
  scan: scrub repaired 0B in 00:22:54 with 0 errors on Mon Feb 20 03:36:10 2023
config:

	NAME           STATE     READ WRITE CKSUM
	data01         ONLINE       0     0     0
	  mirror-0     ONLINE       0     0     0
	    gpt/data1  ONLINE       0     0     0
	    gpt/data2  ONLINE       0     0     0
	  mirror-1     ONLINE       0     0     0
	    gpt/data3  ONLINE       0     0     0
	    gpt/data4  ONLINE       0     0     0
	  mirror-2     ONLINE       0     0     0
	    gpt/data5  ONLINE       0     0     0
	    gpt/data6  ONLINE       0     0     0
	  mirror-3     ONLINE       0     0     0
	    gpt/data7  ONLINE       0     0     0
	    gpt/data8  ONLINE       0     0     0

errors: No known data errors

If anything, I need to have free space to expand. Systems don’t generally use less data as time goes on. I’m hoping this system will be in use for another 3-6 years.

Shopping

I’d rather have raidz2 over mirrors. Just because that makes me feel safer.

I can get WD Blue SA510 1TB SSD 3D NAND SATA III 6Gb/s 2.5″ Internal Solid State Drive for $73 each. For $438 I’d have about 3TB of usable space (leaving 20% free) based on https://wintelguy.com/zfs-calc.pl.

I could double that space for $1020 by buying 6x Samsung 870 EVO 2TB SSD 3-bit MLC V-NAND SATA III 6Gb/s 2.5″ Internal Solid State Drive units (are those the ones with the recent firmware issues?).

Anyone want to fund me?

Website Pin Facebook Twitter Myspace Friendfeed Technorati del.icio.us Digg Google StumbleUpon Premium Responsive

Leave a Comment

Scroll to Top