Maybe I need another zpool

I might need to create another zpool. Or perhaps move a drives/zpool from one host to another.

In this post:

  1. FreeBSD 13.1

Background

I am combining two hosts (slocum and r720-01) into one new host (r730-01). I have been moving jails from those hosts. I have an ansible playbook for creating new entries in /etc/jail.conf.d/.

I thought I had the space calculations done right. Now I think I’m wrong.I’m already at 73% on the 5.8TB pool:

[r730-01 dvl ~] % zpool list
NAME     SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
data01  5.81T  4.26T  1.56T        -         -     3%    73%  1.00x    ONLINE  -
data02  1.73T   360G  1.38T        -         -     0%    20%  1.00x    ONLINE  -
zroot    424G  2.14G   422G        -         -     0%     0%  1.00x    ONLINE  -
[r730-01 dvl ~] % 

I still have the FreshPorts development jails and the database server to migrate to this host:

[r720-01 dan ~] % zfs list | grep pg02
NAME                                           USED  AVAIL     REFER  MOUNTPOINT
data01/pg02                                    541G   873G       88K  none
data01/pg02/dan                                 96K   873G       96K  none
data01/pg02/postgres                           501G   873G      320G  /jails/pg02/var/db/postgres
data01/pg02/rsyncer                           39.9G   873G     6.65G  /jails/pg02/usr/home/rsyncer/backups
tank_fast/dan_pg02                            3.19G   571G       96K  /jails/pg02/root/DUMPING
tank_fast/jails/pg02                          21.6G   571G     7.80G  /jails/pg02

That’s about 560GB for for the database server.

Next, we have the FreshPorts websites/data:

[slocum dan ~] % zfs list | grep freshports
NAME                                                                    USED  AVAIL     REFER  MOUNTPOINT
nvd/freshports                                                          285G   616G       23K  none
nvd/freshports/dan                                                     38.9M   616G     38.9M  none
nvd/freshports/dev                                                     5.33G   616G       23K  /jails/dev-ingress01/var/db/freshports
nvd/freshports/dev-nginx01                                             40.0M   616G       24K  none
nvd/freshports/dev-nginx01/var                                         40.0M   616G       24K  none
nvd/freshports/dev-nginx01/var/db                                      40.0M   616G       24K  none
nvd/freshports/dev-nginx01/var/db/freshports                           39.9M   616G       24K  none
nvd/freshports/dev-nginx01/var/db/freshports/cache                     39.9M   616G       24K  /var/db/freshports/cache
nvd/freshports/dev-nginx01/var/db/freshports/cache/categories            48K   616G       33K  /var/db/freshports/cache/categories
nvd/freshports/dev-nginx01/var/db/freshports/cache/commits             28.2M   616G     28.2M  /var/db/freshports/cache/commits
nvd/freshports/dev-nginx01/var/db/freshports/cache/daily                523K   616G      508K  /var/db/freshports/cache/daily
nvd/freshports/dev-nginx01/var/db/freshports/cache/general               38K   616G       24K  /var/db/freshports/cache/general
nvd/freshports/dev-nginx01/var/db/freshports/cache/news                 299K   616G      284K  /var/db/freshports/cache/news
nvd/freshports/dev-nginx01/var/db/freshports/cache/packages              24K   616G       24K  /var/db/freshports/cache/packages
nvd/freshports/dev-nginx01/var/db/freshports/cache/pages                 38K   616G       24K  /var/db/freshports/cache/pages
nvd/freshports/dev-nginx01/var/db/freshports/cache/ports               10.7M   616G     10.6M  /var/db/freshports/cache/ports
nvd/freshports/dev-nginx01/var/db/freshports/cache/spooling              61K   616G       35K  /var/db/freshports/cache/spooling
nvd/freshports/dev/cache                                                138K   616G     35.5K  /jails/dev-ingress01/var/db/freshports/cache
nvd/freshports/dev/cache/html                                          74.5K   616G     74.5K  /jails/dev-ingress01/var/db/freshports/cache/html
nvd/freshports/dev/cache/spooling                                        28K   616G       28K  /jails/dev-ingress01/var/db/freshports/cache/spooling
nvd/freshports/dev/ingress                                             5.31G   616G       23K  /jails/dev-ingress01/var/db/ingress
nvd/freshports/dev/ingress/message-queues                              1.86M   616G     1.33M  /jails/dev-ingress01/var/db/ingress/message-queues
nvd/freshports/dev/ingress/repos                                       5.31G   616G     2.37G  /jails/dev-ingress01/var/db/ingress/repos
nvd/freshports/dev/ingress/repos/src                                   2.94G   616G     2.94G  /jails/dev-ingress01/var/db/ingress/repos/src
nvd/freshports/dev/message-queues                                      20.3M   616G     19.2M  /jails/dev-ingress01/var/db/freshports/message-queues
nvd/freshports/jailed                                                   266G   616G       24K  none
nvd/freshports/jailed/dev-ingress01                                    89.2G   616G       24K  none
nvd/freshports/jailed/dev-ingress01/jails                              88.8G   616G       24K  /jails
nvd/freshports/jailed/dev-ingress01/jails/freshports                   88.8G   616G     88.8G  /jails/freshports
nvd/freshports/jailed/dev-ingress01/mkjail                              340M   616G      340M  /var/db/mkjail
nvd/freshports/jailed/stage-ingress01                                  88.6G   616G       24K  none
nvd/freshports/jailed/stage-ingress01/jails                            88.2G   616G       24K  /jails
nvd/freshports/jailed/stage-ingress01/jails/freshports                 88.2G   616G     88.2G  /jails/freshports
nvd/freshports/jailed/stage-ingress01/mkjail                            340M   616G      340M  /var/db/mkjail
nvd/freshports/jailed/test-ingress01                                   88.6G   616G       24K  none
nvd/freshports/jailed/test-ingress01/jails                             88.3G   616G       24K  /jails
nvd/freshports/jailed/test-ingress01/jails/freshports                  88.3G   616G     88.3G  /jails/freshports
nvd/freshports/jailed/test-ingress01/mkjail                             340M   616G      340M  /var/db/mkjail
nvd/freshports/mobile-nginx01                                           462K   616G       24K  none
nvd/freshports/mobile-nginx01/var                                       438K   616G       24K  none
nvd/freshports/mobile-nginx01/var/db                                    414K   616G       24K  none
nvd/freshports/mobile-nginx01/var/db/freshports                         390K   616G       24K  none
nvd/freshports/mobile-nginx01/var/db/freshports/cache                   366K   616G       24K  /var/db/freshports/cache
nvd/freshports/mobile-nginx01/var/db/freshports/cache/categories         38K   616G       24K  /var/db/freshports/cache/categories
nvd/freshports/mobile-nginx01/var/db/freshports/cache/commits            38K   616G       24K  /var/db/freshports/cache/commits
nvd/freshports/mobile-nginx01/var/db/freshports/cache/daily              38K   616G       24K  /var/db/freshports/cache/daily
nvd/freshports/mobile-nginx01/var/db/freshports/cache/general            38K   616G       24K  /var/db/freshports/cache/general
nvd/freshports/mobile-nginx01/var/db/freshports/cache/news               38K   616G       24K  /var/db/freshports/cache/news
nvd/freshports/mobile-nginx01/var/db/freshports/cache/packages           38K   616G       24K  /var/db/freshports/cache/packages
nvd/freshports/mobile-nginx01/var/db/freshports/cache/pages              38K   616G       24K  /var/db/freshports/cache/pages
nvd/freshports/mobile-nginx01/var/db/freshports/cache/ports              38K   616G       24K  /var/db/freshports/cache/ports
nvd/freshports/mobile-nginx01/var/db/freshports/cache/spooling           38K   616G       24K  /var/db/freshports/cache/spooling
nvd/freshports/stage-ingress01                                         5.15G   616G       24K  none
nvd/freshports/stage-ingress01/var                                     5.15G   616G       24K  none
nvd/freshports/stage-ingress01/var/db                                  5.15G   616G       24K  none
nvd/freshports/stage-ingress01/var/db/freshports                       18.9M   616G       24K  /jails/stage-ingress01/var/db/freshports
nvd/freshports/stage-ingress01/var/db/freshports/cache                  156K   616G       24K  /jails/stage-ingress01/var/db/freshports/cache
nvd/freshports/stage-ingress01/var/db/freshports/cache/html            86.5K   616G     71.5K  /jails/stage-ingress01/var/db/freshports/cache/html
nvd/freshports/stage-ingress01/var/db/freshports/cache/spooling          46K   616G       46K  /jails/stage-ingress01/var/db/freshports/cache/spooling
nvd/freshports/stage-ingress01/var/db/freshports/message-queues        18.7M   616G     17.6M  /jails/stage-ingress01/var/db/freshports/message-queues
nvd/freshports/stage-ingress01/var/db/ingress                          5.13G   616G       24K  /jails/stage-ingress01/var/db/ingress
nvd/freshports/stage-ingress01/var/db/ingress/message-queues           1.45M   616G      960K  /jails/stage-ingress01/var/db/ingress/message-queues
nvd/freshports/stage-ingress01/var/db/ingress/repos                    5.13G   616G     5.12G  /jails/stage-ingress01/var/db/ingress/repos
nvd/freshports/stage-nginx01                                           39.0M   616G       24K  none
nvd/freshports/stage-nginx01/var                                       39.0M   616G       24K  none
nvd/freshports/stage-nginx01/var/db                                    38.9M   616G       24K  none
nvd/freshports/stage-nginx01/var/db/freshports                         38.9M   616G       24K  none
nvd/freshports/stage-nginx01/var/db/freshports/cache                   38.9M   616G       24K  /var/db/freshports/cache
nvd/freshports/stage-nginx01/var/db/freshports/cache/categories          43K   616G       28K  /var/db/freshports/cache/categories
nvd/freshports/stage-nginx01/var/db/freshports/cache/commits           34.4M   616G     34.4M  /var/db/freshports/cache/commits
nvd/freshports/stage-nginx01/var/db/freshports/cache/daily              528K   616G      512K  /var/db/freshports/cache/daily
nvd/freshports/stage-nginx01/var/db/freshports/cache/general             38K   616G       24K  /var/db/freshports/cache/general
nvd/freshports/stage-nginx01/var/db/freshports/cache/news               299K   616G      284K  /var/db/freshports/cache/news
nvd/freshports/stage-nginx01/var/db/freshports/cache/packages            24K   616G       24K  /var/db/freshports/cache/packages
nvd/freshports/stage-nginx01/var/db/freshports/cache/pages               38K   616G       24K  /var/db/freshports/cache/pages
nvd/freshports/stage-nginx01/var/db/freshports/cache/ports             3.47M   616G     3.46M  /var/db/freshports/cache/ports
nvd/freshports/stage-nginx01/var/db/freshports/cache/spooling            59K   616G       34K  /var/db/freshports/cache/spooling
nvd/freshports/test-ingress01                                          8.11G   616G       24K  none
nvd/freshports/test-ingress01/var                                      8.11G   616G       24K  none
nvd/freshports/test-ingress01/var/db                                   8.11G   616G       24K  none
nvd/freshports/test-ingress01/var/db/freshports                        10.2M   616G       24K  none
nvd/freshports/test-ingress01/var/db/freshports/cache                   146K   616G       24K  /jails/test-ingress01/var/db/freshports/cache
nvd/freshports/test-ingress01/var/db/freshports/cache/html             74.5K   616G     74.5K  /jails/test-ingress01/var/db/freshports/cache/html
nvd/freshports/test-ingress01/var/db/freshports/cache/spooling           47K   616G       47K  /jails/test-ingress01/var/db/freshports/cache/spooling
nvd/freshports/test-ingress01/var/db/freshports/message-queues         10.1M   616G     9.01M  /jails/test-ingress01/var/db/freshports/message-queues
nvd/freshports/test-ingress01/var/db/ingress                           8.10G   616G       24K  /jails/test-ingress01/var/db/ingress
nvd/freshports/test-ingress01/var/db/ingress/message-queues            1.47M   616G      961K  /jails/test-ingress01/var/db/ingress/message-queues
nvd/freshports/test-ingress01/var/db/ingress/repos                     8.10G   616G     5.20G  /jails/test-ingress01/var/db/ingress/repos
nvd/freshports/test-nginx01                                            36.2M   616G       24K  none
nvd/freshports/test-nginx01/var                                        36.1M   616G       24K  none
nvd/freshports/test-nginx01/var/db                                     36.1M   616G       24K  none
nvd/freshports/test-nginx01/var/db/freshports                          36.1M   616G       24K  none
nvd/freshports/test-nginx01/var/db/freshports/cache                    36.1M   616G       24K  /var/db/freshports/cache
nvd/freshports/test-nginx01/var/db/freshports/cache/categories           42K   616G       27K  /var/db/freshports/cache/categories
nvd/freshports/test-nginx01/var/db/freshports/cache/commits            31.8M   616G     31.8M  /var/db/freshports/cache/commits
nvd/freshports/test-nginx01/var/db/freshports/cache/daily               534K   616G      519K  /var/db/freshports/cache/daily
nvd/freshports/test-nginx01/var/db/freshports/cache/general              70K   616G       45K  /var/db/freshports/cache/general
nvd/freshports/test-nginx01/var/db/freshports/cache/news                299K   616G      284K  /var/db/freshports/cache/news
nvd/freshports/test-nginx01/var/db/freshports/cache/packages             24K   616G       24K  /var/db/freshports/cache/packages
nvd/freshports/test-nginx01/var/db/freshports/cache/pages                38K   616G       24K  /var/db/freshports/cache/pages
nvd/freshports/test-nginx01/var/db/freshports/cache/ports              3.23M   616G     3.22M  /var/db/freshports/cache/ports
nvd/freshports/test-nginx01/var/db/freshports/cache/spooling             59K   616G       34K  /var/db/freshports/cache/spooling
system/data/freshports-cache                                            927K  15.0T      176K  none
system/data/freshports-cache/dev-nginx01                                751K  15.0T      176K  none
system/data/freshports-cache/dev-nginx01/packages                       288K  15.0T      176K  /var/db/freshports/cache/packages
system/data/freshports-cache/dev-nginx01/ports                          288K  15.0T      176K  /var/db/freshports/cache/ports
system/data/jail_within_jail/jails/freshports                           620M  15.0T      620M  /jails/freshports
tank_fast/data/dev-ingress01/messages/archive                          13.5G   170G     13.5G  /jails/dev-ingress01/var/db/freshports/message-queues/archive
tank_fast/data/dev-ingress01/usr.local.libexec.freshports              2.23M   170G     2.23M  /jails/dev-ingress01/usr/local/libexec/freshports
tank_fast/data/dev-nginx01/usr/local/www/freshports                    42.0M   170G     41.7M  /jails/dev-nginx01/usr/local/www/freshports
tank_fast/data/dev-nginx01/usr/local/www/freshports-git-branch         15.6M   170G     15.6M  /jails/dev-nginx01/usr/local/www/freshports-git-branch
tank_fast/data/stage-ingress01/messages/archive                        11.4G   170G     11.4G  /jails/stage-ingress01/var/db/freshports/message-queues/archive
tank_fast/data/test-ingress01/messages/archive                         11.9G   170G     11.9G  /jails/test-ingress01/var/db/freshports/message-queues/archive
tank_fast/freshports                                                     88K   170G       88K  none

That’s roughly 320G.

For a total of about 880GB

That will take both of the existing zpools to pretty close to 80%. I need more space.

Filesystems on r730-01

This is what exists on the new host now:

[r730-01 dvl ~] % zfs list
NAME                                       USED  AVAIL     REFER  MOUNTPOINT
data01                                    3.03T  1005G      205K  none
data01/acme-certs                         30.2M  1005G      188K  none
data01/acme-certs/certs                   16.4M  1005G     13.6M  /jails/certs/var/db/acme/certs
data01/acme-certs/certs-for-rsync         13.6M  1005G     8.29M  /jails/certs/var/db/certs-for-rsync
data01/bacula                             1.97T  1005G      188K  /jails/bacula-sd-03/usr/local/bacula
data01/bacula/volumes                     1.97T  1005G      205K  /jails/bacula-sd-03/usr/local/bacula/volumes
data01/bacula/volumes/DiffFile-03          404G  1005G      404G  /jails/bacula-sd-03/usr/local/bacula/volumes/DiffFile-03
data01/bacula/volumes/FullFile-03         1.09T  1005G     1.04T  /jails/bacula-sd-03/usr/local/bacula/volumes/FullFile-03
data01/bacula/volumes/IncrFile-03          492G  1005G      492G  /jails/bacula-sd-03/usr/local/bacula/volumes/IncrFile-03
data01/bacula/working                      623K  1005G      247K  /jails/bacula-sd-03/usr/local/bacula/working
data01/certs-rsync                        7.01G  1005G     4.42G  none
data01/jail-testing                       1.85G  1005G      205K  none
data01/jail-testing/jails                  704M  1005G      222K  /jails
data01/jail-testing/jails/foo              704M  1005G      704M  /jails/foo
data01/jail-testing/mkjail                1.16G  1005G      205K  /jails/mkjail
data01/jail-testing/mkjail/12.2-RELEASE   1.16G  1005G     1.16G  /jails/mkjail/12.2-RELEASE
data01/jail_within_jail                    956M  1005G      205K  none
data01/jail_within_jail/jails              617M  1005G      205K  none
data01/jail_within_jail/jails/freshports   617M  1005G      617M  none
data01/jail_within_jail/mkjail             339M  1005G      339M  none
data01/librenms-rrd                       54.1G  1005G     4.50G  /jails/besser/var/db/librenms/rrd
data01/pg03                               27.8G  1005G      188K  none
data01/pg03/postgres                      27.8G  1005G     27.8G  /jails/pg03/var/db/postgres
data01/pg03/rsyncer                       1.89M  1005G      222K  /jails/pg03/usr/home/rsyncer/backups
data01/poudriere                           271G  1005G      239K  /usr/local/poudriere
data01/poudriere/ccache.13amd64            205K  1005G      205K  /usr/local/poudriere/ccache.13amd64
data01/poudriere/ccache.13i386             205K  1005G      205K  /usr/local/poudriere/ccache.13i386
data01/poudriere/ccache.amd64             6.08G  1005G     34.6M  /usr/local/poudriere/ccache.amd64
data01/poudriere/ccache.i386              9.27G  1005G     6.07G  /usr/local/poudriere/ccache.i386
data01/poudriere/data                     85.3G  1005G     18.2G  /usr/local/poudriere/data
data01/poudriere/data/cache                210M  1005G     71.2M  /usr/local/poudriere/data/cache
data01/poudriere/data/cronjob-logs        10.6M  1005G     2.89M  /usr/local/poudriere/data/cronjob-logs
data01/poudriere/data/packages            53.6G  1005G     24.4G  /usr/local/poudriere/data/packages
data01/poudriere/distfiles                67.8G  1005G     67.6G  /usr/ports/distfiles
data01/poudriere/distfiles.new            67.5G  1005G     67.5G  /usr/local/poudriere/distfiles.new
data01/poudriere/jails                    13.0G  1005G      239K  /usr/local/poudriere/jails
data01/poudriere/jails/114R               1.76G  1005G     1.76G  /usr/local/poudriere/jails/114R
data01/poudriere/jails/121amd64           2.00G  1005G     2.00G  /usr/local/poudriere/jails/121amd64
data01/poudriere/jails/121i386            1.73G  1005G     1.73G  /usr/local/poudriere/jails/121i386
data01/poudriere/jails/131amd64           2.04G  1005G     2.04G  /usr/local/poudriere/jails/131amd64
data01/poudriere/jails/131i386            1.72G  1005G     1.72G  /usr/local/poudriere/jails/131i386
data01/poudriere/jails/13amd64            2.04G  1005G     2.04G  /usr/local/poudriere/jails/13amd64
data01/poudriere/jails/13i386             1.72G  1005G     1.72G  /usr/local/poudriere/jails/13i386
data01/poudriere/ports                    22.0G  1005G      188K  /usr/local/poudriere/ports
data01/poudriere/ports/default            5.17G  1005G     3.09G  /usr/local/poudriere/ports/default
data01/poudriere/ports/main               2.55G  1005G     2.40G  /usr/local/poudriere/ports/main
data01/poudriere/ports/testing            14.2G  1005G     3.07G  /usr/local/poudriere/ports/testing
data01/poudriere/test                      478K  1005G      205K  /usr/local/poudriere/test
data01/repos                              8.09G  1005G      188K  none
data01/repos/gitea                         219M  1005G      196M  /jails/git/var/db/gitea
data01/repos/subversion                   7.88G  1005G     7.85G  /jails/svn/usr/local/svn/repos
data01/samba                               700G  1005G      222K  /jails/fileserver/usr/local/samba
data01/samba/dan                           260G  1005G      260G  /jails/fileserver/usr/local/samba/dan
data01/samba/public                       21.0G  1005G     21.0G  /jails/fileserver/usr/local/samba/public
data01/samba/transfer                     1.48G  1005G     1.48G  /jails/fileserver/usr/local/samba/transfer
data01/samba/video                         417G  1005G      417G  /data/video
data01/syncthing                          14.0G  1005G     13.1G  /jails/fileserver/usr/local/syncthing
data02                                     360G  1.33T       96K  none
data02/data                               1.65G  1.33T       96K  none
data02/data/mydev                         1.65G  1.33T     1.65G  none
data02/jails                               358G  1.33T      232K  /jails
data02/jails/bacula                       22.1G  1.33T     19.9G  /jails/bacula
data02/jails/bacula-sd-02                 7.93G  1.33T     5.30G  /jails/bacula-sd-02
data02/jails/bacula-sd-03                 7.68G  1.33T     5.41G  /jails/bacula-sd-03
data02/jails/besser                       21.5G  1.33T     18.1G  /jails/besser
data02/jails/certs                        4.03G  1.33T     3.97G  /jails/certs
data02/jails/certs-rsync                  3.60G  1.33T     3.55G  /jails/certs-rsync
data02/jails/cliff2                       6.67G  1.33T     4.56G  /jails/cliff2
data02/jails/dev-ingress01                5.49G  1.33T     5.49G  /jails/dev-ingress01
data02/jails/dev-nginx01                  4.40G  1.33T     4.39G  /jails/dev-nginx01
data02/jails/dev-pgeu                     12.5G  1.33T     5.81G  /jails/dev-pgeu
data02/jails/dns-hidden-master            7.17G  1.33T     4.76G  /jails/dns-hidden-master
data02/jails/fileserver                   9.67G  1.33T     7.09G  /jails/fileserver
data02/jails/git                          9.30G  1.33T     4.94G  /jails/git
data02/jails/jail-testing                 3.66G  1.33T     1.85G  /jails/jail-testing
data02/jails/jail_within_jail             1.93G  1.33T      789M  /jails/jail_within_jail
data02/jails/keycloak                     16.2G  1.33T     13.0G  /jails/keycloak
data02/jails/mobile-nginx01               4.37G  1.33T     4.37G  /jails/mobile-nginx01
data02/jails/mqtt01                       8.10G  1.33T     5.34G  /jails/mqtt01
data02/jails/mydev                        14.1G  1.33T     6.71G  /jails/mydev
data02/jails/mysql01                      4.72G  1.33T     4.57G  /jails/mysql01
data02/jails/nsnotify                     6.70G  1.33T     4.33G  /jails/nsnotify
data02/jails/pg01                         14.5G  1.33T     11.3G  /jails/pg01
data02/jails/pg02                         22.3G  1.33T     7.88G  /jails/pg02
data02/jails/pg03                         22.5G  1.33T     5.75G  /jails/pg03
data02/jails/pkg01                        19.4G  1.33T     10.9G  /jails/pkg01
data02/jails/samdrucker                   8.23G  1.33T     5.77G  /jails/samdrucker
data02/jails/serpico                      7.87G  1.33T     5.28G  /jails/serpico
data02/jails/stage-ingress01              2.34G  1.33T     2.34G  /jails/stage-ingress01
data02/jails/stage-nginx01                1.55G  1.33T     1.55G  /jails/stage-nginx01
data02/jails/svn                          5.53G  1.33T     5.46G  /jails/svn
data02/jails/talos                        5.18G  1.33T     3.71G  /jails/talos
data02/jails/test-ingress01               4.11G  1.33T     4.11G  /jails/test-ingress01
data02/jails/test-nginx01                 1.66G  1.33T     1.66G  /jails/test-nginx01
data02/jails/unifi01                      35.7G  1.33T     9.56G  /jails/unifi01
data02/jails/webserver                    21.3G  1.33T     18.0G  /jails/webserver
data02/jails/zm                           4.11G  1.33T     1.90G  /jails/zm
zroot                                     2.14G   409G       96K  /zroot
zroot/ROOT                                2.04G   409G       96K  none
zroot/ROOT/before-jailhosts                  8K   409G     1.46G  /
zroot/ROOT/before-samdrucker                 8K   409G     1.45G  /
zroot/ROOT/default                        2.04G   409G     1.74G  /
zroot/ROOT/without-anvil                   496K   409G     1.45G  /
zroot/tmp                                 8.86M   409G      600K  /tmp
zroot/usr                                 18.5M   409G       96K  /usr
zroot/usr/home                            18.2M   409G     6.32M  /usr/home
zroot/usr/ports                             96K   409G       96K  /usr/ports
zroot/usr/src                               96K   409G       96K  /usr/src
zroot/var                                 17.0M   409G       96K  /var
zroot/var/audit                             96K   409G       96K  /var/audit
zroot/var/crash                             96K   409G       96K  /var/crash
zroot/var/log                             14.0M   409G     1.48M  /var/log
zroot/var/mail                             608K   409G      168K  /var/mail
zroot/var/tmp                             2.07M   409G      412K  /var/tmp

I was trying to keep all jails in data01 and the data used by those jails in data01.

zpools in the old hosts

These are the zpools in slocum:

[slocum dan ~] % zpool list
NAME        SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
nvd         930G   285G   645G        -         -    19%    30%  1.00x    ONLINE  -
system     27.2T  4.51T  22.7T        -         -    24%    16%  1.00x    ONLINE  -
tank_fast   398G   216G   182G        -         -    55%    54%  1.00x    ONLINE  -
zroot       212G  33.3G   179G        -         -    25%    15%  1.00x    ONLINE  -
[slocum dan ~] % 

The system zpool is hard drives and I want to retire them from service (for reasons of noise, heat, and power).

These are the zpools in the other host r720-01:

[r720-01 dan ~] % zpool list
NAME        SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
data01     1.45T   571G   917G        -         -    62%    38%  1.00x    ONLINE  -
tank_fast   928G   328G   600G        -         -    51%    35%  1.00x    ONLINE  -
zroot      72.5G  36.3G  36.2G        -         -    53%    50%  1.00x    ONLINE  -

There is 1.45TB there, in the form of 8 x 500GB SSDs, in mirrored pairs. That still won’t give much free space.

[r720-01 dan ~] % zpool status data01
  pool: data01
 state: ONLINE
  scan: scrub repaired 0B in 00:22:54 with 0 errors on Mon Feb 20 03:36:10 2023
config:

	NAME           STATE     READ WRITE CKSUM
	data01         ONLINE       0     0     0
	  mirror-0     ONLINE       0     0     0
	    gpt/data1  ONLINE       0     0     0
	    gpt/data2  ONLINE       0     0     0
	  mirror-1     ONLINE       0     0     0
	    gpt/data3  ONLINE       0     0     0
	    gpt/data4  ONLINE       0     0     0
	  mirror-2     ONLINE       0     0     0
	    gpt/data5  ONLINE       0     0     0
	    gpt/data6  ONLINE       0     0     0
	  mirror-3     ONLINE       0     0     0
	    gpt/data7  ONLINE       0     0     0
	    gpt/data8  ONLINE       0     0     0

errors: No known data errors

If anything, I need to have free space to expand. Systems don’t generally use less data as time goes on. I’m hoping this system will be in use for another 3-6 years.

Shopping

I’d rather have raidz2 over mirrors. Just because that makes me feel safer.

I can get WD Blue SA510 1TB SSD 3D NAND SATA III 6Gb/s 2.5″ Internal Solid State Drive for $73 each. For $438 I’d have about 3TB of usable space (leaving 20% free) based on https://wintelguy.com/zfs-calc.pl.

I could double that space for $1020 by buying 6x Samsung 870 EVO 2TB SSD 3-bit MLC V-NAND SATA III 6Gb/s 2.5″ Internal Solid State Drive units (are those the ones with the recent firmware issues?).

Anyone want to fund me?

Leave a Comment

Scroll to Top