I would recommend you get NVMe boot working with a standard Raspberry Pi OS image on one of the NVMe drives first before you try complicating it with ZFS.
And if you're new to ZFS then I suggest you get familiar with that first, before attempting to use it as a root filesystem. Getting ZFS working on Raspberry Pi OS is fairly easy if you're not using it for your root filesystem.
I've no idea how easy it is to get a ZFS root filesystem working on a Raspberry Pi, but I expect it is rather more difficult. Ubuntu on x86-64 will install to a ZFS root, but the Raspberry Pi version of Ubuntu just has a disk image with the boot and root filesystems preinstalled that you image to a drive. Taking a quick look at the procedure someone has developed for getting Ubuntu 22.04 installed on a ZFS root (https://openzfs.github.io/openzfs-docs/ ... 20ZFS.html), I don't like your chances - it looks rather too complicated for my liking. (See also https://github.com/openzfs/zfs/discussions/16120 for Ubuntu 24.04 related info). There's also https://openzfs.github.io/openzfs-docs/ ... 20ZFS.html which is for Debian on a ZFS root, which is much closer to Raspberry Pi OS 64-bit.
Those instructions say you need two ZFS pools - one for boot, the other for root. Swap on openZFS (i.e. anything other than Oracle's closed source version of ZFS) is problematic, so that needs its own partition instead. For a minimal ZFS root setup, you would therefore end up with a single drive with two zpools and a separate swap partition on it - not exactly ideal.
TLDR: I suggest you stick with the boot filesystem (/boot/firmware) on FAT and root on ext4.
And if you're new to ZFS then I suggest you get familiar with that first, before attempting to use it as a root filesystem. Getting ZFS working on Raspberry Pi OS is fairly easy if you're not using it for your root filesystem.
I've no idea how easy it is to get a ZFS root filesystem working on a Raspberry Pi, but I expect it is rather more difficult. Ubuntu on x86-64 will install to a ZFS root, but the Raspberry Pi version of Ubuntu just has a disk image with the boot and root filesystems preinstalled that you image to a drive. Taking a quick look at the procedure someone has developed for getting Ubuntu 22.04 installed on a ZFS root (https://openzfs.github.io/openzfs-docs/ ... 20ZFS.html), I don't like your chances - it looks rather too complicated for my liking. (See also https://github.com/openzfs/zfs/discussions/16120 for Ubuntu 24.04 related info). There's also https://openzfs.github.io/openzfs-docs/ ... 20ZFS.html which is for Debian on a ZFS root, which is much closer to Raspberry Pi OS 64-bit.
Those instructions say you need two ZFS pools - one for boot, the other for root. Swap on openZFS (i.e. anything other than Oracle's closed source version of ZFS) is problematic, so that needs its own partition instead. For a minimal ZFS root setup, you would therefore end up with a single drive with two zpools and a separate swap partition on it - not exactly ideal.
TLDR: I suggest you stick with the boot filesystem (/boot/firmware) on FAT and root on ext4.
Statistics: Posted by andrum99 — Tue Jun 25, 2024 12:56 am