Tuning ZFS for FDB

Snowflake is evaluating ZFS as a means of providing snapshots for FoundationDB. Because using ZFS will come at a performance cost, we’re interested in how to tune ZFS to minimize that cost.

We’re interested in hearing from anyone has run FDB on ZFS.

  • What sort of tunables did you set?
    • logbias? primarycache? recordsize?
    • How do you manage the tradeoff between ARC size and FDB’s page cache?
  • What does your pool layout look like?
    • Since we are only interested in snapshots, we’re looking at using a separate zpool per disk.