FreeBSD Implementation details

Disk layout

Current implementation works on ZFS pools

  • created in /var/lib/ceph

  • One ZFS pool per OSD, like:

  1. gpart create -s GPT ada1
  2. gpart add -t freebsd-zfs -l osd1 ada1
  3. zpool create -o mountpoint=/var/lib/ceph/osd/osd.1 osd
  • Maybe add some cache and log (ZIL)? Assuming that ada2 is an SSD:
  1. gpart create -s GPT ada2
  2. gpart add -t freebsd-zfs -l osd1-log -s 1G ada2
  3. zpool add osd1 log gpt/osd1-log
  4. gpart add -t freebsd-zfs -l osd1-cache -s 10G ada2
  5. zpool add osd1 log gpt/osd1-cache
  • Note: UFS2 does not allow large xattribs

Configuration

As per FreeBSD default parts of extra software go into /usr/local/. Whichmeans that for /etc/ceph.conf the default location is/usr/local/etc/ceph/ceph.conf. Smartest thing to do is to create a softlinkfrom /etc/ceph to /usr/local/etc/ceph:

  1. ln -s /usr/local/etc/ceph /etc/ceph

A sample file is provided in /usr/local/share/doc/ceph/sample.ceph.conf

MON creation

Monitors are created by following the manual creation steps on:

  1. http://docs.ceph.com/docs/master/install/manual-deployment/

OSD creation

OSDs can be manually created only, see Adding OSDs