Messenger notes

Messenger is the Ceph network layer implementation. Currently Ceph supportsone messenger type: “async”.

ceph_perf_msgr

ceph_perf_msgr is used to do benchmark for messenger module only and can helpto find the bottleneck or time consuming within messenger moduleIt just like“iperf”, we need to start server-side program firstly:

./ceph_perf_msgr_server 172.16.30.181:10001 1 0

The first argument is ip:port pair which is telling the destination address theclient need to specified. The second argument configures the server threads. Thethird argument tells the “think time”(us) when dispatching messages. After Giant,CEPH_OSD_OP message which is the actual client read/write io request is fastdispatched without queueing to Dispatcher, in order to achieve better performance.So CEPH_OSD_OP message will be processed inline, “think time” is used by mockthis “inline process” process.

./ceph_perf_msgr_client 172.16.30.181:10001 1 32 10000 10 4096

The first argument is specified the server ip:port, and the second argument isused to specify client threads. The third argument specify the concurrency(themax inflight messages for each client thread), the fourth argument specify theio numbers will be issued to server per client thread. The fifth argument isused to indicate the “think time” for client thread when receiving messages,this is also used to mock the client fast dispatch process. The last argumentspecify the message data length to issue.