June 22–26, 2014
Leipzig, Germany

Presentation Details

Name: (10) Performance Implications of NUMA & Multi-Core in Lustre's Metadata Server
Time: Monday, June 23, 2014
05:25 pm - 05:32 pm
Room:   Hall 4
CCL - Congress Center Leipzig
Speaker:   Konstantinos Chasapis, University of Hamburg
Abstract:   The performance of metadata operations in Parallel File System can be crucial to overall application performance. During the last decade we reached the clock frequency wall of the CPU. Multi-core and multi-socket machines are used to improve the computation power of the servers. However, these technologies arise two main obstacles: i) synchronization between different processes and also the Non-uniform memory access (NUMA).
In this work we evaluate the performance implications of NUMA and Multi-core in Lustre's metadata server (MDS), that is the most commonly used parallel file system in the top500. Lustre 2.3 version included optimization's for multi-core architectures and at 2.4 version support for multiple MDS was added (place directories in different MDS). However, the number of operations executed within a single directory is still limited by the performance of a single MDS that is also the target of our evaluation.
We use mdtest benchmark to stress Lustre's MDS and we run our experiments in a single and a multi-socket server. Our evaluation includes several configurations aimed to spot performance inefficiencies of Lustre MDS. From our results we can conclude that Lustre's MDS performance can be improved with multi-core CPUs but it is not ready yet for multi-socket servers.

Konstantinos Chasapis, Michael Kuhn & Thomas Ludwig, University of Hamburg

Konstantinos Chasapis:

(10) Poster