ISC'14

June 22–26, 2014
Leipzig, Germany

Presentation Details

 
Name: (10) Performance Implications of NUMA & Multi-Core in Lustre's Metadata Server
 
Time: Monday, June 23, 2014
05:25 pm - 05:32 pm
 
Room:   Hall 4
CCL - Congress Center Leipzig
 
Speaker:   Konstantinos Chasapis, University of Hamburg
 
Abstract:   The performance of metadata operations in Parallel File System can be crucial to overall application performance. During the last decade we reached the clock frequency wall of the CPU. Multi-core and multi-socket machines are used to improve the computation power of the servers. However, these technologies arise two main obstacles: i) synchronization between different processes and also the Non-uniform memory access (NUMA).
In this work we evaluate the performance implications of NUMA and Multi-core in Lustre's metadata server (MDS), that is the most commonly used parallel file system in the top500. Lustre 2.3 version included optimization's for multi-core architectures and at 2.4 version support for multiple MDS was added (place directories in different MDS). However, the number of operations executed within a single directory is still limited by the performance of a single MDS that is also the target of our evaluation.
We use mdtest benchmark to stress Lustre's MDS and we run our experiments in a single and a multi-socket server. Our evaluation includes several configurations aimed to spot performance inefficiencies of Lustre MDS. From our results we can conclude that Lustre's MDS performance can be improved with multi-core CPUs but it is not ready yet for multi-socket servers.

Authors
Konstantinos Chasapis, Michael Kuhn & Thomas Ludwig, University of Hamburg

Contact
Konstantinos Chasapis: konstantinos.chasapis@informatik.uni-hamburg.de

Download
(10) Poster