Advanced Storage Monitoring

The Advanced Storage Monitoring (ASM) project is a Eurolab4HPC bilateral Academia-Industry Technology Transfer Projects in HPC.

DDN offers a variety of enterprise storage products like the Infinite Memory Engine (IME). IME is designed as a burst-buffer which is optimized for random I/O. However, understanding the reasons that lead to observed performance behavior is non-trivial. Performance analysis of the I/O path in computer systems is a crucial task as it paves the way for subsequent optimization not only of applications but the storage stack itself. Particularly, the on-line analysis enables to detect miss-behaving situations and offers means to mitigate them. From the user-perspective non-intrusive monitoring, i.e., without code changes, is key for widespread adoption.

Contact Dr. Julian Kunkel

Consortium

  • DDN France
  • University of Reading

Goal of the project is to enhance the monitor capabilities in DDN’s IME FUSE client as follows:

  1. incorporate relevant performance counters into the FUSE module
  2. enable a fine-grained on-line monitoring in the module supporting parallel applications
  3. evaluate the extended module on relevant I/O benchmarks.

Ultimately, this will lead to a prototype and proof-of-concept system with the extended monitoring capabilities that exhibit substantial better analytic capabilities.