Advanced Storage Monitoring
The Advanced Storage Monitoring (ASM) project is a Eurolab4HPC bilateral Academia-Industry Technology Transfer Project in HPC.
DDN offers a variety of enterprise storage products like the Infinite Memory Engine (IME). IME is designed as a burst-buffer which is optimized for random I/O. However, understanding the reasons that lead to observed performance behavior is non-trivial. Performance analysis of the I/O path in computer systems is a crucial task as it paves the way for subsequent optimization not only of applications but the storage stack itself. Particularly, the on-line analysis enables to detect miss-behaving situations and offers means to mitigate them. From the user-perspective non-intrusive monitoring, i.e., without code changes, is key for widespread adoption.
Contact Dr. Julian Kunkel
People from HPS
Consortium
- DDN France
- University of Reading
Goals
The goal of the project is to enhance the monitor capabilities of FUSE clients' as follows:
- incorporate relevant performance counters into the FUSE module
- enable fine-grained online monitoring in the module supporting parallel applications
- evaluate the extended module on relevant I/O benchmarks.
Ultimately, this will lead to a prototype and proof-of-concept system with the extended monitoring capabilities that exhibit substantial better analytic capabilities.