====== BoF: Analyzing Parallel I/O ====== ===== Abstract ===== Parallel I/O performance can be a critical bottleneck for applications, yet users are often ill-equipped for identifying and diagnosing I/O performance issues. Increasingly complex hierarchies of storage hardware and software deployed on many systems only compound this problem. Tools that can effectively capture, analyze, and tune I/O behavior for these systems empower users to realize performance gains for many applications. In this BoF, we form a community around best practices in analyzing parallel I/O and cover recent advances to help address the problem presented above, drawing on the expertise of users, I/O researchers, and administrators in attendance. The primary objectives of this BoF are to: 1) highlight recent advances in tools and techniques for monitoring I/O activity in data centers, 2) to discuss experiences and limitations of current approaches, 3) to discuss and derive a roadmap for future I/O tools with the goal to capture, assess, predict and optimize I/O. The BoF is held in conjunction with the [[http://sc21.supercomputing.org/|Supercomputing conference]]. The [[https://sc21.supercomputing.org/presentation/?id=bof116&sess=sess363|official announcement is listed here]]. || Date || Tuesday, 16 November 2021 || || Time || 5:15pm-6:45pm CST || || Venue || Online, see the SC schedule for details || The BoF is powered by the [[https://www.vi4io.org|Virtual Institute for I/O]] and [[http://www.esiwace.eu|ESiWACE]] ((ESiWACE has received funding from the European Union’s Horizon 2020 Research and Innovation Programme under Grant Agreement No 823988)). {{:events:2017:vi4io.png?200&nolink|}} \w {{:research:projects:esiwace-logo.png?300&nolink|}} ===== Organization ===== The BoF is organized by * Shane Snyder (ANL, USA), [[ssnyder@mcs.anl.gov]] * [[about:people:julian_kunkel|Julian Kunkel]] (Georg-August-Universität Göttingen/GWDG), [[julian.kunkel@gwdg.de]] ===== Agenda ===== We have a series of (8 minute) talks followed by a longer discussion: * **Welcome** -- //Julian Kunkel, Shane Snyder// * **Introduction** -- //Shane Snyder// \\ {{ :events:2021:21-bof-analyzing-intro.pdf |Slides}} * **Darshan tracing visualizing** -- //Jean Luca Bez// \\ {{ :events:2021:21-bof-analyzing-jeanluca.pdf |Slides}} * **Experience with the NERSC all-flash system** -- //Glenn Lockwood, Alberto Chiusole// \\ {{ :events:2021:21-bof-analyzing-nersc.pptx.pdf |Slides}} * **Exploring more ways to use IO500 benchmark and IO500 list** -- //Radita Liem// \\ {{ :events:2021:21-bof-analyzing-radita.pptx |Slides}} * **Determining I/O-Weather** -- //Julian Kunkel// \\ {{ :events:2021:21-bof-analyzing-kunkel.pdf |Slides}} * **I/O Monitoring with PIKA** -- //Sebastian Oeste// \\ {{ :events:2021:21-bof-analyzing-pika.pdf |Slides}} * **Panel and discussion** -- (moderated by Julian Kunkel)