This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
events:2020:sig-io-uk [2020-01-16 11:48]
Julian Kunkel [Speakers]
events:2020:sig-io-uk [2020-05-14 11:40] (current)
Julian Kunkel [Agenda]
Line 13: Line 13:
 Users present their challenges dealing with I/O and ongoing RD&E to overcome them. Users present their challenges dealing with I/O and ongoing RD&E to overcome them.
 Vendor talks focus on technical solutions for specific challenges accompanied by use cases demonstrating the benefit. Vendor talks focus on technical solutions for specific challenges accompanied by use cases demonstrating the benefit.
-We welcome the submission of talks and short papers (in LaTeX article format) that summarise the challenges and ongoing effort in different institutions. This effort will lead to a joint paper submitted to Springer Lecture Notes in Computer Science as part of the ISC-HPC proceedings. 
 || Registration deadline || February 20th, 2020 || || Registration deadline || February 20th, 2020 ||
-|| Date || Thursday23rd, April, 2020 || +|| Date || Thursday 23rd, April, 2020 || 
-|| Venue || AI Lab, Room 185, 1st floor, Polly Vacher, Department of Computer Science, Reading University ([[:​about:​visits|Travel information]]) ​|| +|| Venue || Virtual meeting using BlackBoard Collaborate ​|| 
 || Contact || [[about:​people:​julian kunkel]] || || Contact || [[about:​people:​julian kunkel]] ||
Line 44: Line 41:
 ===== Agenda ===== ===== Agenda =====
-//The following ​is the tentative agenda structure//+//The workshop ​is held as a virtual event and we will record ​the presentations.//
-  ​* //09:30 Welcome ​coffee//+The videos are available in the [[https://​www.youtube.com/​playlist?​list=PL_PBXYC_ExoPMhElqPdy83RNP5SVCi9ZC|YouTube playlist]]. 
 +  ​10:00 **Welcome** -- Julian Kunkel \\ {{ :​events:​2020:​sig-io-uk-intro.pdf |Slides}} 
 +  * 10:05 **Toward Next Generation Interfaces for Exploiting Workflows** -- Julian Kunkel \\ //The efficient, convenient, and robust execution of data-driven workflows is key for productivity in scientific computing. However, managing IO workflows efficiently in data centers is challenging for users. In order to achieve the best IO performance,​ a user must consider the characteristics of the various available storage systems and file systems and map the IO of their workflows manually to the storage systems. This talk introduces a wider datacenter vision on the handling of workflows and then our general vision the abstraction bears to the typical IO stack in the domain of climate and weather. Within ESiWACE, we move toward this vision by integrating capabilities into the software stack that increases the abstraction level of IO within workflows and enables the software stack to optimize data placement and handle the information lifecycle automatically. We then show our design for the ESiWACE prototype that utilizes software components such as Cylc, SLURM, ESDM, and XIOS. Next, we discuss how such an approach could be integrated into existing workflows. Finally, the Next-Generation Interfaces effort is introduced.//​ \\ {{ :​events:​2020:​sig-io-uk-kunkel-workflows.pdf |Slides}} 
 +  * 10:30 **Persistent memory for I/O** -- Adrian Jackson \\ //This talk presents the work done during the EU funded NEXTGenIO project, looking at enabling exascale I/O for computational simulation, data analytics, and machine learning. We focus on non-volatile,​ in-node, memory, how it can be used, and the performance benefits and usage pitfalls that it provides.// \\ {{ :​events:​2020:​sig-io-uk-nextgenio.pdf |Slides}} 
 +  * 11:00 **Sage2: Addressing Exascale Storage Challenges** -- Sai Narasimhamurthy \\ {{ :​events:​2020:​sig-io-uk-sage2_-addressing_exascale_storage_challanges.pdf |Slides}} 
 +  * 11:30 **Interoperability as the new frontier** -- Jean-Thomas Acquaviva \\ //As illustrated by IO500 benchmark in recent years HPC storage systems have considerably push the boundaries of performance. Not only from a quantitative standpoint with unprecedented throughput or capacity numbers but also in qualitative terms with the ability to deal with a much larger spectrum of workloads. Such progress, driven by new workloads such as AI are only of part of the answer. Nowadays performance equation has to integrated the complexity of the environment,​ storage systems are not used only as output for huge numerical simulations but integrated within the complex work and data flows. Therefore, the new frontier is about interoperability and the ability for a storage solution to be seamlessly integrated with other data hubs such as clouds either private or public. Our talk will discuss the evolution of the raw performances and will open-up on the on-going efforts for a better integration within modern data flows. This is the ransom of success and the way HPC technologies will carve their way to mainstream environments.// ​ \\ {{ :​events:​2020:​sig-io-uk-ddn.pdf |Slides}} 
 +  * 12:00 **The Benefits and Challenges of Elastic In Situ Analysis and Visualization** -- Matthieu Dorier ​ \\ {{ :​events:​2020:​sig-io-uk-the_challenges_of_elastic_in_situ_analysis_and_visualization.pptx |Slides}} - [[https://​dl.acm.org/​doi/​10.1145/​3364228.3364234 
 +  * //12:30 Virtual lunch break// ​  
 +  * 13:00 **Storage at DLS - One Size fits no one** -- Frederik Ferner ​ \\ {{ :​events:​2020:​sig-io-uk-diamond-light-source.pdf |Slides}} 
 +  * 13:30 **ECMWF’s Exascale IO challenges — From inside the HPC to a whole Data archive migration** -- Tiago Quintino ​ \\ {{ :​events:​2020:​sig-io-uk-ecmwf.pdf |Slides}} 
 +  * 14:00 **Semantic storage of climate data on object store** -- Neil Massey ​ \\ {{ :​events:​2020:​sig-io-uk-s3netcdfpython.pptx |Slides}} 
 +  * 14:20 **Exploiting Heterogeneous Resource Utilization for Scientific Workflows** -- Erdem Yilmaz ​ \\ {{ :​events:​2020:​sig-io-uk-exploitingheterogeneousresourceutilisation.pdf |Slides}} 
 +  * 14:40 **Discussion:​ Supporting the I/O needs for applications (specifically in the UK)** 
 +  * //15:00 Virtual ​coffee ​break / discussion // 
 +  * 15:30 **Memory vs. Storage Software and Hardware: The Shifting Landscape** -- Jay Lofstead \\ //New memory technologies,​ such as the persistent memory modules supported by the latest Intel chips offer a persistent storage device accessible on the memory bus. NVMe and other high-performance storage devices offer extreme performance at increasingly affordable prices. With these technology shifts, what software we use for different tasks and what we can afford to do is changing. This talk will explore how things are changing and where new opportunities to enable science exist.// ​ \\ {{ :​events:​2020:​sig-io-uk-memory_vs._storage.pdf |Slides}} 
 +  * 16:00 **Application IO analysis with Lustre Monitoring using LASSi for ARCHER** -- Karthee Sivalingam ​ \\ {{ :​events:​2020:​sig-io-uk-lassi.pdf |Slides}} 
 +  * 16:30 **Classifying Temporal Characteristics of Job I/O Patterns Using Machine Learning Techniques** -- Eugen Betke  \\ {{ :​events:​2020:​sig-io-uk-betke.pdf |Slides}} 
 +  * 17:00 **Discussion:​ Hot topics** \\ {{ :​events:​2020:​sig-io-uk-hot_topics.pptx |Results}}  
 +  * //17:30 Farewell//  
-  * //12:00 Lunch, sponsored by DDN//\\ 
-  * //14:30 Coffee break// \\ 
-  ​ 
-  * //17:00 Adjourn// 
 ===== Registration ===== ===== Registration =====
 Send an email to [[mailto:​j.m.kunkel@reading.ac.uk|Julian Kunkel]] for registration. Check that you get a confirmation. Send an email to [[mailto:​j.m.kunkel@reading.ac.uk|Julian Kunkel]] for registration. Check that you get a confirmation.
-The official deadline for registration is Feb. 20th, but you may check if seats are still available after this date. 
 Speakers must check the [[http://​www.reading.ac.uk/​web/​files/​policy/​External-Speaker-Code-of-Conduct.pdf|University of Reading - External Speaker Code of Conduct]] and comply with these rules. Speakers must check the [[http://​www.reading.ac.uk/​web/​files/​policy/​External-Speaker-Code-of-Conduct.pdf|University of Reading - External Speaker Code of Conduct]] and comply with these rules.
-===== Speakers ===== 
-**[[https://​www.researchgate.net/​profile/​Julian_Kunkel|Julian Kunkel]]** ​ 
-is a Lecturer at the [[https://​www.reading.ac.uk/​computer-science/​|Department of Computer Science at the University of Reading]]. He manages several research projects revolving around High-Performance Computing and particularly high-performance storage and is member of the [[https://​aces.cs.reading.ac.uk/​|Advanced Computing for Environmental Science (ACES) research group]]. Besides his main goal to provide efficient and performance-portable I/O, his HPC-related interests are: data reduction techniques, performance analysis of parallel applications and parallel I/O, management of cluster systems, cost-efficiency considerations,​ and software engineering of scientific software.