Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
teaching:autumn_term_2021:hpda [2021-10-21 16:42]
Julian Kunkel [Examination]
teaching:autumn_term_2021:hpda [2021-12-10 16:58]
Julian Kunkel [Agenda]
Line 13: Line 13:
 || Contact || [[about:people:julian_kunkel|Julian Kunkel]] ||  || Contact || [[about:people:julian_kunkel|Julian Kunkel]] || 
 || Location || Virtual, [[https://meet.gwdg.de/b/jul-gpr-4ao-ndv|meeting room]] || || Location || Virtual, [[https://meet.gwdg.de/b/jul-gpr-4ao-ndv|meeting room]] ||
-|| Time || Monday 16-18 (lecture), Monday 12-14 (lunch exercise!) ||+|| Time || Monday 16:15-17:45 (lecture), Monday 12:15-13:45 (lunch exercise!) ||
 || Language || English || || Language || English ||
 || Module || Modul B.Inf.1712: Vertiefung Hochleistungsrechnen, Module M.Inf.1236: High-Performance Data Analytics  || || Module || Modul B.Inf.1712: Vertiefung Hochleistungsrechnen, Module M.Inf.1236: High-Performance Data Analytics  ||
Line 68: Line 68:
 ===== Agenda ===== ===== Agenda =====
  
-  * 25.10.21 - **Lecture Overview. Use Cases.**  +  * 25.10.21 - **Lecture Overview. Use Cases.** -- {{ :teaching:autumn_term_2021:hpda01-lecture-01.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda01-01.pdf |Exercise}} 
-    * Exercise: There is **no exercise** today! +    * Exercise: There is **no meeting** today! 
-  * 01.11.21 - **System Architectures and Distributed Algorithms *+    Exercise sheet 1 is due next week! 
-    * Exercise: Discussion of use cases covering business/industry and science. Sketching the analytics pipeline for a use case. +    * Exercise topics: Discussion of use cases covering business/industry and science. Sketching the analytics pipeline for a use case. 
-  * 08.11.21 - **Data Models and Data Processing Strategies** +  * 01.11.21 - **Data Models and Data Processing Strategies** -- {{ :teaching:autumn_term_2021:hpda01-lecture-02.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda01-02.pdf |Exercise}} 
-    * ExerciseSketching system architectures and the execution of distributed algorithms. +    * Exercise: Developing data models for selected use cases. Researching performance for HPDA. Python Word-Count.  
-  * 15.11.21 **Databases and Data Warehouses** +  * 08.11.21 - **Databases and Data Warehouses** -- {{ :teaching:autumn_term_2021:hpda21-lecture-03.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda21-03.pdf |Exercise}}
-    * Exercise: Developing data models for selected use cases. Sketching the processing pipeline+
-  * 22.11.21 - **Distributed Storage and Processing with Hadoop**+
     * Exercise: Developing a database schema and SQL queries.     * Exercise: Developing a database schema and SQL queries.
-  * 29.11.21 - **Designing Distributed Systems and Performance Modelling** +  * 15.11.21 - **Distributed Storage and Processing with Hadoop** -- {{ :teaching:autumn_term_2021:hpda21-lecture-04.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda21-04.pdf |Exercise}} 
-    * Exercise: Data processing with Hadoop. +    * Exercise: MapReduce processing with Python. Sketching the difference between SQL running via Hadoop (and Hive) vsa traditional relational database vs. a data warehouse 
-  * 06.12.21 - **Dataflow Computation** +  * 22.11.21 - **Dataflow Computation and Big Data SQL using Hive** -- {{ :teaching:autumn_term_2021:hpda21-lecture-05-hive.pdf |Slides Hive}} -- {{ :teaching:autumn_term_2021:hpda21-lecture-05-dataflow.pdf |Slides Dataflow}} -- {{ :teaching:autumn_term_2021:hpda21-05.pdf |Exercise}} 
-    * Exercise: Performance analysis of scenariosAnalysing mappings of use cases to systems+    * Exercise: MapReduce via Streaming in HadoopDeveloping a dataflow system in Python
-  * 13.12.21 - **Columnar Access and Document Storage** +  * 29.11.21 - **Columnar Access and Document Storage** -- {{ :teaching:autumn_term_2021:hpda21-lecture-06.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda21-07.pdf |Exercise}} 
-    * Exercise: Developing a dataflow system. +    * Exercise: Managing data using MongoDB 
-  * 20.12.21 - **In-Memory Computation** +  * 06.12.21 - **In-Memory Computation** -- {{ :teaching:autumn_term_2021:hpda21-lecture-07.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda21-07a.pdf |Exercise}}
-    * ExerciseProcessing data using HBASE and MongoDB +
-  * 10.01.22 **Stream Processing **+
     * Exercise: Data processing using Spark     * Exercise: Data processing using Spark
-  * 17.01.22 - **Visual Analytics and Large-Scale Data Analysis**+  * 13.12.21 - **Stream Processing ** -- {{ :teaching:autumn_term_2021:hpda21-lecture-08.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda21-08.pdf |Exercise}} 
 +    * Exercise:  
 +  * 20.12.21 - **The Apache Ecosystem and Beyond** -- Slides -- Exercise -- //This slide deck is optional and not subject to examination// 
 +    * Exercise: None 
 +  * 10.01.22 - **Designing Distributed Systems and Performance Modelling** -- Slides -- Exercise 
 +    * During the exercise, we discuss any questions you may have. 
 +    * Exercise: Sketching system architectures and the execution of distributed algorithms. Performance analysis of scenarios. Analyzing mappings of use cases to systems.  
 +  * 17.01.22 - **Visual Analytics and Large-Scale Data Analysis** -- Slides -- Exercise
     * Exercise: Sketching stream workflows for use cases     * Exercise: Sketching stream workflows for use cases
-  * 24.01.22 - **Storage Systems in Cloud and HPC**+  * 24.01.22 - **Storage Systems in Cloud and HPC** -- Slides -- Exercise
     * Exercise: Developing a visualization using GoJS     * Exercise: Developing a visualization using GoJS
-  * 31.01.22 - **Use Cases in AeroSpace** (tentative title) -- Cornelia Grabe (DLR) +  * 31.01.22 - **Use Cases in AeroSpace** (tentative title) -- Cornelia Grabe (DLR) -- Slides
     * Exercise: Performance analysis of storage solutions     * Exercise: Performance analysis of storage solutions
   * 07.02.22 - **Summary**   * 07.02.22 - **Summary**
     * Exercise: Q&A Session     * Exercise: Q&A Session
  
 +===== Links =====
 +  * Example Scripts: https://github.com/JulianKunkel/hpda-samples
  
  • teaching/autumn_term_2021/hpda.txt
  • Last modified: 2022-02-22 16:55
  • by Julian Kunkel