Differences

This shows you the differences between two versions of the page.

--- teaching:autumn_term_2021:hpda [2021-10-21 16:42]
Julian Kunkel [Examination]
+++ teaching:autumn_term_2021:hpda [2021-12-10 16:58]
Julian Kunkel [Agenda]
@@ Line 13: / Line 13: @@
 || Contact || [[about:people:julian_kunkel|Julian Kunkel]] ||
 || Location || Virtual, [[https://meet.gwdg.de/b/jul-gpr-4ao-ndv|meeting room]] ||
-|| Time || Monday 16-18 (lecture), Monday 12-14 (lunch exercise!) ||
+|| Time || Monday 16:15-17:45 (lecture), Monday 12:15-13:45 (lunch exercise!) ||
 || Language || English ||
 || Module || Modul B.Inf.1712: Vertiefung Hochleistungsrechnen, Module M.Inf.1236: High-Performance Data Analytics  ||
@@ Line 68: / Line 68: @@
 ===== Agenda =====
-  * 25.10.21 - **Lecture Overview. Use Cases.**
+  * 25.10.21 - **Lecture Overview. Use Cases.** -- {{ :teaching:autumn_term_2021:hpda01-lecture-01.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda01-01.pdf |Exercise}}
-    * Exercise: There is **no exercise** today!
+    * Exercise: There is **no meeting** today!
-  * 01.11.21 - **System Architectures and Distributed Algorithms **
+    * Exercise sheet 1 is due next week!
-    * Exercise: Discussion of use cases covering business/industry and science. Sketching the analytics pipeline for a use case.
+    * Exercise topics: Discussion of use cases covering business/industry and science. Sketching the analytics pipeline for a use case.
-  * 08.11.21 - **Data Models and Data Processing Strategies**
+  * 01.11.21 - **Data Models and Data Processing Strategies** -- {{ :teaching:autumn_term_2021:hpda01-lecture-02.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda01-02.pdf |Exercise}}
-    * Exercise: Sketching system architectures and the execution of distributed algorithms.
+    * Exercise: Developing data models for selected use cases. Researching performance for HPDA. Python Word-Count.
-  * 15.11.21 - **Databases and Data Warehouses**
+  * 08.11.21 - **Databases and Data Warehouses** -- {{ :teaching:autumn_term_2021:hpda21-lecture-03.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda21-03.pdf |Exercise}}
-    * Exercise: Developing data models for selected use cases. Sketching the processing pipeline.
-  * 22.11.21 - **Distributed Storage and Processing with Hadoop**
     * Exercise: Developing a database schema and SQL queries.
-  * 29.11.21 - **Designing Distributed Systems and Performance Modelling**
+  * 15.11.21 - **Distributed Storage and Processing with Hadoop** -- {{ :teaching:autumn_term_2021:hpda21-lecture-04.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda21-04.pdf |Exercise}}
-    * Exercise: Data processing with Hadoop.
+    * Exercise: MapReduce processing with Python. Sketching the difference between SQL running via Hadoop (and Hive) vs. a traditional relational database vs. a data warehouse
-  * 06.12.21 - **Dataflow Computation**
+  * 22.11.21 - **Dataflow Computation and Big Data SQL using Hive** -- {{ :teaching:autumn_term_2021:hpda21-lecture-05-hive.pdf |Slides Hive}} -- {{ :teaching:autumn_term_2021:hpda21-lecture-05-dataflow.pdf |Slides Dataflow}} -- {{ :teaching:autumn_term_2021:hpda21-05.pdf |Exercise}}
-    * Exercise: Performance analysis of scenarios. Analysing mappings of use cases to systems.
+    * Exercise: MapReduce via Streaming in Hadoop. Developing a dataflow system in Python.
-  * 13.12.21 - **Columnar Access and Document Storage**
+  * 29.11.21 - **Columnar Access and Document Storage** -- {{ :teaching:autumn_term_2021:hpda21-lecture-06.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda21-07.pdf |Exercise}}
-    * Exercise: Developing a dataflow system.
+    * Exercise: Managing data using MongoDB
-  * 20.12.21 - **In-Memory Computation**
+  * 06.12.21 - **In-Memory Computation** -- {{ :teaching:autumn_term_2021:hpda21-lecture-07.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda21-07a.pdf |Exercise}}
-    * Exercise: Processing data using HBASE and MongoDB
-  * 10.01.22 - **Stream Processing **
     * Exercise: Data processing using Spark
-  * 17.01.22 - **Visual Analytics and Large-Scale Data Analysis**
+  * 13.12.21 - **Stream Processing ** -- {{ :teaching:autumn_term_2021:hpda21-lecture-08.pdf |Slides}} -- {{ :teaching:autumn_term_2021:hpda21-08.pdf |Exercise}}
+    * Exercise:
+  * 20.12.21 - **The Apache Ecosystem and Beyond** -- Slides -- Exercise -- //This slide deck is optional and not subject to examination//
+    * Exercise: None
+  * 10.01.22 - **Designing Distributed Systems and Performance Modelling** -- Slides -- Exercise
+    * During the exercise, we discuss any questions you may have.
+    * Exercise: Sketching system architectures and the execution of distributed algorithms. Performance analysis of scenarios. Analyzing mappings of use cases to systems.
+  * 17.01.22 - **Visual Analytics and Large-Scale Data Analysis** -- Slides -- Exercise
     * Exercise: Sketching stream workflows for use cases
-  * 24.01.22 - **Storage Systems in Cloud and HPC**
+  * 24.01.22 - **Storage Systems in Cloud and HPC** -- Slides -- Exercise
     * Exercise: Developing a visualization using GoJS
-  * 31.01.22 - **Use Cases in AeroSpace** (tentative title) -- Cornelia Grabe (DLR)
+  * 31.01.22 - **Use Cases in AeroSpace** (tentative title) -- Cornelia Grabe (DLR) -- Slides
     * Exercise: Performance analysis of storage solutions
   * 07.02.22 - **Summary**
     * Exercise: Q&A Session
+===== Links =====
+  * Example Scripts: https://github.com/JulianKunkel/hpda-samples