The focus of this lecture lies in and around enterprise applications with regards to in-memory databases. The lecture will largely be based on the new book by Plattner and Zeier, which is available for free to all enrolled students. The contents of the lecture include:
* Design
o Introduction to design thinking and how it can help in the software development process
o Design research overview of activities at HPI and Center for Design Research at Stanford University
* Complexity and characteristics of enterprise applications
o Focus on financial accounting
o How accounting systems were built previously and how they can be built simpler today (e.g. reducing complexity by avoiding materialized aggregates)
* Column-oriented, in-memory databases and compression
* Trends in hardware
o The shift from disk to main-memory
o The CPU / memory boundary as the new bottleneck
* Parallel programming
o Why is it hard to introduce parallelism to business applications?
o Multi-core CPUs and how they change the way we must program
* Deployment options
o On-premise vs. Software-as-a-Service
o Massive parallelism by building a cluster of SMP machines (e.g. blade servers)
* Maintenance of software and interface compatibility
Introduction to In-Memory Column Databases I | 01:23:39 | |
---|---|---|
Introduction | 00:14:51 | |
Apply Major Access Patterns | 00:21:50 | |
Columner Store | 00:14:35 | |
The Main Disadvantage | 00:09:27 | |
OLAP & OLTP | 00:22:56 |
Introduction to In-Memory Column Databases II | 01:19:50 | |
---|---|---|
Q & A | 00:08:04 | |
Text Retrieval and Exploration | 00:06:59 | |
Combined Column and Row Store | 00:14:42 | |
Bulk Load | 00:17:01 | |
Object to Relational Mapping | 00:19:48 | |
Dictionary Compression | 00:13:16 |
Introduction to In-Memory Column Databases III | 00:43:13 | |
---|---|---|
Parallel Filter/Aggregation I | 00:13:36 | |
Parallel Filter/Aggregation II | 00:13:50 | |
Key Observations | 00:15:47 |
Memory Hierarchy & The New Bottleneck = Cache Conscious Data Access | 01:00:49 | |
---|---|---|
Agenda | 00:14:06 | |
Writing | 00:16:00 | |
How to Exploit the Memory Hierarchy | 00:11:58 | |
Virtualized Access | 00:18:45 |
Data Structures for In-memory Applications and the Merge Process | 00:39:15 | |
---|---|---|
Recap on Memory Access | 00:16:06 | |
Partition Attributes Across (PAX) | 00:08:47 | |
In-Memory Databases | 00:14:22 |
Parallelization | 01:50:17 | |
---|---|---|
Q & A I | 00:17:29 | |
Q & A II | 00:19:17 | |
Q & A III | 00:12:23 | |
Parallel Processing | 00:17:31 | |
Parallelism in NewDB | 00:16:14 | |
Parallel Filter/Join | 00:07:08 | |
Object Customer Order | 00:20:15 |
Deploying Enterprise Applications on RAMCloud | 00:40:05 | |
---|---|---|
What is RAMCloud? | 00:10:48 | |
Log-structured Memory | 00:08:27 | |
Why is RAMCloud interesting for Enterprise In-Memory Computing? | 00:09:43 | |
Object Sizing | 00:11:07 |
Complexity and Characteristics of Enterprise Apps | 00:26:25 | |
---|---|---|
EA Requirements are diverse and complex | 00:08:53 | |
EA have different interaction paradigms | 00:11:45 | |
EA comprise layers | 00:05:47 |
Enterprise-specific Data Management | 00:58:10 | |
---|---|---|
Sparse Enterprise Data | 00:16:59 | |
Handling Data Modifcations | 00:13:09 | |
Main Store - Valid Tuples | 00:15:22 | |
Merge Dictionary | 00:12:40 |
In-Memory Applications Intro & Dunning | 01:18:43 | |
---|---|---|
Q & A I | 00:12:55 | |
Q & A II | 00:11:44 | |
In-Memory Applications | 00:12:43 | |
In-Memory Technology Trigger | 00:16:12 | |
Dunning | 00:15:43 | |
Dunning II | 00:09:26 |
Text Search in Enterprise Applications | 00:57:34 | |
---|---|---|
Basic Text Search Functionalities | 00:12:07 | |
Advanced Text Search Functionalities | 00:16:13 | |
Details on Core-Algorithms | 00:11:17 | |
Property Table | 00:06:10 | |
Demo | 00:11:47 |
Source Code Search | 00:26:35 | |
---|---|---|
Source Code Search | 00:09:28 | |
Demo I | 00:04:37 | |
Demo II | 00:12:30 |
Student Presentations | 00:59:57 | |
---|---|---|
Next Generation Demand Planning | 00:05:36 | |
Maintenance Planning with SanssouciDB | 00:08:13 | |
Sales | 00:07:14 | |
Enercon | 00:06:32 | |
Demand Planning | 00:06:36 | |
Airplane Maintenance | 00:07:04 | |
Customer Relation Management and Sales | 00:11:02 | |
Dynamic Pricing | 00:07:40 |