Gesellschaft für Informatik e.V.

Lecture Notes in Informatics

Informatik 2014 P-232, 1797-1810 (2014).

Gesellschaft für Informatik, Bonn

Copyright © Gesellschaft für Informatik, Bonn


Asynchronous logging and fast recovery for a large-scale distributed in-memory storage

Kevin Beineke , Florian Klein and Michael Schöttner


Large-scale interactive applications and online graph analytic processing require very fast data access to many small data objects. DXRAM addresses these challenges by keeping all data always in memory of potentially many nodes aggregated in a data center. Data loss in case of node failures is prevented by an asynchronous logging on flash disks. In this paper we present the architecture of a novel logging service designed to support billions of small data objects, flash disk characteristics and fast node recovery. The latter is challenging if 32-64 GB of in-memory data of a failed node needs to be recovered in seconds from the logs.

Full Text: PDF

Gesellschaft für Informatik, Bonn
ISBN 978-3-88579-626-8

Last changed 18.11.2014 21:18:15