Gesellschaft für Informatik e.V.

Lecture Notes in Informatics

Datenbanksysteme für Business, Technologie und Web (BTW 2015) P-241, 351-360 (2015).

Gesellschaft für Informatik, Bonn

Copyright © Gesellschaft für Informatik, Bonn


Who watches the watchmen? on the lack of validation in nosql benchmarking

Wolfram Wingerath , Steffen Friedrich , Felix Gessert and Norbert Ritter


There are numerous approaches towards quantifying the performance of NoSQL datastores with respect to dimensions that are notoriously hard to capture such as staleness or consistency in general. Many of these approaches, though, are built on assumptions regarding the underlying infrastructure or the test scenario and may lead to invalid results, if those assumptions do not hold. As a consequence, in-depth knowledge of both the system under test and the benchmarking procedure is required to prevent misleading results. In this paper, we want to make the case for more experimental validation in NoSQL benchmarking to uncover the bounds of existing benchmarking approaches.

Full Text: PDF

Gesellschaft für Informatik, Bonn
ISBN 978-3-88579-635-0

Last changed 30.04.2015 15:16:33