This paper presents the results of a 1-year project aimed at testing the performance and scalability of AyraDB, a next-generation database, on Davinci-1 super-computer. AyraDB is unique as it is fully peer-to-peer, with no central node to coordinate other storage nodes and no need for caching data in-memory, with consequent linear scalability. All competing solutions, including the most popular databases such as MongoDB and Redis, are not fully peer-to-peer, have central coordination nodes and/or cache data in memory with a bottleneck to scalability. These unique features make AyraDB particularly suitable to store and retrieve satellite data, which are notoriously challenging due to their size and layered structure, and position it as an enabler of new use cases in the space economy. In this paper, we present the results of a large-scale test aimed at verifying and measuring AyraDB's performance on Davinci-1's HPC infrastructure. An HPC infrastructure is in fact designed for data- and processing-intensive applications and can support scalability without infrastructural bottlenecks limiting software performance. Tests have been performed with a total of 500 runs on a number of 8-core servers growing from 1 to 20 and a data size growing from 10 Gbyte to 500 Gbyte. Results show how AyraDB reaches 1 million requests/s with 13 servers, with linear scalability and consistent read/write performance, beating the state of the art by 5X factor.

Benchmarking AyraDB next-generation database on Davinci-1 super-computer

Chiara Francalanci;Paolo Giacomazzi;Paolo Ravanelli
2022-01-01

Abstract

This paper presents the results of a 1-year project aimed at testing the performance and scalability of AyraDB, a next-generation database, on Davinci-1 super-computer. AyraDB is unique as it is fully peer-to-peer, with no central node to coordinate other storage nodes and no need for caching data in-memory, with consequent linear scalability. All competing solutions, including the most popular databases such as MongoDB and Redis, are not fully peer-to-peer, have central coordination nodes and/or cache data in memory with a bottleneck to scalability. These unique features make AyraDB particularly suitable to store and retrieve satellite data, which are notoriously challenging due to their size and layered structure, and position it as an enabler of new use cases in the space economy. In this paper, we present the results of a large-scale test aimed at verifying and measuring AyraDB's performance on Davinci-1's HPC infrastructure. An HPC infrastructure is in fact designed for data- and processing-intensive applications and can support scalability without infrastructural bottlenecks limiting software performance. Tests have been performed with a total of 500 runs on a number of 8-core servers growing from 1 to 20 and a data size growing from 10 Gbyte to 500 Gbyte. Results show how AyraDB reaches 1 million requests/s with 13 servers, with linear scalability and consistent read/write performance, beating the state of the art by 5X factor.
2022
Proceedings of the 1st Italian Conference on Big Data and Data Science (ITADATA 2022)
File in questo prodotto:
File Dimensione Formato  
ITADATA_2022_9.pdf

Accesso riservato

Dimensione 841.45 kB
Formato Adobe PDF
841.45 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11311/1229906
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact