TY - GEN
T1 - Accelerating read atomic multi-partition transaction with remote direct memory access
AU - Murata, Naofumi
AU - Kawashima, Hideyuki
AU - Tatebe, Osamu
N1 - Publisher Copyright:
© 2017 IEEE.
PY - 2017/3/17
Y1 - 2017/3/17
N2 - Many applications these days require data processing that is both efficient and reliable. Distributed databases are one way to meet these requirements, but must be updated using distributed transactions. To manage foreign key constraints, secondary indices, and materialized views in distributed environments, read atomic multi-partition (RAMP) transactions demonstrate high efficiency. RAMP transactions achieved high performance distributed transaction processing by relaxing the isolation level. However, the use of fast interconnect to accelerate performance has not yet been considered. This paper proposes the acceleration of RAMP transactions by exploiting remote direct memory access (RDMA) on the InfiniBand interconnect. We first present GET+ and PUT+ operations that accelerate the RAMP transaction by exploiting RDMA write operations. We then present the GET∗ operation, which further accelerates GET+ operations exploiting RDMA read operations. To evaluate the proposed methods, we implemented a prototype distributed in-memory key-value store in C/C++. The results of the experiments show that compared with RAMP transactions on IP over InfiniBand, GET∗ and PUT+ achieve a 2.67× performance improvement on the Yahoo! Cloud Serving Benchmark. All of our code is publicly available.
AB - Many applications these days require data processing that is both efficient and reliable. Distributed databases are one way to meet these requirements, but must be updated using distributed transactions. To manage foreign key constraints, secondary indices, and materialized views in distributed environments, read atomic multi-partition (RAMP) transactions demonstrate high efficiency. RAMP transactions achieved high performance distributed transaction processing by relaxing the isolation level. However, the use of fast interconnect to accelerate performance has not yet been considered. This paper proposes the acceleration of RAMP transactions by exploiting remote direct memory access (RDMA) on the InfiniBand interconnect. We first present GET+ and PUT+ operations that accelerate the RAMP transaction by exploiting RDMA write operations. We then present the GET∗ operation, which further accelerates GET+ operations exploiting RDMA read operations. To evaluate the proposed methods, we implemented a prototype distributed in-memory key-value store in C/C++. The results of the experiments show that compared with RAMP transactions on IP over InfiniBand, GET∗ and PUT+ achieve a 2.67× performance improvement on the Yahoo! Cloud Serving Benchmark. All of our code is publicly available.
KW - Distributed Transaction
KW - RAMP Transaction
KW - RDMA
UR - http://www.scopus.com/inward/record.url?scp=85017642268&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85017642268&partnerID=8YFLogxK
U2 - 10.1109/BIGCOMP.2017.7881705
DO - 10.1109/BIGCOMP.2017.7881705
M3 - Conference contribution
AN - SCOPUS:85017642268
T3 - 2017 IEEE International Conference on Big Data and Smart Computing, BigComp 2017
SP - 239
EP - 246
BT - 2017 IEEE International Conference on Big Data and Smart Computing, BigComp 2017
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2017 IEEE International Conference on Big Data and Smart Computing, BigComp 2017
Y2 - 13 February 2017 through 16 February 2017
ER -