• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

计算机工程与科学 ›› 2021, Vol. 43 ›› Issue (02): 191-198.

• 高性能计算 • 上一篇    下一篇

面向DRAM和NVM异构混合内存架构的排序连接算法优化

杨柳,金培权   

  1. (中国科学技术大学计算机科学与技术学院,安徽 合肥 230027)
  • 收稿日期:2020-05-15 修回日期:2020-07-17 接受日期:2021-02-25 出版日期:2021-02-25 发布日期:2021-02-23

Optimization of sort join algorithms on DRAM/NVM-based hybrid memory architecture

YANG Liu,JIN Pei-quan   

  1. (School of Computer Science and Technology,University of Science and Technology of China,Hefei 230027,China)
  • Received:2020-05-15 Revised:2020-07-17 Accepted:2021-02-25 Online:2021-02-25 Published:2021-02-23
  • Supported by:
    国家自然科学基金(61672479,62072419)

摘要: 随着计算机技术的高速发展,数据的应用规模也在不断扩大,各行各业对于数据存取速度的要求也越来越高。为了满足这种需求,内存数据库的思想被提出,然而传统的内存存储器DRAM由于密度和能耗的限制无法大规模集成和扩展。与此同时,非易失内存(NVM)以其性能高、密度高、能耗低的优势弥补了DRAM的不足。DRAM和NVM结合在一起组成的混合内存系统能够发挥出更高的性能和更强的扩展能力,同时也更加经济高效。在这种新的混合内存架构下,传统的算法面临着巨大的挑战,因为它们必须要对新的架构进行优化。故从数据库系统常用的排序连接算法出发,探索其在混合内存系统上的更优使用方式,提出了键值分离的排序连接算法,并在此基础上提出了3种不同的C-Join算法。实验结果表明,提出的方案达到了预期的目标,不仅减少了DRAM的使用,同时也提高了算法的时间性能。


关键词: 非易失性内存, 混合内存架构, 排序连接算法

Abstract: With the rapid development of computer technology, the application scale of data is also expanding, and all walks of life have higher and higher requirements for data access speed. To meet this demand, the idea of in-memory database has been proposed, whereas the traditional mainstream main memory DRAM are integrated and extended on a large scale due to the density and energy consumption constraints. At the same time, Non-Volatile Memory (NVM) makes up for DRAM with its high performance, high density, and low power consumption. A hybrid memory system combining DRAM and NVM can deliver better performance and greater scalability, while also being more cost-effective. Under this new hybrid memory architecture, traditional algorithms face huge challenges because they have to be optimized to meet the new architecture. Therefore, this paper starts from the sort join algorithm commonly used in database system, and explores its optimization on the hybrid memory system. We propose a new sort join algorithm with key-value separation, and three different C-Join algorithms based on it. Experimental results show that our scheme achieves the expected goal, which not only reduces the usage of DRAM but also improves the time performance of the algorithm.

Key words: non-volatile memory, hybrid memory architecture, sort join algorithm