• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

J4 ›› 2015, Vol. 37 ›› Issue (11): 1989-1996.

• 论文 • 上一篇    下一篇

云计算环境下基于数据关联度的海洋监测大数据布局策略

黄冬梅1,随宏运1,贺琪1,赵丹枫1,杜艳玲1,苏诚2   

  1. (1.上海海洋大学信息学院,上海 201306;2.国家海洋局东海信息中心,上海 200136)
  • 收稿日期:2015-07-13 修回日期:2015-09-20 出版日期:2015-11-25 发布日期:2015-11-25
  • 基金资助:

    国家自然科学基金资助项目(61272098);上海市自然科学基金资助项目(13ZR1455800);海洋公益性行业科研专项(2011050346)

A marine monitoring big data placement strategy in cloud
computing environment based on data dependency  

HUANG Dongmei1,SUI Hongyun1,HE Qi1,ZHAO Danfeng1,DU Yanling1,SU Cheng2   

  1. (1.College of Information,Shanghai Ocean University,Shanghai 201306;
    2.East China Sea Branch of S.O.A,Shanghai 201306,China)
  • Received:2015-07-13 Revised:2015-09-20 Online:2015-11-25 Published:2015-11-25

摘要:

海洋监测数据是具有强数据关联的大数据,如何高效地进行数据布局,是制约其有效管理和应用的关键问题之一。在云计算环境下,针对海洋监测大数据的特点,提出了一种基于数据关联度的海洋监测大数据布局策略。在保证数据中心存储均衡的情况下,综合考虑了监测任务、监测点和监测数据之间的关联,建立了海洋监测点间的关联度、监测数据间的关联度和监测数据全局关联度,从三个角度对海洋监测大数据进行布局,使得同一数据中心内的数据具有较高的关联度。通过实验分析,该 方法降低了用户访问海洋监测大数据的响应时间,为海洋监测大数据提供了一种有效的布局策略。

关键词: 海洋监测大数据, 云计算环境, 数据布局, 关联度

Abstract:

Marine monitoring data is big and has strong data dependency. How to design a fast placement strategy and control the marine data efficiently becomes more and more important for the management and the application of big marine monitoring data. In cloud computing environments, according to the characteristics of big marine monitoring data we propose a placement strategy based on data dependency. Under the condition of guaranteeing the load balancing of data centers, the dependencies among monitoring tasks, monitoring points and monitoring data are considered comprehensively. The dependency of monitoring points, the dependency of monitoring data and the overall dependency of monitoring data are established.According to the three kinds of dependencies, the marine data placement is done so as to make the big marine monitoring data in the same data center with higher dependency.Experimental results show that our strategy reduces the response time of ocean monitoring data access and provides an effective placement strategy for ocean monitoring data.

Key words: big marine monitoring data;cloud computing environment;data placement;dependency