| 一种基于Storm编程模型的迭代Topology方案 |
| |
| 引用本文： | 杜政颉,王,鹏,黄,焱,郎福通.一种基于Storm编程模型的迭代Topology方案[J].成都信息工程学院学报,2014(1):47-51. |
| |
| 作者姓名： | 杜政颉 王 鹏 黄 焱 郎福通 |
| |
| 作者单位： | [1]成都信息工程学院软件工程学院并行计算实验室,四川成都610225 [2]中国科学院成都计算机应用研究所,四川成都610041 [3]中国科学院大学,北京100049 |
| |
| 基金项目： | 四川省青年科学基金资助项目（09ZQ026-068）;感谢成都市科技局创新发展战略研究项目（11RKYB016ZF）对本文的资助 |
| |
| 摘 要： | 为解决Storm编程模型无法处理具有迭代结构的应用程序的问题,从迭代结构程序的特点出发,在Storm编程模型的基础上通过增加Receiver、IBolt、Checker组件组建迭代Topology,设计了一种可以处理迭代结构的编程模型,分析了这种模型实现原理,对这种模型的新增组件和其对应的应用程序接口进行介绍和分析,同时,在Storm系统架构基础上设计了一种迭代Topology的实现方案,描述了这种实现方式下解决具有迭代结构程序的具体过程,最后使用这种模型模拟实现K-Means算法,实例论证这种迭代模型的可行性。
|
| 关 键 词： | 大数据 Storm 迭代 拓扑 |
An Iterative Topology Method based on Storm Programming Model |
| |
| DU Zheng-jie,WANG Peng,HUANG Yan,LANG Fu-tong.An Iterative Topology Method based on Storm Programming Model[J].Journal of Chengdu University of Information Technology,2014(1):47-51. |
| |
| Authors: | DU Zheng-jie WANG Peng HUANG Yan LANG Fu-tong |
| |
| Institution: | 1. Parallel Computing Lab, Chengdu University of Information Technology, Chengdu 610225, China;2. Chengdu Institute of Com- puter Application, Chinese Academy of Sciences, Chengdu 610041, China;3. University of Chinese Academy of Sciences, Beijing 100049, China) |
| |
| Abstract: | To resolve the problem that Storm programming model can not dispose the application program of iterative structures, this paper started with the characteristics of the program of iterative structures, constructed the iterative Topology by adding components Receiver, IBolt and Checker based on the Storm programming model, designed a new programming model which can deal with the iterative structures, analyzed the principle of this model, introduced the new components and its Application Programming Interfaces in detail, and made a design on its implementation, described the process of iterative structures programming. Finally simulated the implemention of the K-Means algo- rithm by the model, which proves its feasibility. |
| |
| Keywords: | big data Storm iterative topology |
| 本文献已被 CNKI 维普 等数据库收录！ |
|
