| 数据湖技术在气象卫星资料业务共享中的应用 |
| |
| 作者姓名： | 白铁男 唐维尧 金石声 谭海波 |
| |
| 作者单位： | 贵州省气象信息中心,贵州省气象信息中心,贵州省气象信息中心,贵州省气象信息中心 |
| |
| 基金项目： | 贵州省气象局科研登记制项目“基于数据湖实现CMACast共享资料统一管理的研究” |
| |
| 摘 要： | 文章依托大数据云平台·天擎系统的共享NAS存储，通过省级气象通信系统的文件分发策略，将气象卫星广播数据迁移到共享NAS上进行统一存储。基于B/S系统构架搭建气象数据湖对大数据云平台·天擎系统的共享NAS存储上的数据进行统一管理。数据湖提供了前端图形界面对目录权限和账户权限统一管理，一方面规范了数据访问权限，保障了数据和账户的安全性。另一方面解决了因数据反复迁移、多处存储而造成的资源浪费，符合气象业务的发展需求。
|
| 关 键 词： | 天擎 数据湖集群 CMACast NAS存储 安全管理 |
| 收稿时间： | 2021/11/8 0:00:00 |
| 修稿时间： | 2022/2/18 0:00:00 |
The Application of Data Lake Technology in The Sharing of Meteorological Satellite Data Service |
| |
| Authors: | Baitienan tangweiyao jinshisheng and tanhaibo |
| |
| Institution: | Guizhou Provincial Center of Meteorological Information Support,Guizhou Meteorological Information Center,Guizhou Meteorological Information Center,Guizhou Meteorological Information Center |
| |
| Abstract: | The article relies on the shared NAS storage of the big data cloud platform, Tianqing system, and through the file distribution strategy of the provincial meteorological communication system, the meteorological satellite broadcast data is migrated to the shared NAS for unified storage. Based on the B/S system architecture, a meteorological data lake is built to uniformly manage the data on the shared NAS storage of the big data cloud platform·Tianqing system. Data Lake provides a front-end graphical interface for unified management of directory permissions and account permissions. On the one hand, it regulates data access permissions and ensures the security of data and accounts. On the other hand, it solves the waste of resources caused by repeated data migration and multiple storage, which meets the development needs of meteorological services. |
| |
| Keywords: | |
|
| 点击此处可从《》浏览原始摘要信息 |
| 点击此处可从《》下载免费的PDF全文 |
