Design and Implementation of Power Big Data Platform

In recent years, with the advancement of the national construction of smart grid and the development of power grid enterprise integration system, the traditional power data platform has some defect, such as insufficient scalability, repeated implementation of two sets of logic of off-line data wareh...

Full description

Saved in:
Bibliographic Details
Published in:Journal of physics. Conference series 2023-12, Vol.2665 (1), p.12001
Main Authors: Zhao, Zongluo, Li, Qiangqiang, Zhao, Zhixin, Zhang, Haida, Han, Qianqian, Ju, Xiaoming
Format: Article
Language:English
Subjects:
Big Data
Data analysis
Data storage
Data warehouses
Electric equipment
Electric power grids
Enterprise integration
Information management
Machine learning
Physics
Power consumption
Real time
Smart grid
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In recent years, with the advancement of the national construction of smart grid and the development of power grid enterprise integration system, the traditional power data platform has some defect, such as insufficient scalability, repeated implementation of two sets of logic of off-line data warehouse and real-time data warehouse, highly correlated storage of data warehouse during computation, and difficulty in platform migration, which restrict the deeper mining and analysis of power big data. Therefore, this paper adopts a technical architecture incorporating distributed calculating, micro-service, flow-batch integration and lake-warehouse integration, combining the current popular Web front-end and back-end technologies such as Vue, SpringCloud and Flask, and utilizing big data components such as Hadoop, Flink, Hudi and Kafka as well as Docker containerization technology. We explore and build a power grid system operation oriented big data platform that assembles real-time computing, multi-source heterogeneous data storage, and develop APIs for authority management, information management, data analysis and visualization, machine learning and other data supporting services that assist power enterprises in managing electrical equipment and users’ power consumption.With the help of this platform, power enterprises can intelligently track the equipment status, view the offline and real-time visual charts to analyze the power consumption by users, so as to have better basis in the power dispatching, maintenance and scheme adjustment of electrical market.
ISSN:1742-6588
1742-6596
DOI:10.1088/1742-6596/2665/1/012001