A Big Data Architecture Design for Smart Grids Based on Random Matrix Theory

• Published in: IEEE transactions on smart grid 2017-03, Vol.8 (2), p.674-686
• Main Authors: Xing He, Qian Ai, Qiu, Robert Caiming, Wentao Huang, Longjian Piao, Haichun Liu
• Format: Article
• Language: English
• Subjects: Algorithms; Architecture; Big Data; Computer architecture; Computer simulation; Correlation; Data models; Dimensional analysis; Energy flow; group-work mode; high-dimension; large-scale distributed system; Mathematical model; Matrix theory; mean spectral radius (MSR); random matrix; Situational awareness; Smart grid; Smart grids; Utilities
• ISSN: 1949-3053; 1949-3061
• DOI: 10.1109/TSG.2015.2445828

Model-based analysis tools, built on assumptions and simplifications, are difficult to handle smart grids with data characterized by volume, velocity, variety, and veracity (i.e., 4Vs data). This paper, using random matrix theory (RMT), motivates data-driven tools to perceive the complex grids in high-dimension; meanwhile, an architecture with detailed procedures is proposed. In algorithm perspective, the architecture performs a high-dimensional analysis and compares the findings with RMT predictions to conduct anomaly detections. Mean spectral radius (MSR), as a statistical indicator, is defined to reflect the correlations of system data in different dimensions. In management mode perspective, a group-work mode is discussed for smart grids operation. This mode breaks through regional limitations for energy flows and data flows, and makes advanced big data analyses possible. For a specific large-scale zone-dividing system with multiple connected utilities, each site, operating under the group-work mode, is able to work out the regional MSR only with its own measured/simulated data. The large-scale interconnected system, in this way, is naturally decoupled from statistical parameters perspective, rather than from engineering models perspective. Furthermore, a comparative analysis of these distributed MSRs, even with imperceptible different raw data, will produce a contour line to detect the event and locate the source. It demonstrates that the architecture is compatible with the block calculation only using the regional small database; beyond that, this architecture, as a data-driven solution, is sensitive to system situation awareness, and practical for real large-scale interconnected systems. Five case studies and their visualizations validate the designed architecture in various fields of power systems. To our best knowledge, this paper is the first attempt to apply big data technology into smart grids.